• It's recommended to check out the latest log via: the Stats page >> View log >> Tail

PROJECT (sourcing_v2), SPIDER (auto1.fr)

2026-01-29 06:00:11 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-01-29 06:00:11 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-01-29 06:00:11 [auto1.fr] INFO: Starting spider auto1.fr
2026-01-29 06:00:11 [scrapy.addons] INFO: Enabled addons:
[]
2026-01-29 06:00:11 [asyncio] DEBUG: Using selector: EpollSelector
2026-01-29 06:00:11 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-01-29 06:00:11 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-01-29 06:00:11 [scrapy.extensions.telnet] INFO: Telnet Password: 7b05ce85d3fbaead
2026-01-29 06:00:11 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-01-29 06:00:11 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.fr/task_31_2026-01-29T06_00_01.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-01-29 06:00:11 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-01-29 06:00:11 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-01-29 06:00:11 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-01-29 06:00:11 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-01-29 06:00:11 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-01-29 06:00:11 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-01-29 06:00:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:00:12 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-01-29 06:00:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-01-29 06:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:12 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-01-29 06:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-01-29 06:00:12 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-01-29 06:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: low_mileage_for_country.json
2026-01-29 06:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage.json
2026-01-29 06:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-01-29 06:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-01-29 06:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-01-29 06:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-01-29 06:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-01-29 06:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-01-29 06:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-01-29 06:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-01-29 06:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: cars_too_new_for_country.json
2026-01-29 06:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_price_for_currency.json
2026-01-29 06:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-01-29 06:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-01-29 06:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-01-29 06:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-01-29 06:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_country.json
2026-01-29 06:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-01-29 06:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-01-29 06:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-01-29 06:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-01-29 06:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-01-29 06:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: registration_date_old.json
2026-01-29 06:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_make.json
2026-01-29 06:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-01-29 06:00:12 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-01-29 06:00:12 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-01-29 06:00:12 [scrapy.core.engine] INFO: Spider opened
2026-01-29 06:00:12 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-01-29 06:00:12 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-01-29 06:00:12 [scrapy-playwright] INFO: Starting download handler
2026-01-29 06:00:12 [scrapy-playwright] INFO: Starting download handler
2026-01-29 06:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-01-29 06:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-01-29 06:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-01-29 06:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-01-29 06:00:21 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:00:21 [auto1.fr] INFO: Found listing with ID: RR80485
2026-01-29 06:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RR80485%27 HTTP/1.1" 200 None
2026-01-29 06:00:21 [auto1.fr] INFO: Scrape type for RR80485: 2
2026-01-29 06:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:21 [auto1.fr] INFO: Found listing with ID: EG82204
2026-01-29 06:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EG82204%27 HTTP/1.1" 200 None
2026-01-29 06:00:21 [auto1.fr] INFO: Scrape type for EG82204: 2
2026-01-29 06:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:21 [auto1.fr] INFO: Found listing with ID: CY92610
2026-01-29 06:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY92610%27 HTTP/1.1" 200 None
2026-01-29 06:00:21 [auto1.fr] INFO: Scrape type for CY92610: 2
2026-01-29 06:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:21 [auto1.fr] INFO: Found listing with ID: LJ44729
2026-01-29 06:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ44729%27 HTTP/1.1" 200 None
2026-01-29 06:00:21 [auto1.fr] INFO: Scrape type for LJ44729: 2
2026-01-29 06:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:21 [auto1.fr] INFO: Found listing with ID: DG06084
2026-01-29 06:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DG06084%27 HTTP/1.1" 200 None
2026-01-29 06:00:21 [auto1.fr] INFO: Scrape type for DG06084: 2
2026-01-29 06:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:21 [auto1.fr] INFO: Found listing with ID: BH30412
2026-01-29 06:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BH30412%27 HTTP/1.1" 200 None
2026-01-29 06:00:21 [auto1.fr] INFO: Scrape type for BH30412: 1
2026-01-29 06:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:21 [auto1.fr] INFO: Found listing with ID: AV10982
2026-01-29 06:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV10982%27 HTTP/1.1" 200 None
2026-01-29 06:00:21 [auto1.fr] INFO: Scrape type for AV10982: 1
2026-01-29 06:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:21 [auto1.fr] INFO: Found listing with ID: GA52113
2026-01-29 06:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GA52113%27 HTTP/1.1" 200 None
2026-01-29 06:00:21 [auto1.fr] INFO: Scrape type for GA52113: 2
2026-01-29 06:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:21 [auto1.fr] INFO: Found listing with ID: AZ72812
2026-01-29 06:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AZ72812%27 HTTP/1.1" 200 None
2026-01-29 06:00:21 [auto1.fr] INFO: Scrape type for AZ72812: 1
2026-01-29 06:00:21 [auto1.fr] INFO: Found listing with ID: SC50116
2026-01-29 06:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SC50116%27 HTTP/1.1" 200 None
2026-01-29 06:00:21 [auto1.fr] INFO: Scrape type for SC50116: 2
2026-01-29 06:00:21 [auto1.fr] INFO: Found listing with ID: MM01049
2026-01-29 06:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MM01049%27 HTTP/1.1" 200 None
2026-01-29 06:00:21 [auto1.fr] INFO: Scrape type for MM01049: 1
2026-01-29 06:00:21 [auto1.fr] INFO: Found listing with ID: WU82726
2026-01-29 06:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU82726%27 HTTP/1.1" 200 None
2026-01-29 06:00:21 [auto1.fr] INFO: Scrape type for WU82726: 1
2026-01-29 06:00:21 [auto1.fr] INFO: Found listing with ID: MS44390
2026-01-29 06:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MS44390%27 HTTP/1.1" 200 None
2026-01-29 06:00:21 [auto1.fr] INFO: Scrape type for MS44390: 2
2026-01-29 06:00:21 [auto1.fr] INFO: Found listing with ID: JU45690
2026-01-29 06:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JU45690%27 HTTP/1.1" 200 None
2026-01-29 06:00:21 [auto1.fr] INFO: Scrape type for JU45690: 1
2026-01-29 06:00:21 [auto1.fr] INFO: Found listing with ID: CD99747
2026-01-29 06:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CD99747%27 HTTP/1.1" 200 None
2026-01-29 06:00:21 [auto1.fr] INFO: Scrape type for CD99747: 1
2026-01-29 06:00:21 [auto1.fr] INFO: Found listing with ID: RB75331
2026-01-29 06:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RB75331%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for RB75331: 2
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: PW30452
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PW30452%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for PW30452: 2
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: ZW66039
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZW66039%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for ZW66039: 2
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: DL43817
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DL43817%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for DL43817: 2
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: YA10266
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YA10266%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for YA10266: 1
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: NK06116
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK06116%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for NK06116: 1
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: CL14274
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CL14274%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for CL14274: 2
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: GL46763
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GL46763%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for GL46763: 0
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: RU54394
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RU54394%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for RU54394: 1
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: XW79085
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XW79085%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for XW79085: 0
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: UD83687
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UD83687%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for UD83687: 1
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: XU49551
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XU49551%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for XU49551: 2
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: JR61080
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JR61080%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for JR61080: 2
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: YY96568
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YY96568%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for YY96568: 1
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: UF99896
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UF99896%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for UF99896: 1
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: ER42739
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER42739%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for ER42739: 2
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: PR67213
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR67213%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for PR67213: 2
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: LG78632
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LG78632%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for LG78632: 2
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: VG10471
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG10471%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for VG10471: 2
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: YH47366
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YH47366%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for YH47366: 1
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: MJ86885
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MJ86885%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for MJ86885: 1
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: LK42623
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LK42623%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for LK42623: 0
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: SA16378
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SA16378%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for SA16378: 1
2026-01-29 06:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: FV47029
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV47029%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for FV47029: 1
2026-01-29 06:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: GN92315
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN92315%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for GN92315: 2
2026-01-29 06:00:22 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: RR80485
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RR80485%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for RR80485: 2
2026-01-29 06:00:22 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/RR80485/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: EG82204
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EG82204%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for EG82204: 2
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: CY92610
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY92610%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for CY92610: 2
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: LJ44729
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ44729%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for LJ44729: 2
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: DG06084
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DG06084%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for DG06084: 2
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: BH30412
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: AV10982
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: GA52113
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GA52113%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for GA52113: 2
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: AZ72812
2026-01-29 06:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DG06084/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: SC50116
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SC50116%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for SC50116: 2
2026-01-29 06:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: MM01049
2026-01-29 06:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RR80485/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LJ44729/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: WU82726
2026-01-29 06:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: MS44390
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MS44390%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for MS44390: 2
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: JU45690
2026-01-29 06:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EG82204/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: CD99747
2026-01-29 06:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: RB75331
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RB75331%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for RB75331: 2
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: PW30452
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PW30452%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for PW30452: 2
2026-01-29 06:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AV10982/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: ZW66039
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZW66039%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for ZW66039: 2
2026-01-29 06:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:22 [auto1.fr] INFO: Found listing with ID: DL43817
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DL43817%27 HTTP/1.1" 200 None
2026-01-29 06:00:22 [auto1.fr] INFO: Scrape type for DL43817: 2
2026-01-29 06:00:23 [auto1.fr] INFO: Found listing with ID: YA10266
2026-01-29 06:00:23 [auto1.fr] INFO: Found listing with ID: NK06116
2026-01-29 06:00:23 [auto1.fr] INFO: Found listing with ID: CL14274
2026-01-29 06:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CL14274%27 HTTP/1.1" 200 None
2026-01-29 06:00:23 [auto1.fr] INFO: Scrape type for CL14274: 2
2026-01-29 06:00:23 [auto1.fr] INFO: Found listing with ID: GL46763
2026-01-29 06:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GL46763%27 HTTP/1.1" 200 None
2026-01-29 06:00:23 [auto1.fr] INFO: Scrape type for GL46763: 0
2026-01-29 06:00:23 [auto1.fr] INFO: Found listing with ID: RU54394
2026-01-29 06:00:23 [auto1.fr] INFO: Found listing with ID: XW79085
2026-01-29 06:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XW79085%27 HTTP/1.1" 200 None
2026-01-29 06:00:23 [auto1.fr] INFO: Scrape type for XW79085: 0
2026-01-29 06:00:23 [auto1.fr] INFO: Found listing with ID: UD83687
2026-01-29 06:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BH30412/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CY92610/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:23 [auto1.fr] INFO: Found listing with ID: XU49551
2026-01-29 06:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XU49551%27 HTTP/1.1" 200 None
2026-01-29 06:00:23 [auto1.fr] INFO: Scrape type for XU49551: 2
2026-01-29 06:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:23 [auto1.fr] INFO: Found listing with ID: JR61080
2026-01-29 06:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JR61080%27 HTTP/1.1" 200 None
2026-01-29 06:00:23 [auto1.fr] INFO: Scrape type for JR61080: 2
2026-01-29 06:00:23 [auto1.fr] INFO: Found listing with ID: YY96568
2026-01-29 06:00:23 [auto1.fr] INFO: Found listing with ID: UF99896
2026-01-29 06:00:23 [auto1.fr] INFO: Found listing with ID: ER42739
2026-01-29 06:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER42739%27 HTTP/1.1" 200 None
2026-01-29 06:00:23 [auto1.fr] INFO: Scrape type for ER42739: 2
2026-01-29 06:00:23 [auto1.fr] INFO: Found listing with ID: PR67213
2026-01-29 06:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR67213%27 HTTP/1.1" 200 None
2026-01-29 06:00:23 [auto1.fr] INFO: Scrape type for PR67213: 2
2026-01-29 06:00:23 [auto1.fr] INFO: Found listing with ID: LG78632
2026-01-29 06:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LG78632%27 HTTP/1.1" 200 None
2026-01-29 06:00:23 [auto1.fr] INFO: Scrape type for LG78632: 2
2026-01-29 06:00:23 [auto1.fr] INFO: Found listing with ID: VG10471
2026-01-29 06:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG10471%27 HTTP/1.1" 200 None
2026-01-29 06:00:23 [auto1.fr] INFO: Scrape type for VG10471: 2
2026-01-29 06:00:23 [auto1.fr] INFO: Found listing with ID: YH47366
2026-01-29 06:00:23 [auto1.fr] INFO: Found listing with ID: MJ86885
2026-01-29 06:00:23 [auto1.fr] INFO: Found listing with ID: LK42623
2026-01-29 06:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LK42623%27 HTTP/1.1" 200 None
2026-01-29 06:00:23 [auto1.fr] INFO: Scrape type for LK42623: 0
2026-01-29 06:00:23 [auto1.fr] INFO: Found listing with ID: SA16378
2026-01-29 06:00:23 [auto1.fr] INFO: Found listing with ID: FV47029
2026-01-29 06:00:23 [auto1.fr] INFO: Found listing with ID: GN92315
2026-01-29 06:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN92315%27 HTTP/1.1" 200 None
2026-01-29 06:00:23 [auto1.fr] INFO: Scrape type for GN92315: 2
2026-01-29 06:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GA52113/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MM01049/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WU82726/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JU45690/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SC50116/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AZ72812/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CD99747/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MS44390/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GN92315/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SA16378/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FV47029/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:24 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:00:24 [auto1.fr] INFO: Found listing with ID: FA71595
2026-01-29 06:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FA71595%27 HTTP/1.1" 200 None
2026-01-29 06:00:24 [auto1.fr] INFO: Scrape type for FA71595: 0
2026-01-29 06:00:24 [auto1.fr] INFO: Found listing with ID: NV25263
2026-01-29 06:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NV25263%27 HTTP/1.1" 200 None
2026-01-29 06:00:24 [auto1.fr] INFO: Scrape type for NV25263: 2
2026-01-29 06:00:24 [auto1.fr] INFO: Found listing with ID: EH94085
2026-01-29 06:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EH94085%27 HTTP/1.1" 200 None
2026-01-29 06:00:24 [auto1.fr] INFO: Scrape type for EH94085: 1
2026-01-29 06:00:24 [auto1.fr] INFO: Found listing with ID: NP09597
2026-01-29 06:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NP09597%27 HTTP/1.1" 200 None
2026-01-29 06:00:24 [auto1.fr] INFO: Scrape type for NP09597: 2
2026-01-29 06:00:24 [auto1.fr] INFO: Found listing with ID: ML57809
2026-01-29 06:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ML57809%27 HTTP/1.1" 200 None
2026-01-29 06:00:24 [auto1.fr] INFO: Scrape type for ML57809: 2
2026-01-29 06:00:25 [auto1.fr] INFO: Found listing with ID: PX46861
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX46861%27 HTTP/1.1" 200 None
2026-01-29 06:00:25 [auto1.fr] INFO: Scrape type for PX46861: 1
2026-01-29 06:00:25 [auto1.fr] INFO: Found listing with ID: JY05541
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JY05541%27 HTTP/1.1" 200 None
2026-01-29 06:00:25 [auto1.fr] INFO: Scrape type for JY05541: 1
2026-01-29 06:00:25 [auto1.fr] INFO: Found listing with ID: GG31907
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG31907%27 HTTP/1.1" 200 None
2026-01-29 06:00:25 [auto1.fr] INFO: Scrape type for GG31907: 1
2026-01-29 06:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YH47366/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:25 [auto1.fr] INFO: Found listing with ID: AC35213
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AC35213%27 HTTP/1.1" 200 None
2026-01-29 06:00:25 [auto1.fr] INFO: Scrape type for AC35213: 2
2026-01-29 06:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:25 [auto1.fr] INFO: Found listing with ID: NJ96560
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NJ96560%27 HTTP/1.1" 200 None
2026-01-29 06:00:25 [auto1.fr] INFO: Scrape type for NJ96560: 2
2026-01-29 06:00:25 [auto1.fr] INFO: Found listing with ID: ZF28512
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZF28512%27 HTTP/1.1" 200 None
2026-01-29 06:00:25 [auto1.fr] INFO: Scrape type for ZF28512: 2
2026-01-29 06:00:25 [auto1.fr] INFO: Found listing with ID: VF97823
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VF97823%27 HTTP/1.1" 200 None
2026-01-29 06:00:25 [auto1.fr] INFO: Scrape type for VF97823: 2
2026-01-29 06:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MJ86885/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:25 [auto1.fr] INFO: Found listing with ID: MP03922
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP03922%27 HTTP/1.1" 200 None
2026-01-29 06:00:25 [auto1.fr] INFO: Scrape type for MP03922: 1
2026-01-29 06:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:25 [auto1.fr] INFO: Found listing with ID: RZ93074
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RZ93074%27 HTTP/1.1" 200 None
2026-01-29 06:00:25 [auto1.fr] INFO: Scrape type for RZ93074: 2
2026-01-29 06:00:25 [auto1.fr] INFO: Found listing with ID: GN17831
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN17831%27 HTTP/1.1" 200 None
2026-01-29 06:00:25 [auto1.fr] INFO: Scrape type for GN17831: 2
2026-01-29 06:00:25 [auto1.fr] INFO: Found listing with ID: BM36001
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BM36001%27 HTTP/1.1" 200 None
2026-01-29 06:00:25 [auto1.fr] INFO: Scrape type for BM36001: 2
2026-01-29 06:00:25 [auto1.fr] INFO: Found listing with ID: GZ75839
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GZ75839%27 HTTP/1.1" 200 None
2026-01-29 06:00:25 [auto1.fr] INFO: Scrape type for GZ75839: 2
2026-01-29 06:00:25 [auto1.fr] INFO: Found listing with ID: BT80701
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BT80701%27 HTTP/1.1" 200 None
2026-01-29 06:00:25 [auto1.fr] INFO: Scrape type for BT80701: 2
2026-01-29 06:00:25 [auto1.fr] INFO: Found listing with ID: FL57020
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FL57020%27 HTTP/1.1" 200 None
2026-01-29 06:00:25 [auto1.fr] INFO: Scrape type for FL57020: 1
2026-01-29 06:00:25 [auto1.fr] INFO: Found listing with ID: SV32349
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV32349%27 HTTP/1.1" 200 None
2026-01-29 06:00:25 [auto1.fr] INFO: Scrape type for SV32349: 2
2026-01-29 06:00:25 [auto1.fr] INFO: Found listing with ID: DL71358
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DL71358%27 HTTP/1.1" 200 None
2026-01-29 06:00:25 [auto1.fr] INFO: Scrape type for DL71358: 2
2026-01-29 06:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LJ44729> (referer: https://www.auto1.com/v1/car-details-view/LJ44729/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:25 [auto1.fr] INFO: Found listing with ID: PX67710
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX67710%27 HTTP/1.1" 200 None
2026-01-29 06:00:25 [auto1.fr] INFO: Scrape type for PX67710: 1
2026-01-29 06:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:25 [auto1.fr] INFO: Found listing with ID: CE88723
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CE88723%27 HTTP/1.1" 200 None
2026-01-29 06:00:25 [auto1.fr] INFO: Scrape type for CE88723: 2
2026-01-29 06:00:25 [auto1.fr] INFO: Found listing with ID: FK20372
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FK20372%27 HTTP/1.1" 200 None
2026-01-29 06:00:25 [auto1.fr] INFO: Scrape type for FK20372: 1
2026-01-29 06:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EG82204> (referer: https://www.auto1.com/v1/car-details-view/EG82204/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:25 [auto1.fr] INFO: Found listing with ID: DB64981
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DB64981%27 HTTP/1.1" 200 None
2026-01-29 06:00:25 [auto1.fr] INFO: Scrape type for DB64981: 0
2026-01-29 06:00:25 [auto1.fr] INFO: Found listing with ID: GG58617
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG58617%27 HTTP/1.1" 200 None
2026-01-29 06:00:25 [auto1.fr] INFO: Scrape type for GG58617: 1
2026-01-29 06:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:25 [auto1.fr] INFO: Found listing with ID: MX59144
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MX59144%27 HTTP/1.1" 200 None
2026-01-29 06:00:25 [auto1.fr] INFO: Scrape type for MX59144: 0
2026-01-29 06:00:25 [auto1.fr] INFO: Found listing with ID: KW58357
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KW58357%27 HTTP/1.1" 200 None
2026-01-29 06:00:25 [auto1.fr] INFO: Scrape type for KW58357: 1
2026-01-29 06:00:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47378ffa-2911-512d-8b40-801d444bdcee with identifier: LJ44729
2026-01-29 06:00:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47378ffa-2911-512d-8b40-801d444bdcee with scrape type 2
2026-01-29 06:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47378ffa-2911-512d-8b40-801d444bdcee with scrape type 2
2026-01-29 06:00:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 47378ffa-2911-512d-8b40-801d444bdcee, identifier: LJ44729
2026-01-29 06:00:25 [auto1.fr] INFO: Found listing with ID: BN34419
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BN34419%27 HTTP/1.1" 200 None
2026-01-29 06:00:25 [auto1.fr] INFO: Scrape type for BN34419: 0
2026-01-29 06:00:25 [auto1.fr] INFO: Found listing with ID: UK05835
2026-01-29 06:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UK05835%27 HTTP/1.1" 200 None
2026-01-29 06:00:26 [auto1.fr] INFO: Scrape type for UK05835: 2
2026-01-29 06:00:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 47378ffa-2911-512d-8b40-801d444bdcee with identifier: LJ44729
2026-01-29 06:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:00:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-01-29 06:00:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:00:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-01-29 06:00:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:00:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 47378ffa-2911-512d-8b40-801d444bdcee with identifier: LJ44729
2026-01-29 06:00:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel corsa 1.2 edition', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'corsa', 'transmission': 'manual', 'odometer': 92859, 'odometer_reading_unit': 'km', 'registration_date': '2020-06-11', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lj44729', 'expiration_date': '2026-01-29t16:57:06z', 'origin_country_code': 'fr', 'trim': 'edition', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, beaucaire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 123, 'id': '47378ffa-2911-512d-8b40-801d444bdcee', 'current_year_diff': 6, 'age_in_months': 67, 'make_model': 'opel corsa', 'sanitized_make': 'opel', 'odometer_in_km': 92859}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 67,
     'auction_title': '',
     'c_o_2_emission_value': 123,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 75,
     'expiration_date': '2026-01-29t16:57:06z',
     'fuel_type': 'petrol',
     'id': '47378ffa-2911-512d-8b40-801d444bdcee',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lj44729',
     'listing': 'auction',
     'location': 'fr, beaucaire',
     'make': 'opel',
     'make_model': 'opel corsa',
     'model': 'corsa',
     'odometer': 92859,
     'odometer_in_km': 92859,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-06-11',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel corsa 1.2 edition',
     'transmission': 'manual',
     'trim': 'edition',
     'year': 2020}
2026-01-29 06:00:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 47378ffa-2911-512d-8b40-801d444bdcee spider: auto1.fr
2026-01-29 06:00:26 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 47378ffa-2911-512d-8b40-801d444bdcee due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel corsa 1.2 edition', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'corsa', 'transmission': 'manual', 'odometer': 92859, 'odometer_reading_unit': 'km', 'registration_date': '2020-06-11', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lj44729', 'expiration_date': '2026-01-29t16:57:06z', 'origin_country_code': 'fr', 'trim': 'edition', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, beaucaire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 123, 'id': '47378ffa-2911-512d-8b40-801d444bdcee', 'current_year_diff': 6, 'age_in_months': 67, 'make_model': 'opel corsa', 'sanitized_make': 'opel', 'odometer_in_km': 92859}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 67,
     'auction_title': '',
     'c_o_2_emission_value': 123,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 75,
     'expiration_date': '2026-01-29t16:57:06z',
     'fuel_type': 'petrol',
     'id': '47378ffa-2911-512d-8b40-801d444bdcee',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lj44729',
     'listing': 'auction',
     'location': 'fr, beaucaire',
     'make': 'opel',
     'make_model': 'opel corsa',
     'model': 'corsa',
     'odometer': 92859,
     'odometer_in_km': 92859,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-06-11',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel corsa 1.2 edition',
     'transmission': 'manual',
     'trim': 'edition',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:57:06Z',
 'fuel_type': 'petrol',
 'id': '47378ffa-2911-512d-8b40-801d444bdcee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ44729',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 92859,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2020}
2026-01-29 06:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ44729%27 HTTP/1.1" 200 None
2026-01-29 06:00:26 [auto1.fr] INFO: Saving data for LJ44729: {'auction_closing_time': 1769705826.0, 'created_time': 1768323820.396713, 'last_price_update_time': 1769666426.4468}
2026-01-29 06:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LJ44729') HTTP/1.1" 204 0
2026-01-29 06:00:26 [auto1.fr] INFO: Found listing with ID: VN50741
2026-01-29 06:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN50741%27 HTTP/1.1" 200 None
2026-01-29 06:00:26 [auto1.fr] INFO: Scrape type for VN50741: 1
2026-01-29 06:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JU45690> (referer: https://www.auto1.com/v1/car-details-view/JU45690/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BH30412> (referer: https://www.auto1.com/v1/car-details-view/BH30412/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CY92610> (referer: https://www.auto1.com/v1/car-details-view/CY92610/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MM01049> (referer: https://www.auto1.com/v1/car-details-view/MM01049/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WU82726> (referer: https://www.auto1.com/v1/car-details-view/WU82726/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GA52113> (referer: https://www.auto1.com/v1/car-details-view/GA52113/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38357705-1794-5a4b-898f-dc5f13cc5021 with identifier: EG82204
2026-01-29 06:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38357705-1794-5a4b-898f-dc5f13cc5021 with scrape type 2
2026-01-29 06:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38357705-1794-5a4b-898f-dc5f13cc5021 with scrape type 2
2026-01-29 06:00:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 38357705-1794-5a4b-898f-dc5f13cc5021, identifier: EG82204
2026-01-29 06:00:26 [auto1.fr] INFO: Found listing with ID: YT31802
2026-01-29 06:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YT31802%27 HTTP/1.1" 200 None
2026-01-29 06:00:26 [auto1.fr] INFO: Scrape type for YT31802: 0
2026-01-29 06:00:26 [auto1.fr] INFO: Found listing with ID: XR30986
2026-01-29 06:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XR30986%27 HTTP/1.1" 200 None
2026-01-29 06:00:26 [auto1.fr] INFO: Scrape type for XR30986: 0
2026-01-29 06:00:26 [auto1.fr] INFO: Found listing with ID: XG32175
2026-01-29 06:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XG32175%27 HTTP/1.1" 200 None
2026-01-29 06:00:26 [auto1.fr] INFO: Scrape type for XG32175: 0
2026-01-29 06:00:26 [auto1.fr] INFO: Found listing with ID: NM34816
2026-01-29 06:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NM34816%27 HTTP/1.1" 200 None
2026-01-29 06:00:26 [auto1.fr] INFO: Scrape type for NM34816: 0
2026-01-29 06:00:26 [auto1.fr] INFO: Found listing with ID: JJ40715
2026-01-29 06:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ40715%27 HTTP/1.1" 200 None
2026-01-29 06:00:26 [auto1.fr] INFO: Scrape type for JJ40715: 1
2026-01-29 06:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 38357705-1794-5a4b-898f-dc5f13cc5021 with identifier: EG82204
2026-01-29 06:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:00:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-01-29 06:00:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-01-29 06:00:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 38357705-1794-5a4b-898f-dc5f13cc5021 with identifier: EG82204
2026-01-29 06:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit custom' containing 'transit'
2026-01-29 06:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 38357705-1794-5a4b-898f-dc5f13cc5021 spider: auto1.fr
2026-01-29 06:00:27 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 38357705-1794-5a4b-898f-dc5f13cc5021 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit custom' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': 182,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-01-29T16:38:34Z',
 'fuel_type': 'diesel',
 'id': '38357705-1794-5a4b-898f-dc5f13cc5021',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG82204',
 'listing': 'auction',
 'location': 'FR',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 170287,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-24',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi L1 Trail',
 'transmission': 'manual',
 'trim': 'L1 Trail',
 'year': 2019}
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EG82204%27 HTTP/1.1" 200 None
2026-01-29 06:00:27 [auto1.fr] INFO: Saving data for EG82204: {'auction_closing_time': 1769704714.0, 'created_time': 1769533941.565566, 'last_price_update_time': 1769666427.356265}
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EG82204') HTTP/1.1" 204 0
2026-01-29 06:00:27 [auto1.fr] INFO: Found listing with ID: LF63766
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LF63766%27 HTTP/1.1" 200 None
2026-01-29 06:00:27 [auto1.fr] INFO: Scrape type for LF63766: 1
2026-01-29 06:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 020101c6-e8d4-5934-adac-dbe061a3511f with identifier: JU45690
2026-01-29 06:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 020101c6-e8d4-5934-adac-dbe061a3511f with scrape type 1
2026-01-29 06:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 020101c6-e8d4-5934-adac-dbe061a3511f
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F55%252F60551e97eff0c4da62f8fe1550d7f80e%252Fpa%252FJU45690_070a66dd3d961902b7e930bb7f5c1448.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_070a66dd3d961902b7e930bb7f5c1448.jpg already downloaded
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F55%252F60551e97eff0c4da62f8fe1550d7f80e%252Fpa%252FJU45690_c01aa5e3bf08d157f7ce01f5055fe9e9.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_c01aa5e3bf08d157f7ce01f5055fe9e9.jpg already downloaded
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F55%252F60551e97eff0c4da62f8fe1550d7f80e%252Fpa%252FJU45690_43b7e30422a134db557d661cbd021fd5.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_43b7e30422a134db557d661cbd021fd5.jpg already downloaded
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F55%252F60551e97eff0c4da62f8fe1550d7f80e%252Fpa%252FJU45690_47c39235d676750f180fe86cd12cd12a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_47c39235d676750f180fe86cd12cd12a.jpg already downloaded
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F55%252F60551e97eff0c4da62f8fe1550d7f80e%252Fpa%252FJU45690_651494f689265a60a1b8f2e27e56b5de.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_651494f689265a60a1b8f2e27e56b5de.jpg already downloaded
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F55%252F60551e97eff0c4da62f8fe1550d7f80e%252Fpa%252FJU45690_087cc5b83a952abaecc9657972aeeb24.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_087cc5b83a952abaecc9657972aeeb24.jpg already downloaded
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F55%252F60551e97eff0c4da62f8fe1550d7f80e%252Fpa%252FJU45690_21dac59c6c8438c94a39e1bf93f7e36b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_21dac59c6c8438c94a39e1bf93f7e36b.jpg already downloaded
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F55%252F60551e97eff0c4da62f8fe1550d7f80e%252Fpa%252FJU45690_7f575a71e232aa76b81254372ff58e24.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_7f575a71e232aa76b81254372ff58e24.jpg already downloaded
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F55%252F60551e97eff0c4da62f8fe1550d7f80e%252Fpa%252FJU45690_d63b2f81426d7fc2b3288c9681deeba5.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_d63b2f81426d7fc2b3288c9681deeba5.jpg already downloaded
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F55%252F60551e97eff0c4da62f8fe1550d7f80e%252Fpa%252FJU45690_e147d145c76feffa307ec3141a0b44ba.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_e147d145c76feffa307ec3141a0b44ba.jpg already downloaded
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F55%252F60551e97eff0c4da62f8fe1550d7f80e%252Fpa%252FJU45690_a800f9fccf156d00ecd21770eff9d438.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_a800f9fccf156d00ecd21770eff9d438.jpg already downloaded
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F55%252F60551e97eff0c4da62f8fe1550d7f80e%252Fpa%252FJU45690_2cc5edc02dbf02bb0f8291ce3823cb56.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_2cc5edc02dbf02bb0f8291ce3823cb56.jpg already downloaded
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F55%252F60551e97eff0c4da62f8fe1550d7f80e%252Fpa%252FJU45690_3ffc1e9a96e95f2e65bb6f6e0fc5b516.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_3ffc1e9a96e95f2e65bb6f6e0fc5b516.jpg already downloaded
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F55%252F60551e97eff0c4da62f8fe1550d7f80e%252Fpa%252FJU45690_6a88173d66c302ef6fb403910c9fa2e5.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_6a88173d66c302ef6fb403910c9fa2e5.jpg already downloaded
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F55%252F60551e97eff0c4da62f8fe1550d7f80e%252Fpa%252FJU45690_6972d53389a0409bb063851f74345024.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_6972d53389a0409bb063851f74345024.jpg already downloaded
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F55%252F60551e97eff0c4da62f8fe1550d7f80e%252Fpa%252FJU45690_2cf01b2730b09cd551c177392425fc80.png%27 HTTP/1.1" 200 None
2026-01-29 06:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_2cf01b2730b09cd551c177392425fc80.png already downloaded
2026-01-29 06:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 020101c6-e8d4-5934-adac-dbe061a3511f, identifier: JU45690
2026-01-29 06:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ee38a03-c814-59b0-acda-1dc1887bc7b1 with identifier: BH30412
2026-01-29 06:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ee38a03-c814-59b0-acda-1dc1887bc7b1 with scrape type 1
2026-01-29 06:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 7ee38a03-c814-59b0-acda-1dc1887bc7b1
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd5%252Fafd5c300fba5a22dddec1d625b302d7c%252Fpa%252FBH30412_791b21797f6f01cd69b7f3e862fd4ca6.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_791b21797f6f01cd69b7f3e862fd4ca6.jpg already downloaded
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd5%252Fafd5c300fba5a22dddec1d625b302d7c%252Fpa%252FBH30412_aede64feff6aae8536bd9b852a1726a4.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_aede64feff6aae8536bd9b852a1726a4.jpg already downloaded
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd5%252Fafd5c300fba5a22dddec1d625b302d7c%252Fpa%252FBH30412_c36acc95b07d60dd7141eae7acb08f5d.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_c36acc95b07d60dd7141eae7acb08f5d.jpg already downloaded
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd5%252Fafd5c300fba5a22dddec1d625b302d7c%252Fpa%252FBH30412_bc0a80b58fd0b128bb8786c155f6d5c9.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_bc0a80b58fd0b128bb8786c155f6d5c9.jpg already downloaded
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd5%252Fafd5c300fba5a22dddec1d625b302d7c%252Fpa%252FBH30412_f5ec9e93f8133cf91707969c8019bf0a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_f5ec9e93f8133cf91707969c8019bf0a.jpg already downloaded
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd5%252Fafd5c300fba5a22dddec1d625b302d7c%252Fpa%252FBH30412_cd63b6d607e9199d1ae1582879b07316.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_cd63b6d607e9199d1ae1582879b07316.jpg already downloaded
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd5%252Fafd5c300fba5a22dddec1d625b302d7c%252Fpa%252FBH30412_6230d933dfba8799615276a2b0f914c0.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_6230d933dfba8799615276a2b0f914c0.jpg already downloaded
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd5%252Fafd5c300fba5a22dddec1d625b302d7c%252Fpa%252FBH30412_c428649325637d80d6c145daf972ce60.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_c428649325637d80d6c145daf972ce60.jpg already downloaded
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd5%252Fafd5c300fba5a22dddec1d625b302d7c%252Fpa%252FBH30412_44b195458ef419b4c2e15894de30389c.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_44b195458ef419b4c2e15894de30389c.jpg already downloaded
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd5%252Fafd5c300fba5a22dddec1d625b302d7c%252Fpa%252FBH30412_4927e9b352bcb8a9fcaa4b8062715ec7.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_4927e9b352bcb8a9fcaa4b8062715ec7.jpg already downloaded
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd5%252Fafd5c300fba5a22dddec1d625b302d7c%252Fpa%252FBH30412_15a2afbecfa07c8ded8cfe4075bf1ec3.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_15a2afbecfa07c8ded8cfe4075bf1ec3.jpg already downloaded
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd5%252Fafd5c300fba5a22dddec1d625b302d7c%252Fpa%252FBH30412_c3714559cf8cbf05d64583c94842d0fe.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_c3714559cf8cbf05d64583c94842d0fe.jpg already downloaded
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd5%252Fafd5c300fba5a22dddec1d625b302d7c%252Fpa%252FBH30412_3242e25ded093528495d9e68f8b5f9b4.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_3242e25ded093528495d9e68f8b5f9b4.jpg already downloaded
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd5%252Fafd5c300fba5a22dddec1d625b302d7c%252Fpa%252FBH30412_79a6f1d6733612e520136082c4150cdd.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_79a6f1d6733612e520136082c4150cdd.jpg already downloaded
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd5%252Fafd5c300fba5a22dddec1d625b302d7c%252Fpa%252FBH30412_2f11187fe6887f754eba5aae92a7f14d.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_2f11187fe6887f754eba5aae92a7f14d.jpg already downloaded
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fd5%252Fafd5c300fba5a22dddec1d625b302d7c%252Fpa%252FBH30412_0b40ffb4e8ff22276701e3974edf91a4.png%27 HTTP/1.1" 200 None
2026-01-29 06:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_0b40ffb4e8ff22276701e3974edf91a4.png already downloaded
2026-01-29 06:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7ee38a03-c814-59b0-acda-1dc1887bc7b1, identifier: BH30412
2026-01-29 06:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3399342-651c-5788-8f8c-929b2ac96f66 with identifier: CY92610
2026-01-29 06:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3399342-651c-5788-8f8c-929b2ac96f66 with scrape type 2
2026-01-29 06:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3399342-651c-5788-8f8c-929b2ac96f66 with scrape type 2
2026-01-29 06:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e3399342-651c-5788-8f8c-929b2ac96f66, identifier: CY92610
2026-01-29 06:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc60a149-c994-5272-bbe7-0497a4fa6ca8 with identifier: MM01049
2026-01-29 06:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc60a149-c994-5272-bbe7-0497a4fa6ca8 with scrape type 1
2026-01-29 06:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item bc60a149-c994-5272-bbe7-0497a4fa6ca8
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fca%252Fd9ca3c6080180489c7b3db9a2cbff1de%252Fpa%252FMM01049_3036e3b9b965b0103e9ce6b8d8f78d08.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_3036e3b9b965b0103e9ce6b8d8f78d08.jpg already downloaded
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fca%252Fd9ca3c6080180489c7b3db9a2cbff1de%252Fpa%252FMM01049_2c4fbdf9dd2238e4bb82e25d1bc7a387.png%27 HTTP/1.1" 200 None
2026-01-29 06:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_2c4fbdf9dd2238e4bb82e25d1bc7a387.png already downloaded
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fca%252Fd9ca3c6080180489c7b3db9a2cbff1de%252Fpa%252FMM01049_dcf3bdf50d644fcfc4dc2415923f2ec1.png%27 HTTP/1.1" 200 None
2026-01-29 06:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_dcf3bdf50d644fcfc4dc2415923f2ec1.png already downloaded
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fca%252Fd9ca3c6080180489c7b3db9a2cbff1de%252Fpa%252FMM01049_0fd10d3fe2e5958df9d928fd7356a69f.png%27 HTTP/1.1" 200 None
2026-01-29 06:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_0fd10d3fe2e5958df9d928fd7356a69f.png already downloaded
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fca%252Fd9ca3c6080180489c7b3db9a2cbff1de%252Fpa%252FMM01049_9386a6107ef62ee0003d270472ec3e85.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_9386a6107ef62ee0003d270472ec3e85.jpg already downloaded
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fca%252Fd9ca3c6080180489c7b3db9a2cbff1de%252Fpa%252FMM01049_7ad57a0018750c93ce83402992660248.png%27 HTTP/1.1" 200 None
2026-01-29 06:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_7ad57a0018750c93ce83402992660248.png already downloaded
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fca%252Fd9ca3c6080180489c7b3db9a2cbff1de%252Fpa%252FMM01049_33c9bed8bed9bf85e98266aa43b27c4c.png%27 HTTP/1.1" 200 None
2026-01-29 06:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_33c9bed8bed9bf85e98266aa43b27c4c.png already downloaded
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fca%252Fd9ca3c6080180489c7b3db9a2cbff1de%252Fpa%252FMM01049_6342c2e18838fd009d979758c054c2f5.png%27 HTTP/1.1" 200 None
2026-01-29 06:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_6342c2e18838fd009d979758c054c2f5.png already downloaded
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fca%252Fd9ca3c6080180489c7b3db9a2cbff1de%252Fpa%252FMM01049_cf3b594cd77581920d06ba72ca1048f0.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_cf3b594cd77581920d06ba72ca1048f0.jpg already downloaded
2026-01-29 06:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fca%252Fd9ca3c6080180489c7b3db9a2cbff1de%252Fpa%252FMM01049_9057f20e31ca8f75d862f791b714dc76.png%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_9057f20e31ca8f75d862f791b714dc76.png already downloaded
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fca%252Fd9ca3c6080180489c7b3db9a2cbff1de%252Fpa%252FMM01049_cdf99e165d8436b51a2841f61928b2b5.png%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_cdf99e165d8436b51a2841f61928b2b5.png already downloaded
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fca%252Fd9ca3c6080180489c7b3db9a2cbff1de%252Fpa%252FMM01049_9e7e96e4d9d08b69fef322c68b108d86.png%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_9e7e96e4d9d08b69fef322c68b108d86.png already downloaded
2026-01-29 06:00:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bc60a149-c994-5272-bbe7-0497a4fa6ca8, identifier: MM01049
2026-01-29 06:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8 with identifier: WU82726
2026-01-29 06:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8 with scrape type 1
2026-01-29 06:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F23%252Ff623b2c8f9a54c61621300eb00fffa78%252Fpa%252FWU82726_3ebc2b02314c3b09d6e777febfdfef6e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_3ebc2b02314c3b09d6e777febfdfef6e.jpg already downloaded
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F23%252Ff623b2c8f9a54c61621300eb00fffa78%252Fpa%252FWU82726_6737fc164aec7d244bee444183ae161d.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_6737fc164aec7d244bee444183ae161d.jpg already downloaded
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F23%252Ff623b2c8f9a54c61621300eb00fffa78%252Fpa%252FWU82726_039416da6c3f85fafe2097627d8eec8f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_039416da6c3f85fafe2097627d8eec8f.jpg already downloaded
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F23%252Ff623b2c8f9a54c61621300eb00fffa78%252Fpa%252FWU82726_45c4a83dc024756dd42a71ef6e2f872e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_45c4a83dc024756dd42a71ef6e2f872e.jpg already downloaded
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F23%252Ff623b2c8f9a54c61621300eb00fffa78%252Fpa%252FWU82726_6d20d7cc0f757a533fc98ed2c3fae3c3.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_6d20d7cc0f757a533fc98ed2c3fae3c3.jpg already downloaded
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F23%252Ff623b2c8f9a54c61621300eb00fffa78%252Fpa%252FWU82726_b5db8519c9bece24f17fbfb089be5437.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_b5db8519c9bece24f17fbfb089be5437.jpg already downloaded
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F23%252Ff623b2c8f9a54c61621300eb00fffa78%252Fpa%252FWU82726_25805cfdd929b8f1693eaac4c7c4016f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_25805cfdd929b8f1693eaac4c7c4016f.jpg already downloaded
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F23%252Ff623b2c8f9a54c61621300eb00fffa78%252Fpa%252FWU82726_28cefd7d968df55db51cef49d4c53115.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_28cefd7d968df55db51cef49d4c53115.jpg already downloaded
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F23%252Ff623b2c8f9a54c61621300eb00fffa78%252Fpa%252FWU82726_515bb493d6bac99c89c8b7b7b11e5956.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_515bb493d6bac99c89c8b7b7b11e5956.jpg already downloaded
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F23%252Ff623b2c8f9a54c61621300eb00fffa78%252Fpa%252FWU82726_cbe5a47817dee447b1e6ea1d9e68c061.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_cbe5a47817dee447b1e6ea1d9e68c061.jpg already downloaded
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F23%252Ff623b2c8f9a54c61621300eb00fffa78%252Fpa%252FWU82726_bcbf59d8a59ac89c2ab850e4d4ee83fc.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_bcbf59d8a59ac89c2ab850e4d4ee83fc.jpg already downloaded
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F23%252Ff623b2c8f9a54c61621300eb00fffa78%252Fpa%252FWU82726_133a5397c8eb5fcef6aa9d18d20e3d7e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_133a5397c8eb5fcef6aa9d18d20e3d7e.jpg already downloaded
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F23%252Ff623b2c8f9a54c61621300eb00fffa78%252Fpa%252FWU82726_d3b230b999d0b088835a9f9031186d0c.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_d3b230b999d0b088835a9f9031186d0c.jpg already downloaded
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F23%252Ff623b2c8f9a54c61621300eb00fffa78%252Fpa%252FWU82726_d2d03cdf17bd1f8ee3347cc360c973af.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_d2d03cdf17bd1f8ee3347cc360c973af.jpg already downloaded
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F23%252Ff623b2c8f9a54c61621300eb00fffa78%252Fpa%252FWU82726_af0a04f738b1ab64662a5427d53b1de8.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_af0a04f738b1ab64662a5427d53b1de8.jpg already downloaded
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F23%252Ff623b2c8f9a54c61621300eb00fffa78%252Fpa%252FWU82726_13a3abd40d0cf7d7c8af6199df72a7bb.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_13a3abd40d0cf7d7c8af6199df72a7bb.jpg already downloaded
2026-01-29 06:00:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8, identifier: WU82726
2026-01-29 06:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de759db0-50b5-5227-8d05-67ca5fa5d9b1 with identifier: GA52113
2026-01-29 06:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de759db0-50b5-5227-8d05-67ca5fa5d9b1 with scrape type 2
2026-01-29 06:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de759db0-50b5-5227-8d05-67ca5fa5d9b1 with scrape type 2
2026-01-29 06:00:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: de759db0-50b5-5227-8d05-67ca5fa5d9b1, identifier: GA52113
2026-01-29 06:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 020101c6-e8d4-5934-adac-dbe061a3511f with identifier: JU45690
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-01-29 06:00:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 020101c6-e8d4-5934-adac-dbe061a3511f with identifier: JU45690
2026-01-29 06:00:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 020101c6-e8d4-5934-adac-dbe061a3511f with identifier: JU45690 to the API
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JU45690>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:49:49Z',
 'fuel_type': 'petrol',
 'id': '020101c6-e8d4-5934-adac-dbe061a3511f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU45690',
 'listing': 'auction',
 'location': 'FR, Ambarès-et-Lagrave',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 98174,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_070a66dd3d961902b7e930bb7f5c1448.jpg',
                'https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_c01aa5e3bf08d157f7ce01f5055fe9e9.jpg',
                'https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_43b7e30422a134db557d661cbd021fd5.jpg',
                'https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_47c39235d676750f180fe86cd12cd12a.jpg',
                'https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_651494f689265a60a1b8f2e27e56b5de.jpg',
                'https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_087cc5b83a952abaecc9657972aeeb24.jpg',
                'https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_21dac59c6c8438c94a39e1bf93f7e36b.jpg',
                'https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_7f575a71e232aa76b81254372ff58e24.jpg',
                'https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_d63b2f81426d7fc2b3288c9681deeba5.jpg',
                'https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_e147d145c76feffa307ec3141a0b44ba.jpg',
                'https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_a800f9fccf156d00ecd21770eff9d438.jpg',
                'https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_2cc5edc02dbf02bb0f8291ce3823cb56.jpg',
                'https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_3ffc1e9a96e95f2e65bb6f6e0fc5b516.jpg',
                'https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_6a88173d66c302ef6fb403910c9fa2e5.jpg',
                'https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_6972d53389a0409bb063851f74345024.jpg',
                'https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_2cf01b2730b09cd551c177392425fc80.png'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_020101c6-e8d4-5934-adac-dbe061a3511f/020101c6-e8d4-5934-adac-dbe061a3511f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_070a66dd3d961902b7e930bb7f5c1448.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_020101c6-e8d4-5934-adac-dbe061a3511f/020101c6-e8d4-5934-adac-dbe061a3511f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2206284,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_c01aa5e3bf08d157f7ce01f5055fe9e9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_020101c6-e8d4-5934-adac-dbe061a3511f/020101c6-e8d4-5934-adac-dbe061a3511f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_43b7e30422a134db557d661cbd021fd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_020101c6-e8d4-5934-adac-dbe061a3511f/020101c6-e8d4-5934-adac-dbe061a3511f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2254644,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_47c39235d676750f180fe86cd12cd12a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_020101c6-e8d4-5934-adac-dbe061a3511f/020101c6-e8d4-5934-adac-dbe061a3511f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_651494f689265a60a1b8f2e27e56b5de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_020101c6-e8d4-5934-adac-dbe061a3511f/020101c6-e8d4-5934-adac-dbe061a3511f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_087cc5b83a952abaecc9657972aeeb24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_020101c6-e8d4-5934-adac-dbe061a3511f/020101c6-e8d4-5934-adac-dbe061a3511f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_21dac59c6c8438c94a39e1bf93f7e36b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_020101c6-e8d4-5934-adac-dbe061a3511f/020101c6-e8d4-5934-adac-dbe061a3511f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2576512,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_7f575a71e232aa76b81254372ff58e24.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_020101c6-e8d4-5934-adac-dbe061a3511f/020101c6-e8d4-5934-adac-dbe061a3511f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_d63b2f81426d7fc2b3288c9681deeba5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_020101c6-e8d4-5934-adac-dbe061a3511f/020101c6-e8d4-5934-adac-dbe061a3511f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_e147d145c76feffa307ec3141a0b44ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_020101c6-e8d4-5934-adac-dbe061a3511f/020101c6-e8d4-5934-adac-dbe061a3511f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_a800f9fccf156d00ecd21770eff9d438.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_020101c6-e8d4-5934-adac-dbe061a3511f/020101c6-e8d4-5934-adac-dbe061a3511f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2354952,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_2cc5edc02dbf02bb0f8291ce3823cb56.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_020101c6-e8d4-5934-adac-dbe061a3511f/020101c6-e8d4-5934-adac-dbe061a3511f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_3ffc1e9a96e95f2e65bb6f6e0fc5b516.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_020101c6-e8d4-5934-adac-dbe061a3511f/020101c6-e8d4-5934-adac-dbe061a3511f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2391317,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_6a88173d66c302ef6fb403910c9fa2e5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_020101c6-e8d4-5934-adac-dbe061a3511f/020101c6-e8d4-5934-adac-dbe061a3511f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_6972d53389a0409bb063851f74345024.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_020101c6-e8d4-5934-adac-dbe061a3511f/020101c6-e8d4-5934-adac-dbe061a3511f_image_15.png',
             'Extension': 'png',
             'FileSizeInBytes': 123490,
             'Height': 525,
             'OriginUrl': 'https://img-pa.auto1.com/img60/55/60551e97eff0c4da62f8fe1550d7f80e/pa/JU45690_2cf01b2730b09cd551c177392425fc80.png',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2021}
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JU45690%27 HTTP/1.1" 200 None
2026-01-29 06:00:30 [auto1.fr] INFO: Saving data for JU45690: {'created_time': 1769666430.506315, 'last_price_update_time': 1769666430.506328, 'auction_closing_time': 1769705389.0}
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JU45690') HTTP/1.1" 204 0
2026-01-29 06:00:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7ee38a03-c814-59b0-acda-1dc1887bc7b1 with identifier: BH30412
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-01-29 06:00:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:00:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7ee38a03-c814-59b0-acda-1dc1887bc7b1 with identifier: BH30412
2026-01-29 06:00:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7ee38a03-c814-59b0-acda-1dc1887bc7b1 with identifier: BH30412 to the API
2026-01-29 06:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:00:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:00:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BH30412>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 184,
 'expiration_date': '2026-01-29T16:41:40Z',
 'fuel_type': 'hybrid',
 'id': '7ee38a03-c814-59b0-acda-1dc1887bc7b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH30412',
 'listing': 'auction',
 'location': 'FR, Le Boulou',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 29965,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_791b21797f6f01cd69b7f3e862fd4ca6.jpg',
                'https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_aede64feff6aae8536bd9b852a1726a4.jpg',
                'https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_c36acc95b07d60dd7141eae7acb08f5d.jpg',
                'https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_bc0a80b58fd0b128bb8786c155f6d5c9.jpg',
                'https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_f5ec9e93f8133cf91707969c8019bf0a.jpg',
                'https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_cd63b6d607e9199d1ae1582879b07316.jpg',
                'https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_6230d933dfba8799615276a2b0f914c0.jpg',
                'https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_c428649325637d80d6c145daf972ce60.jpg',
                'https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_44b195458ef419b4c2e15894de30389c.jpg',
                'https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_4927e9b352bcb8a9fcaa4b8062715ec7.jpg',
                'https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_15a2afbecfa07c8ded8cfe4075bf1ec3.jpg',
                'https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_c3714559cf8cbf05d64583c94842d0fe.jpg',
                'https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_3242e25ded093528495d9e68f8b5f9b4.jpg',
                'https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_79a6f1d6733612e520136082c4150cdd.jpg',
                'https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_2f11187fe6887f754eba5aae92a7f14d.jpg',
                'https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_0b40ffb4e8ff22276701e3974edf91a4.png'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ee38a03-c814-59b0-acda-1dc1887bc7b1/7ee38a03-c814-59b0-acda-1dc1887bc7b1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_791b21797f6f01cd69b7f3e862fd4ca6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ee38a03-c814-59b0-acda-1dc1887bc7b1/7ee38a03-c814-59b0-acda-1dc1887bc7b1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_aede64feff6aae8536bd9b852a1726a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ee38a03-c814-59b0-acda-1dc1887bc7b1/7ee38a03-c814-59b0-acda-1dc1887bc7b1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_c36acc95b07d60dd7141eae7acb08f5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ee38a03-c814-59b0-acda-1dc1887bc7b1/7ee38a03-c814-59b0-acda-1dc1887bc7b1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66847,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_bc0a80b58fd0b128bb8786c155f6d5c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ee38a03-c814-59b0-acda-1dc1887bc7b1/7ee38a03-c814-59b0-acda-1dc1887bc7b1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_f5ec9e93f8133cf91707969c8019bf0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ee38a03-c814-59b0-acda-1dc1887bc7b1/7ee38a03-c814-59b0-acda-1dc1887bc7b1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_cd63b6d607e9199d1ae1582879b07316.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ee38a03-c814-59b0-acda-1dc1887bc7b1/7ee38a03-c814-59b0-acda-1dc1887bc7b1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_6230d933dfba8799615276a2b0f914c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ee38a03-c814-59b0-acda-1dc1887bc7b1/7ee38a03-c814-59b0-acda-1dc1887bc7b1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90118,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_c428649325637d80d6c145daf972ce60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ee38a03-c814-59b0-acda-1dc1887bc7b1/7ee38a03-c814-59b0-acda-1dc1887bc7b1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78969,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_44b195458ef419b4c2e15894de30389c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ee38a03-c814-59b0-acda-1dc1887bc7b1/7ee38a03-c814-59b0-acda-1dc1887bc7b1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_4927e9b352bcb8a9fcaa4b8062715ec7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ee38a03-c814-59b0-acda-1dc1887bc7b1/7ee38a03-c814-59b0-acda-1dc1887bc7b1_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_15a2afbecfa07c8ded8cfe4075bf1ec3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ee38a03-c814-59b0-acda-1dc1887bc7b1/7ee38a03-c814-59b0-acda-1dc1887bc7b1_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_c3714559cf8cbf05d64583c94842d0fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ee38a03-c814-59b0-acda-1dc1887bc7b1/7ee38a03-c814-59b0-acda-1dc1887bc7b1_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_3242e25ded093528495d9e68f8b5f9b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ee38a03-c814-59b0-acda-1dc1887bc7b1/7ee38a03-c814-59b0-acda-1dc1887bc7b1_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_79a6f1d6733612e520136082c4150cdd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ee38a03-c814-59b0-acda-1dc1887bc7b1/7ee38a03-c814-59b0-acda-1dc1887bc7b1_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89683,
             'Height': 502,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_2f11187fe6887f754eba5aae92a7f14d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ee38a03-c814-59b0-acda-1dc1887bc7b1/7ee38a03-c814-59b0-acda-1dc1887bc7b1_image_15.png',
             'Extension': 'png',
             'FileSizeInBytes': 109423,
             'Height': 525,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/d5/afd5c300fba5a22dddec1d625b302d7c/pa/BH30412_0b40ffb4e8ff22276701e3974edf91a4.png',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-06-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota C-HR 2.0 Hybrid Design',
 'transmission': 'automatic',
 'trim': 'Design',
 'year': 2023}
2026-01-29 06:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BH30412%27 HTTP/1.1" 200 None
2026-01-29 06:00:31 [auto1.fr] INFO: Saving data for BH30412: {'created_time': 1769666431.358517, 'last_price_update_time': 1769666431.358532, 'auction_closing_time': 1769704900.0}
2026-01-29 06:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BH30412') HTTP/1.1" 204 0
2026-01-29 06:00:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e3399342-651c-5788-8f8c-929b2ac96f66 with identifier: CY92610
2026-01-29 06:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e3399342-651c-5788-8f8c-929b2ac96f66 with identifier: CY92610
2026-01-29 06:00:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e3399342-651c-5788-8f8c-929b2ac96f66 with identifier: CY92610 to the API
2026-01-29 06:00:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:00:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CY92610>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:20:42Z',
 'fuel_type': 'petrol',
 'id': 'e3399342-651c-5788-8f8c-929b2ac96f66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY92610',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 53588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2021}
2026-01-29 06:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY92610%27 HTTP/1.1" 200 None
2026-01-29 06:00:32 [auto1.fr] INFO: Saving data for CY92610: {'auction_closing_time': 1769703642.0, 'created_time': 1767807760.931837, 'last_price_update_time': 1769666432.071545}
2026-01-29 06:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CY92610') HTTP/1.1" 204 0
2026-01-29 06:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bc60a149-c994-5272-bbe7-0497a4fa6ca8 with identifier: MM01049
2026-01-29 06:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bc60a149-c994-5272-bbe7-0497a4fa6ca8 with identifier: MM01049
2026-01-29 06:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bc60a149-c994-5272-bbe7-0497a4fa6ca8 with identifier: MM01049 to the API
2026-01-29 06:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MM01049>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:52:56Z',
 'fuel_type': 'diesel',
 'id': 'bc60a149-c994-5272-bbe7-0497a4fa6ca8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM01049',
 'listing': 'auction',
 'location': 'FR, Warluis',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 113515,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 12,
 'photo_urls': ['https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_3036e3b9b965b0103e9ce6b8d8f78d08.jpg',
                'https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_2c4fbdf9dd2238e4bb82e25d1bc7a387.png',
                'https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_dcf3bdf50d644fcfc4dc2415923f2ec1.png',
                'https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_0fd10d3fe2e5958df9d928fd7356a69f.png',
                'https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_9386a6107ef62ee0003d270472ec3e85.jpg',
                'https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_7ad57a0018750c93ce83402992660248.png',
                'https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_33c9bed8bed9bf85e98266aa43b27c4c.png',
                'https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_6342c2e18838fd009d979758c054c2f5.png',
                'https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_cf3b594cd77581920d06ba72ca1048f0.jpg',
                'https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_9057f20e31ca8f75d862f791b714dc76.png',
                'https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_cdf99e165d8436b51a2841f61928b2b5.png',
                'https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_9e7e96e4d9d08b69fef322c68b108d86.png'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc60a149-c994-5272-bbe7-0497a4fa6ca8/bc60a149-c994-5272-bbe7-0497a4fa6ca8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 136435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_3036e3b9b965b0103e9ce6b8d8f78d08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc60a149-c994-5272-bbe7-0497a4fa6ca8/bc60a149-c994-5272-bbe7-0497a4fa6ca8_image_1.png',
             'Extension': 'png',
             'FileSizeInBytes': 180722,
             'Height': 512,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_2c4fbdf9dd2238e4bb82e25d1bc7a387.png',
             'Width': 512},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc60a149-c994-5272-bbe7-0497a4fa6ca8/bc60a149-c994-5272-bbe7-0497a4fa6ca8_image_2.png',
             'Extension': 'png',
             'FileSizeInBytes': 180722,
             'Height': 512,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_dcf3bdf50d644fcfc4dc2415923f2ec1.png',
             'Width': 512},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc60a149-c994-5272-bbe7-0497a4fa6ca8/bc60a149-c994-5272-bbe7-0497a4fa6ca8_image_3.png',
             'Extension': 'png',
             'FileSizeInBytes': 180722,
             'Height': 512,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_0fd10d3fe2e5958df9d928fd7356a69f.png',
             'Width': 512},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc60a149-c994-5272-bbe7-0497a4fa6ca8/bc60a149-c994-5272-bbe7-0497a4fa6ca8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_9386a6107ef62ee0003d270472ec3e85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc60a149-c994-5272-bbe7-0497a4fa6ca8/bc60a149-c994-5272-bbe7-0497a4fa6ca8_image_5.png',
             'Extension': 'png',
             'FileSizeInBytes': 180722,
             'Height': 512,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_7ad57a0018750c93ce83402992660248.png',
             'Width': 512},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc60a149-c994-5272-bbe7-0497a4fa6ca8/bc60a149-c994-5272-bbe7-0497a4fa6ca8_image_6.png',
             'Extension': 'png',
             'FileSizeInBytes': 180722,
             'Height': 512,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_33c9bed8bed9bf85e98266aa43b27c4c.png',
             'Width': 512},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc60a149-c994-5272-bbe7-0497a4fa6ca8/bc60a149-c994-5272-bbe7-0497a4fa6ca8_image_7.png',
             'Extension': 'png',
             'FileSizeInBytes': 180722,
             'Height': 512,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_6342c2e18838fd009d979758c054c2f5.png',
             'Width': 512},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc60a149-c994-5272-bbe7-0497a4fa6ca8/bc60a149-c994-5272-bbe7-0497a4fa6ca8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_cf3b594cd77581920d06ba72ca1048f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc60a149-c994-5272-bbe7-0497a4fa6ca8/bc60a149-c994-5272-bbe7-0497a4fa6ca8_image_9.png',
             'Extension': 'png',
             'FileSizeInBytes': 180722,
             'Height': 512,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_9057f20e31ca8f75d862f791b714dc76.png',
             'Width': 512},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc60a149-c994-5272-bbe7-0497a4fa6ca8/bc60a149-c994-5272-bbe7-0497a4fa6ca8_image_10.png',
             'Extension': 'png',
             'FileSizeInBytes': 180722,
             'Height': 512,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_cdf99e165d8436b51a2841f61928b2b5.png',
             'Width': 512},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc60a149-c994-5272-bbe7-0497a4fa6ca8/bc60a149-c994-5272-bbe7-0497a4fa6ca8_image_11.png',
             'Extension': 'png',
             'FileSizeInBytes': 180722,
             'Height': 512,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/ca/d9ca3c6080180489c7b3db9a2cbff1de/pa/MM01049_9e7e96e4d9d08b69fef322c68b108d86.png',
             'Width': 512}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.5 Blue-HDi Shine Business',
 'transmission': 'automatic',
 'trim': 'Shine Business',
 'year': 2020}
2026-01-29 06:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MM01049%27 HTTP/1.1" 200 None
2026-01-29 06:00:32 [auto1.fr] INFO: Saving data for MM01049: {'created_time': 1769666432.633083, 'last_price_update_time': 1769666432.633099, 'auction_closing_time': 1769705576.0}
2026-01-29 06:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MM01049') HTTP/1.1" 204 0
2026-01-29 06:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8 with identifier: WU82726
2026-01-29 06:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8 with identifier: WU82726
2026-01-29 06:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8 with identifier: WU82726 to the API
2026-01-29 06:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WU82726>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 170,
 'expiration_date': '2026-01-29T16:31:02Z',
 'fuel_type': 'diesel',
 'id': 'cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU82726',
 'listing': 'auction',
 'location': 'FR, Marly-la-ville',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 111711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_3ebc2b02314c3b09d6e777febfdfef6e.jpg',
                'https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_6737fc164aec7d244bee444183ae161d.jpg',
                'https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_039416da6c3f85fafe2097627d8eec8f.jpg',
                'https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_45c4a83dc024756dd42a71ef6e2f872e.jpg',
                'https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_6d20d7cc0f757a533fc98ed2c3fae3c3.jpg',
                'https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_b5db8519c9bece24f17fbfb089be5437.jpg',
                'https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_25805cfdd929b8f1693eaac4c7c4016f.jpg',
                'https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_28cefd7d968df55db51cef49d4c53115.jpg',
                'https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_515bb493d6bac99c89c8b7b7b11e5956.jpg',
                'https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_cbe5a47817dee447b1e6ea1d9e68c061.jpg',
                'https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_bcbf59d8a59ac89c2ab850e4d4ee83fc.jpg',
                'https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_133a5397c8eb5fcef6aa9d18d20e3d7e.jpg',
                'https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_d3b230b999d0b088835a9f9031186d0c.jpg',
                'https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_d2d03cdf17bd1f8ee3347cc360c973af.jpg',
                'https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_af0a04f738b1ab64662a5427d53b1de8.jpg',
                'https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_13a3abd40d0cf7d7c8af6199df72a7bb.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8/cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3826953,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_3ebc2b02314c3b09d6e777febfdfef6e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8/cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_6737fc164aec7d244bee444183ae161d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8/cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_039416da6c3f85fafe2097627d8eec8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8/cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_45c4a83dc024756dd42a71ef6e2f872e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8/cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_6d20d7cc0f757a533fc98ed2c3fae3c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8/cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_b5db8519c9bece24f17fbfb089be5437.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8/cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_25805cfdd929b8f1693eaac4c7c4016f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8/cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2822846,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_28cefd7d968df55db51cef49d4c53115.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8/cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_515bb493d6bac99c89c8b7b7b11e5956.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8/cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_cbe5a47817dee447b1e6ea1d9e68c061.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8/cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_bcbf59d8a59ac89c2ab850e4d4ee83fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8/cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_133a5397c8eb5fcef6aa9d18d20e3d7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8/cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_d3b230b999d0b088835a9f9031186d0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8/cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_d2d03cdf17bd1f8ee3347cc360c973af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8/cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_af0a04f738b1ab64662a5427d53b1de8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8/cedd7964-2b9c-5b15-b5d2-faf61e5bd6c8_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/23/f623b2c8f9a54c61621300eb00fffa78/pa/WU82726_13a3abd40d0cf7d7c8af6199df72a7bb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2017}
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU82726%27 HTTP/1.1" 200 None
2026-01-29 06:00:33 [auto1.fr] INFO: Saving data for WU82726: {'created_time': 1769666433.30839, 'last_price_update_time': 1769666433.308406, 'auction_closing_time': 1769704262.0}
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WU82726') HTTP/1.1" 204 0
2026-01-29 06:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: de759db0-50b5-5227-8d05-67ca5fa5d9b1 with identifier: GA52113
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-01-29 06:00:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: de759db0-50b5-5227-8d05-67ca5fa5d9b1 with identifier: GA52113
2026-01-29 06:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'automatic', 'odometer': 73729, 'odometer_reading_unit': 'km', 'registration_date': '2020-12-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ga52113', 'expiration_date': '2026-01-29t16:45:13z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, le boulou', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 141, 'id': 'de759db0-50b5-5227-8d05-67ca5fa5d9b1', 'current_year_diff': 6, 'age_in_months': 61, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 73729}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 61,
     'auction_title': '',
     'c_o_2_emission_value': 141,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:45:13z',
     'fuel_type': 'petrol',
     'id': 'de759db0-50b5-5227-8d05-67ca5fa5d9b1',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ga52113',
     'listing': 'auction',
     'location': 'fr, le boulou',
     'make': 'citroen',
     'make_model': 'citroen c3 aircross',
     'model': 'c3 aircross',
     'odometer': 73729,
     'odometer_in_km': 73729,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-12-28',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 aircross 1.2 puretech shine',
     'transmission': 'automatic',
     'trim': 'shine',
     'year': 2020}
2026-01-29 06:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: de759db0-50b5-5227-8d05-67ca5fa5d9b1 spider: auto1.fr
2026-01-29 06:00:34 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: de759db0-50b5-5227-8d05-67ca5fa5d9b1 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'automatic', 'odometer': 73729, 'odometer_reading_unit': 'km', 'registration_date': '2020-12-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ga52113', 'expiration_date': '2026-01-29t16:45:13z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, le boulou', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 141, 'id': 'de759db0-50b5-5227-8d05-67ca5fa5d9b1', 'current_year_diff': 6, 'age_in_months': 61, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 73729}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 61,
     'auction_title': '',
     'c_o_2_emission_value': 141,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:45:13z',
     'fuel_type': 'petrol',
     'id': 'de759db0-50b5-5227-8d05-67ca5fa5d9b1',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ga52113',
     'listing': 'auction',
     'location': 'fr, le boulou',
     'make': 'citroen',
     'make_model': 'citroen c3 aircross',
     'model': 'c3 aircross',
     'odometer': 73729,
     'odometer_in_km': 73729,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-12-28',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 aircross 1.2 puretech shine',
     'transmission': 'automatic',
     'trim': 'shine',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:45:13Z',
 'fuel_type': 'petrol',
 'id': 'de759db0-50b5-5227-8d05-67ca5fa5d9b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA52113',
 'listing': 'auction',
 'location': 'FR, Le Boulou',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 73729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2020}
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GA52113%27 HTTP/1.1" 200 None
2026-01-29 06:00:34 [auto1.fr] INFO: Saving data for GA52113: {'auction_closing_time': 1769705113.0, 'created_time': 1768821336.929728, 'last_price_update_time': 1769666434.180643}
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GA52113') HTTP/1.1" 204 0
2026-01-29 06:00:34 [auto1.fr] INFO: Found listing with ID: JH35342
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JH35342%27 HTTP/1.1" 200 None
2026-01-29 06:00:34 [auto1.fr] INFO: Scrape type for JH35342: 1
2026-01-29 06:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AZ72812> (referer: https://www.auto1.com/v1/car-details-view/AZ72812/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SC50116> (referer: https://www.auto1.com/v1/car-details-view/SC50116/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:34 [auto1.fr] INFO: Found listing with ID: EK56691
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EK56691%27 HTTP/1.1" 200 None
2026-01-29 06:00:34 [auto1.fr] INFO: Scrape type for EK56691: 1
2026-01-29 06:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:34 [auto1.fr] INFO: Found listing with ID: WY33267
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WY33267%27 HTTP/1.1" 200 None
2026-01-29 06:00:34 [auto1.fr] INFO: Scrape type for WY33267: 1
2026-01-29 06:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d0554ef-1273-5dae-85b2-f0c03795ab6d with identifier: AZ72812
2026-01-29 06:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d0554ef-1273-5dae-85b2-f0c03795ab6d with scrape type 1
2026-01-29 06:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 8d0554ef-1273-5dae-85b2-f0c03795ab6d
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F43%252Fb24321cae9c45520cfd439e99023424d%252Fpa%252FAZ72812_eabaf6f00e3b848ef46f0581f81f36d8.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_eabaf6f00e3b848ef46f0581f81f36d8.jpg already downloaded
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F43%252Fb24321cae9c45520cfd439e99023424d%252Fpa%252FAZ72812_f3a56e7bbf7ad1b88447b26d7f99589e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_f3a56e7bbf7ad1b88447b26d7f99589e.jpg already downloaded
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F43%252Fb24321cae9c45520cfd439e99023424d%252Fpa%252FAZ72812_c5824454d9ed5f958069a3d3f9ce1c10.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_c5824454d9ed5f958069a3d3f9ce1c10.jpg already downloaded
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F43%252Fb24321cae9c45520cfd439e99023424d%252Fpa%252FAZ72812_3f3ad5b2f3c7f9c4acdc1d83e2bb97c7.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_3f3ad5b2f3c7f9c4acdc1d83e2bb97c7.jpg already downloaded
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F43%252Fb24321cae9c45520cfd439e99023424d%252Fpa%252FAZ72812_b7162932fe4cbafbe327bddd91653398.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_b7162932fe4cbafbe327bddd91653398.jpg already downloaded
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F43%252Fb24321cae9c45520cfd439e99023424d%252Fpa%252FAZ72812_0df49af78d896d8c8512baf57c12e518.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_0df49af78d896d8c8512baf57c12e518.jpg already downloaded
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F43%252Fb24321cae9c45520cfd439e99023424d%252Fpa%252FAZ72812_0e84bbd6ceb6b1993fe611bfd1d2c86b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_0e84bbd6ceb6b1993fe611bfd1d2c86b.jpg already downloaded
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F43%252Fb24321cae9c45520cfd439e99023424d%252Fpa%252FAZ72812_69748addaf76288f8849870befc15c5b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_69748addaf76288f8849870befc15c5b.jpg already downloaded
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F43%252Fb24321cae9c45520cfd439e99023424d%252Fpa%252FAZ72812_5d2c3d6c2a9cc8cb6109ea25643ac07d.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_5d2c3d6c2a9cc8cb6109ea25643ac07d.jpg already downloaded
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F43%252Fb24321cae9c45520cfd439e99023424d%252Fpa%252FAZ72812_522866bc498c31a18f357aed5991a4a0.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_522866bc498c31a18f357aed5991a4a0.jpg already downloaded
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F43%252Fb24321cae9c45520cfd439e99023424d%252Fpa%252FAZ72812_4e27d684501506d236212e4ecc1cb846.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_4e27d684501506d236212e4ecc1cb846.jpg already downloaded
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F43%252Fb24321cae9c45520cfd439e99023424d%252Fpa%252FAZ72812_28b74885cc1537fed41cee8fe7b5a5d5.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_28b74885cc1537fed41cee8fe7b5a5d5.jpg already downloaded
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F43%252Fb24321cae9c45520cfd439e99023424d%252Fpa%252FAZ72812_8f88fea882a25562a9eb007808dbde0f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_8f88fea882a25562a9eb007808dbde0f.jpg already downloaded
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F43%252Fb24321cae9c45520cfd439e99023424d%252Fpa%252FAZ72812_d77039d954a844e2a7bc2f08db800bf4.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_d77039d954a844e2a7bc2f08db800bf4.jpg already downloaded
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F43%252Fb24321cae9c45520cfd439e99023424d%252Fpa%252FAZ72812_19f4501b9e0fe5123b77466beb867617.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_19f4501b9e0fe5123b77466beb867617.jpg already downloaded
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F43%252Fb24321cae9c45520cfd439e99023424d%252Fpa%252FAZ72812_5f11da1ddf35a941a3a3c16b933923a0.png%27 HTTP/1.1" 200 None
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_5f11da1ddf35a941a3a3c16b933923a0.png already downloaded
2026-01-29 06:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8d0554ef-1273-5dae-85b2-f0c03795ab6d, identifier: AZ72812
2026-01-29 06:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1662cb1e-1fee-505f-9374-2a4e6f8ee522 with identifier: SC50116
2026-01-29 06:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1662cb1e-1fee-505f-9374-2a4e6f8ee522 with scrape type 2
2026-01-29 06:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1662cb1e-1fee-505f-9374-2a4e6f8ee522 with scrape type 2
2026-01-29 06:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1662cb1e-1fee-505f-9374-2a4e6f8ee522, identifier: SC50116
2026-01-29 06:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8d0554ef-1273-5dae-85b2-f0c03795ab6d with identifier: AZ72812
2026-01-29 06:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8d0554ef-1273-5dae-85b2-f0c03795ab6d with identifier: AZ72812
2026-01-29 06:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8d0554ef-1273-5dae-85b2-f0c03795ab6d with identifier: AZ72812 to the API
2026-01-29 06:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AZ72812>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:16:57Z',
 'fuel_type': 'diesel',
 'id': '8d0554ef-1273-5dae-85b2-f0c03795ab6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ72812',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 102539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_eabaf6f00e3b848ef46f0581f81f36d8.jpg',
                'https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_f3a56e7bbf7ad1b88447b26d7f99589e.jpg',
                'https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_c5824454d9ed5f958069a3d3f9ce1c10.jpg',
                'https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_3f3ad5b2f3c7f9c4acdc1d83e2bb97c7.jpg',
                'https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_b7162932fe4cbafbe327bddd91653398.jpg',
                'https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_0df49af78d896d8c8512baf57c12e518.jpg',
                'https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_0e84bbd6ceb6b1993fe611bfd1d2c86b.jpg',
                'https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_69748addaf76288f8849870befc15c5b.jpg',
                'https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_5d2c3d6c2a9cc8cb6109ea25643ac07d.jpg',
                'https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_522866bc498c31a18f357aed5991a4a0.jpg',
                'https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_4e27d684501506d236212e4ecc1cb846.jpg',
                'https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_28b74885cc1537fed41cee8fe7b5a5d5.jpg',
                'https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_8f88fea882a25562a9eb007808dbde0f.jpg',
                'https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_d77039d954a844e2a7bc2f08db800bf4.jpg',
                'https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_19f4501b9e0fe5123b77466beb867617.jpg',
                'https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_5f11da1ddf35a941a3a3c16b933923a0.png'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d0554ef-1273-5dae-85b2-f0c03795ab6d/8d0554ef-1273-5dae-85b2-f0c03795ab6d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_eabaf6f00e3b848ef46f0581f81f36d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d0554ef-1273-5dae-85b2-f0c03795ab6d/8d0554ef-1273-5dae-85b2-f0c03795ab6d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_f3a56e7bbf7ad1b88447b26d7f99589e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d0554ef-1273-5dae-85b2-f0c03795ab6d/8d0554ef-1273-5dae-85b2-f0c03795ab6d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_c5824454d9ed5f958069a3d3f9ce1c10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d0554ef-1273-5dae-85b2-f0c03795ab6d/8d0554ef-1273-5dae-85b2-f0c03795ab6d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_3f3ad5b2f3c7f9c4acdc1d83e2bb97c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d0554ef-1273-5dae-85b2-f0c03795ab6d/8d0554ef-1273-5dae-85b2-f0c03795ab6d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_b7162932fe4cbafbe327bddd91653398.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d0554ef-1273-5dae-85b2-f0c03795ab6d/8d0554ef-1273-5dae-85b2-f0c03795ab6d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_0df49af78d896d8c8512baf57c12e518.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d0554ef-1273-5dae-85b2-f0c03795ab6d/8d0554ef-1273-5dae-85b2-f0c03795ab6d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_0e84bbd6ceb6b1993fe611bfd1d2c86b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d0554ef-1273-5dae-85b2-f0c03795ab6d/8d0554ef-1273-5dae-85b2-f0c03795ab6d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56421,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_69748addaf76288f8849870befc15c5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d0554ef-1273-5dae-85b2-f0c03795ab6d/8d0554ef-1273-5dae-85b2-f0c03795ab6d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_5d2c3d6c2a9cc8cb6109ea25643ac07d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d0554ef-1273-5dae-85b2-f0c03795ab6d/8d0554ef-1273-5dae-85b2-f0c03795ab6d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_522866bc498c31a18f357aed5991a4a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d0554ef-1273-5dae-85b2-f0c03795ab6d/8d0554ef-1273-5dae-85b2-f0c03795ab6d_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_4e27d684501506d236212e4ecc1cb846.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d0554ef-1273-5dae-85b2-f0c03795ab6d/8d0554ef-1273-5dae-85b2-f0c03795ab6d_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_28b74885cc1537fed41cee8fe7b5a5d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d0554ef-1273-5dae-85b2-f0c03795ab6d/8d0554ef-1273-5dae-85b2-f0c03795ab6d_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_8f88fea882a25562a9eb007808dbde0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d0554ef-1273-5dae-85b2-f0c03795ab6d/8d0554ef-1273-5dae-85b2-f0c03795ab6d_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_d77039d954a844e2a7bc2f08db800bf4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d0554ef-1273-5dae-85b2-f0c03795ab6d/8d0554ef-1273-5dae-85b2-f0c03795ab6d_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_19f4501b9e0fe5123b77466beb867617.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d0554ef-1273-5dae-85b2-f0c03795ab6d/8d0554ef-1273-5dae-85b2-f0c03795ab6d_image_15.png',
             'Extension': 'png',
             'FileSizeInBytes': 78178,
             'Height': 525,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/43/b24321cae9c45520cfd439e99023424d/pa/AZ72812_5f11da1ddf35a941a3a3c16b933923a0.png',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-11',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Business 4x4',
 'transmission': 'automatic',
 'trim': 'Business 4x4',
 'year': 2018}
2026-01-29 06:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AZ72812%27 HTTP/1.1" 200 None
2026-01-29 06:00:36 [auto1.fr] INFO: Saving data for AZ72812: {'created_time': 1769666436.344968, 'last_price_update_time': 1769666436.344984, 'auction_closing_time': 1769703417.0}
2026-01-29 06:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AZ72812') HTTP/1.1" 204 0
2026-01-29 06:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1662cb1e-1fee-505f-9374-2a4e6f8ee522 with identifier: SC50116
2026-01-29 06:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:00:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-01-29 06:00:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1662cb1e-1fee-505f-9374-2a4e6f8ee522 with identifier: SC50116
2026-01-29 06:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1662cb1e-1fee-505f-9374-2a4e6f8ee522 with identifier: SC50116 to the API
2026-01-29 06:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SC50116>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 299,
 'expiration_date': '2026-01-29T16:48:49Z',
 'fuel_type': 'electro',
 'id': '1662cb1e-1fee-505f-9374-2a4e6f8ee522',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC50116',
 'listing': 'auction',
 'location': 'FR, Ambarès-et-Lagrave',
 'make': 'Tesla',
 'model': 'Model Y',
 'odometer': 62654,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Tesla Model Y Standard Range',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-01-29 06:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SC50116%27 HTTP/1.1" 200 None
2026-01-29 06:00:37 [auto1.fr] INFO: Saving data for SC50116: {'auction_closing_time': 1769705329.0, 'created_time': 1768842675.842553, 'last_price_update_time': 1769666437.641328}
2026-01-29 06:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SC50116') HTTP/1.1" 204 0
2026-01-29 06:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GG31907/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VF97823/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AV10982> (referer: https://www.auto1.com/v1/car-details-view/AV10982/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MS44390> (referer: https://www.auto1.com/v1/car-details-view/MS44390/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GN92315> (referer: https://www.auto1.com/v1/car-details-view/GN92315/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CD99747> (referer: https://www.auto1.com/v1/car-details-view/CD99747/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c475d91-dfc5-55d0-b179-f9063380cada with identifier: AV10982
2026-01-29 06:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c475d91-dfc5-55d0-b179-f9063380cada with scrape type 1
2026-01-29 06:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 6c475d91-dfc5-55d0-b179-f9063380cada
2026-01-29 06:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9a%252Fdc9a404daaeb93b1fcd95d1b16ffa8de%252Fpa%252FAV10982_316bd937f0d9cb4857bfc367614ae9db.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_316bd937f0d9cb4857bfc367614ae9db.jpg already downloaded
2026-01-29 06:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9a%252Fdc9a404daaeb93b1fcd95d1b16ffa8de%252Fpa%252FAV10982_3c92dc9fe84ce7144ac6433d63231035.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_3c92dc9fe84ce7144ac6433d63231035.jpg already downloaded
2026-01-29 06:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9a%252Fdc9a404daaeb93b1fcd95d1b16ffa8de%252Fpa%252FAV10982_1304b9eb0dc216fd2c6d9d7222e07929.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_1304b9eb0dc216fd2c6d9d7222e07929.jpg already downloaded
2026-01-29 06:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9a%252Fdc9a404daaeb93b1fcd95d1b16ffa8de%252Fpa%252FAV10982_cb3fb141dd80599b27fc9752e5f04c4c.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_cb3fb141dd80599b27fc9752e5f04c4c.jpg already downloaded
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9a%252Fdc9a404daaeb93b1fcd95d1b16ffa8de%252Fpa%252FAV10982_98a38ee2d20abfbe403ef8f09e3135e0.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_98a38ee2d20abfbe403ef8f09e3135e0.jpg already downloaded
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9a%252Fdc9a404daaeb93b1fcd95d1b16ffa8de%252Fpa%252FAV10982_415e059b5af403e2f4ea9a5665e62557.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_415e059b5af403e2f4ea9a5665e62557.jpg already downloaded
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9a%252Fdc9a404daaeb93b1fcd95d1b16ffa8de%252Fpa%252FAV10982_6f8b7b721a8d149d4c60c37292a8ad72.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_6f8b7b721a8d149d4c60c37292a8ad72.jpg already downloaded
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9a%252Fdc9a404daaeb93b1fcd95d1b16ffa8de%252Fpa%252FAV10982_7b70846631ff4b38bff9d6866ab6dbe6.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_7b70846631ff4b38bff9d6866ab6dbe6.jpg already downloaded
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9a%252Fdc9a404daaeb93b1fcd95d1b16ffa8de%252Fpa%252FAV10982_dc32c15e71fef493f97402d60debf2cf.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_dc32c15e71fef493f97402d60debf2cf.jpg already downloaded
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9a%252Fdc9a404daaeb93b1fcd95d1b16ffa8de%252Fpa%252FAV10982_e7b55a408a53938e5037c782dd319225.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_e7b55a408a53938e5037c782dd319225.jpg already downloaded
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9a%252Fdc9a404daaeb93b1fcd95d1b16ffa8de%252Fpa%252FAV10982_091b8dd469bf768bca6cba792d03dae5.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_091b8dd469bf768bca6cba792d03dae5.jpg already downloaded
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9a%252Fdc9a404daaeb93b1fcd95d1b16ffa8de%252Fpa%252FAV10982_2383db42fb466055eeb1dce789a2f5d7.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_2383db42fb466055eeb1dce789a2f5d7.jpg already downloaded
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9a%252Fdc9a404daaeb93b1fcd95d1b16ffa8de%252Fpa%252FAV10982_7d6d06bd581b061b734f2014d61505c0.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_7d6d06bd581b061b734f2014d61505c0.jpg already downloaded
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9a%252Fdc9a404daaeb93b1fcd95d1b16ffa8de%252Fpa%252FAV10982_458e5f03cd28968a708ff3933aa8c7e3.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_458e5f03cd28968a708ff3933aa8c7e3.jpg already downloaded
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9a%252Fdc9a404daaeb93b1fcd95d1b16ffa8de%252Fpa%252FAV10982_546b3d30448841660500d1ebeb5b4ca9.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_546b3d30448841660500d1ebeb5b4ca9.jpg already downloaded
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F9a%252Fdc9a404daaeb93b1fcd95d1b16ffa8de%252Fpa%252FAV10982_b79829e63f3d3c7a298b34cc346c0672.png%27 HTTP/1.1" 200 None
2026-01-29 06:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_b79829e63f3d3c7a298b34cc346c0672.png already downloaded
2026-01-29 06:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6c475d91-dfc5-55d0-b179-f9063380cada, identifier: AV10982
2026-01-29 06:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d9c28b3-bd42-51bb-8088-678087b97cf2 with identifier: MS44390
2026-01-29 06:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d9c28b3-bd42-51bb-8088-678087b97cf2 with scrape type 2
2026-01-29 06:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d9c28b3-bd42-51bb-8088-678087b97cf2 with scrape type 2
2026-01-29 06:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4d9c28b3-bd42-51bb-8088-678087b97cf2, identifier: MS44390
2026-01-29 06:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c123ebf-6e1a-5e56-9709-615de2232652 with identifier: GN92315
2026-01-29 06:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c123ebf-6e1a-5e56-9709-615de2232652 with scrape type 2
2026-01-29 06:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c123ebf-6e1a-5e56-9709-615de2232652 with scrape type 2
2026-01-29 06:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8c123ebf-6e1a-5e56-9709-615de2232652, identifier: GN92315
2026-01-29 06:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 178968db-49ba-53e1-9de6-6048929ab0b5 with identifier: CD99747
2026-01-29 06:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 178968db-49ba-53e1-9de6-6048929ab0b5 with scrape type 1
2026-01-29 06:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 178968db-49ba-53e1-9de6-6048929ab0b5
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F2e%252F7c2e9e369d4554e89773054a0ed1fb76%252Fpa%252FCD99747_1c8bbebfd754c739bceb35ce8db6b0c3.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_1c8bbebfd754c739bceb35ce8db6b0c3.jpg already downloaded
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F2e%252F7c2e9e369d4554e89773054a0ed1fb76%252Fpa%252FCD99747_7487eda138c7bd3609ee40b120876f59.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_7487eda138c7bd3609ee40b120876f59.jpg already downloaded
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F2e%252F7c2e9e369d4554e89773054a0ed1fb76%252Fpa%252FCD99747_a8bdcd43e501fdf6e024a361308a5c80.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_a8bdcd43e501fdf6e024a361308a5c80.jpg already downloaded
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F2e%252F7c2e9e369d4554e89773054a0ed1fb76%252Fpa%252FCD99747_06cb499e67df44f3872c89b5cf726dd5.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_06cb499e67df44f3872c89b5cf726dd5.jpg already downloaded
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F2e%252F7c2e9e369d4554e89773054a0ed1fb76%252Fpa%252FCD99747_2ecbb64dbf919fcdacdaebe5ccf7727c.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_2ecbb64dbf919fcdacdaebe5ccf7727c.jpg already downloaded
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F2e%252F7c2e9e369d4554e89773054a0ed1fb76%252Fpa%252FCD99747_720d250f562c8f1ec3b389c27a7ea146.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_720d250f562c8f1ec3b389c27a7ea146.jpg already downloaded
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F2e%252F7c2e9e369d4554e89773054a0ed1fb76%252Fpa%252FCD99747_05fcafc5e25cfd97a91d5d0600e99d13.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_05fcafc5e25cfd97a91d5d0600e99d13.jpg already downloaded
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F2e%252F7c2e9e369d4554e89773054a0ed1fb76%252Fpa%252FCD99747_5c800ede8ddfbd91f3f3562ba1c42ac6.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_5c800ede8ddfbd91f3f3562ba1c42ac6.jpg already downloaded
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F2e%252F7c2e9e369d4554e89773054a0ed1fb76%252Fpa%252FCD99747_ad9129961a3aed2455dc7601690bfc26.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_ad9129961a3aed2455dc7601690bfc26.jpg already downloaded
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F2e%252F7c2e9e369d4554e89773054a0ed1fb76%252Fpa%252FCD99747_6230b606383af187df045efda2d3180a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_6230b606383af187df045efda2d3180a.jpg already downloaded
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F2e%252F7c2e9e369d4554e89773054a0ed1fb76%252Fpa%252FCD99747_26dd8ebae6992d016685071316caccc3.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_26dd8ebae6992d016685071316caccc3.jpg already downloaded
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F2e%252F7c2e9e369d4554e89773054a0ed1fb76%252Fpa%252FCD99747_be8fa49b408293d938656b760f95ecab.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_be8fa49b408293d938656b760f95ecab.jpg already downloaded
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F2e%252F7c2e9e369d4554e89773054a0ed1fb76%252Fpa%252FCD99747_efa1d1692f4d9b909d65676ca282aa36.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_efa1d1692f4d9b909d65676ca282aa36.jpg already downloaded
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F2e%252F7c2e9e369d4554e89773054a0ed1fb76%252Fpa%252FCD99747_3963f8eb7ed21f4b9ca755264e7d919b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_3963f8eb7ed21f4b9ca755264e7d919b.jpg already downloaded
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F2e%252F7c2e9e369d4554e89773054a0ed1fb76%252Fpa%252FCD99747_f549fac3ee1c4c33a7f63c5c8d1fb28a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_f549fac3ee1c4c33a7f63c5c8d1fb28a.jpg already downloaded
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F2e%252F7c2e9e369d4554e89773054a0ed1fb76%252Fpa%252FCD99747_51d63662fa9192be3e9299ed080d622b.png%27 HTTP/1.1" 200 None
2026-01-29 06:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_51d63662fa9192be3e9299ed080d622b.png already downloaded
2026-01-29 06:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 178968db-49ba-53e1-9de6-6048929ab0b5, identifier: CD99747
2026-01-29 06:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6c475d91-dfc5-55d0-b179-f9063380cada with identifier: AV10982
2026-01-29 06:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6c475d91-dfc5-55d0-b179-f9063380cada with identifier: AV10982
2026-01-29 06:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6c475d91-dfc5-55d0-b179-f9063380cada with identifier: AV10982 to the API
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AV10982>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:21:46Z',
 'fuel_type': 'diesel',
 'id': '6c475d91-dfc5-55d0-b179-f9063380cada',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV10982',
 'listing': 'auction',
 'location': 'FR, LE HAVRE',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 117366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_316bd937f0d9cb4857bfc367614ae9db.jpg',
                'https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_3c92dc9fe84ce7144ac6433d63231035.jpg',
                'https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_1304b9eb0dc216fd2c6d9d7222e07929.jpg',
                'https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_cb3fb141dd80599b27fc9752e5f04c4c.jpg',
                'https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_98a38ee2d20abfbe403ef8f09e3135e0.jpg',
                'https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_415e059b5af403e2f4ea9a5665e62557.jpg',
                'https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_6f8b7b721a8d149d4c60c37292a8ad72.jpg',
                'https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_7b70846631ff4b38bff9d6866ab6dbe6.jpg',
                'https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_dc32c15e71fef493f97402d60debf2cf.jpg',
                'https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_e7b55a408a53938e5037c782dd319225.jpg',
                'https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_091b8dd469bf768bca6cba792d03dae5.jpg',
                'https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_2383db42fb466055eeb1dce789a2f5d7.jpg',
                'https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_7d6d06bd581b061b734f2014d61505c0.jpg',
                'https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_458e5f03cd28968a708ff3933aa8c7e3.jpg',
                'https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_546b3d30448841660500d1ebeb5b4ca9.jpg',
                'https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_b79829e63f3d3c7a298b34cc346c0672.png'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c475d91-dfc5-55d0-b179-f9063380cada/6c475d91-dfc5-55d0-b179-f9063380cada_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_316bd937f0d9cb4857bfc367614ae9db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c475d91-dfc5-55d0-b179-f9063380cada/6c475d91-dfc5-55d0-b179-f9063380cada_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70367,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_3c92dc9fe84ce7144ac6433d63231035.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c475d91-dfc5-55d0-b179-f9063380cada/6c475d91-dfc5-55d0-b179-f9063380cada_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_1304b9eb0dc216fd2c6d9d7222e07929.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c475d91-dfc5-55d0-b179-f9063380cada/6c475d91-dfc5-55d0-b179-f9063380cada_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_cb3fb141dd80599b27fc9752e5f04c4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c475d91-dfc5-55d0-b179-f9063380cada/6c475d91-dfc5-55d0-b179-f9063380cada_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_98a38ee2d20abfbe403ef8f09e3135e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c475d91-dfc5-55d0-b179-f9063380cada/6c475d91-dfc5-55d0-b179-f9063380cada_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2556287,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_415e059b5af403e2f4ea9a5665e62557.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c475d91-dfc5-55d0-b179-f9063380cada/6c475d91-dfc5-55d0-b179-f9063380cada_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_6f8b7b721a8d149d4c60c37292a8ad72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c475d91-dfc5-55d0-b179-f9063380cada/6c475d91-dfc5-55d0-b179-f9063380cada_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2857509,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_7b70846631ff4b38bff9d6866ab6dbe6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c475d91-dfc5-55d0-b179-f9063380cada/6c475d91-dfc5-55d0-b179-f9063380cada_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2841634,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_dc32c15e71fef493f97402d60debf2cf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c475d91-dfc5-55d0-b179-f9063380cada/6c475d91-dfc5-55d0-b179-f9063380cada_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_e7b55a408a53938e5037c782dd319225.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c475d91-dfc5-55d0-b179-f9063380cada/6c475d91-dfc5-55d0-b179-f9063380cada_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69061,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_091b8dd469bf768bca6cba792d03dae5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c475d91-dfc5-55d0-b179-f9063380cada/6c475d91-dfc5-55d0-b179-f9063380cada_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2807427,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_2383db42fb466055eeb1dce789a2f5d7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c475d91-dfc5-55d0-b179-f9063380cada/6c475d91-dfc5-55d0-b179-f9063380cada_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_7d6d06bd581b061b734f2014d61505c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c475d91-dfc5-55d0-b179-f9063380cada/6c475d91-dfc5-55d0-b179-f9063380cada_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61116,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_458e5f03cd28968a708ff3933aa8c7e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c475d91-dfc5-55d0-b179-f9063380cada/6c475d91-dfc5-55d0-b179-f9063380cada_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_546b3d30448841660500d1ebeb5b4ca9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c475d91-dfc5-55d0-b179-f9063380cada/6c475d91-dfc5-55d0-b179-f9063380cada_image_15.png',
             'Extension': 'png',
             'FileSizeInBytes': 121554,
             'Height': 525,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/9a/dc9a404daaeb93b1fcd95d1b16ffa8de/pa/AV10982_b79829e63f3d3c7a298b34cc346c0672.png',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.6 dCi Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2017}
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV10982%27 HTTP/1.1" 200 None
2026-01-29 06:00:40 [auto1.fr] INFO: Saving data for AV10982: {'created_time': 1769666440.413787, 'last_price_update_time': 1769666440.413799, 'auction_closing_time': 1769703706.0}
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AV10982') HTTP/1.1" 204 0
2026-01-29 06:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4d9c28b3-bd42-51bb-8088-678087b97cf2 with identifier: MS44390
2026-01-29 06:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4d9c28b3-bd42-51bb-8088-678087b97cf2 with identifier: MS44390
2026-01-29 06:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4d9c28b3-bd42-51bb-8088-678087b97cf2 with identifier: MS44390 to the API
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MS44390>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-01-29T16:51:53Z',
 'fuel_type': 'diesel',
 'id': '4d9c28b3-bd42-51bb-8088-678087b97cf2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS44390',
 'listing': 'auction',
 'location': 'FR, Quincieux',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 124993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-27',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 2.0 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2018}
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MS44390%27 HTTP/1.1" 200 None
2026-01-29 06:00:41 [auto1.fr] INFO: Saving data for MS44390: {'auction_closing_time': 1769705513.0, 'created_time': 1765794821.011077, 'last_price_update_time': 1769666441.14364}
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MS44390') HTTP/1.1" 204 0
2026-01-29 06:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8c123ebf-6e1a-5e56-9709-615de2232652 with identifier: GN92315
2026-01-29 06:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8c123ebf-6e1a-5e56-9709-615de2232652 with identifier: GN92315
2026-01-29 06:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8c123ebf-6e1a-5e56-9709-615de2232652 with identifier: GN92315 to the API
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GN92315>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:40:13Z',
 'fuel_type': 'diesel',
 'id': '8c123ebf-6e1a-5e56-9709-615de2232652',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN92315',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 90656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN92315%27 HTTP/1.1" 200 None
2026-01-29 06:00:42 [auto1.fr] INFO: Saving data for GN92315: {'auction_closing_time': 1769704813.0, 'created_time': 1768991764.296713, 'last_price_update_time': 1769666442.082545}
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GN92315') HTTP/1.1" 204 0
2026-01-29 06:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 178968db-49ba-53e1-9de6-6048929ab0b5 with identifier: CD99747
2026-01-29 06:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 178968db-49ba-53e1-9de6-6048929ab0b5 with identifier: CD99747
2026-01-29 06:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'manual', 'odometer': 84537, 'odometer_reading_unit': 'km', 'registration_date': '2017-09-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cd99747', 'expiration_date': '2026-01-29t16:01:06z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_1c8bbebfd754c739bceb35ce8db6b0c3.jpg', 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_7487eda138c7bd3609ee40b120876f59.jpg', 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_a8bdcd43e501fdf6e024a361308a5c80.jpg', 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_06cb499e67df44f3872c89b5cf726dd5.jpg', 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_2ecbb64dbf919fcdacdaebe5ccf7727c.jpg', 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_720d250f562c8f1ec3b389c27a7ea146.jpg', 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_05fcafc5e25cfd97a91d5d0600e99d13.jpg', 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_5c800ede8ddfbd91f3f3562ba1c42ac6.jpg', 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_ad9129961a3aed2455dc7601690bfc26.jpg', 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_6230b606383af187df045efda2d3180a.jpg', 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_26dd8ebae6992d016685071316caccc3.jpg', 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_be8fa49b408293d938656b760f95ecab.jpg', 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_efa1d1692f4d9b909d65676ca282aa36.jpg', 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_3963f8eb7ed21f4b9ca755264e7d919b.jpg', 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_f549fac3ee1c4c33a7f63c5c8d1fb28a.jpg', 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_51d63662fa9192be3e9299ed080d622b.png'], 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, le boulou', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 115, 'id': '178968db-49ba-53e1-9de6-6048929ab0b5', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_1c8bbebfd754c739bceb35ce8db6b0c3.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 78879}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_7487eda138c7bd3609ee40b120876f59.jpg', 'Width': 800, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 58128}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_a8bdcd43e501fdf6e024a361308a5c80.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68345}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_06cb499e67df44f3872c89b5cf726dd5.jpg', 'Width': 800, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 51293}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_2ecbb64dbf919fcdacdaebe5ccf7727c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 75452}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_720d250f562c8f1ec3b389c27a7ea146.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 69700}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_05fcafc5e25cfd97a91d5d0600e99d13.jpg', 'Width': 800, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 49919}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_5c800ede8ddfbd91f3f3562ba1c42ac6.jpg', 'Width': 800, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 60404}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_ad9129961a3aed2455dc7601690bfc26.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 75750}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_6230b606383af187df045efda2d3180a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 83220}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_26dd8ebae6992d016685071316caccc3.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 72385}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_be8fa49b408293d938656b760f95ecab.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 56735}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_efa1d1692f4d9b909d65676ca282aa36.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57572}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_3963f8eb7ed21f4b9ca755264e7d919b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62472}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_f549fac3ee1c4c33a7f63c5c8d1fb28a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 72433}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_51d63662fa9192be3e9299ed080d622b.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 82708}], 'current_year_diff': 9, 'age_in_months': 99, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 84537}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 99,
     'auction_title': '',
     'c_o_2_emission_value': 115,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:01:06z',
     'fuel_type': 'petrol',
     'id': '178968db-49ba-53e1-9de6-6048929ab0b5',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cd99747',
     'listing': 'auction',
     'location': 'fr, le boulou',
     'make': 'citroen',
     'make_model': 'citroen c3 aircross',
     'model': 'c3 aircross',
     'odometer': 84537,
     'odometer_in_km': 84537,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 16,
     'photo_urls': ['https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_1c8bbebfd754c739bceb35ce8db6b0c3.jpg',
                    'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_7487eda138c7bd3609ee40b120876f59.jpg',
                    'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_a8bdcd43e501fdf6e024a361308a5c80.jpg',
                    'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_06cb499e67df44f3872c89b5cf726dd5.jpg',
                    'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_2ecbb64dbf919fcdacdaebe5ccf7727c.jpg',
                    'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_720d250f562c8f1ec3b389c27a7ea146.jpg',
                    'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_05fcafc5e25cfd97a91d5d0600e99d13.jpg',
                    'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_5c800ede8ddfbd91f3f3562ba1c42ac6.jpg',
                    'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_ad9129961a3aed2455dc7601690bfc26.jpg',
                    'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_6230b606383af187df045efda2d3180a.jpg',
                    'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_26dd8ebae6992d016685071316caccc3.jpg',
                    'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_be8fa49b408293d938656b760f95ecab.jpg',
                    'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_efa1d1692f4d9b909d65676ca282aa36.jpg',
                    'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_3963f8eb7ed21f4b9ca755264e7d919b.jpg',
                    'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_f549fac3ee1c4c33a7f63c5c8d1fb28a.jpg',
                    'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_51d63662fa9192be3e9299ed080d622b.png'],
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 78879,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_1c8bbebfd754c739bceb35ce8db6b0c3.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 58128,
                 'Height': 450,
                 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_7487eda138c7bd3609ee40b120876f59.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 68345,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_a8bdcd43e501fdf6e024a361308a5c80.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51293,
                 'Height': 450,
                 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_06cb499e67df44f3872c89b5cf726dd5.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 75452,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_2ecbb64dbf919fcdacdaebe5ccf7727c.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 69700,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_720d250f562c8f1ec3b389c27a7ea146.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 49919,
                 'Height': 450,
                 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_05fcafc5e25cfd97a91d5d0600e99d13.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 60404,
                 'Height': 450,
                 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_5c800ede8ddfbd91f3f3562ba1c42ac6.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 75750,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_ad9129961a3aed2455dc7601690bfc26.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 83220,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_6230b606383af187df045efda2d3180a.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 72385,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_26dd8ebae6992d016685071316caccc3.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56735,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_be8fa49b408293d938656b760f95ecab.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57572,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_efa1d1692f4d9b909d65676ca282aa36.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 62472,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_3963f8eb7ed21f4b9ca755264e7d919b.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 72433,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_f549fac3ee1c4c33a7f63c5c8d1fb28a.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_15.png',
                 'Extension': 'png',
                 'FileSizeInBytes': 82708,
                 'Height': 525,
                 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_51d63662fa9192be3e9299ed080d622b.png',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-09-30',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 aircross 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2017}
2026-01-29 06:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 178968db-49ba-53e1-9de6-6048929ab0b5 spider: auto1.fr
2026-01-29 06:00:42 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 178968db-49ba-53e1-9de6-6048929ab0b5 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'manual', 'odometer': 84537, 'odometer_reading_unit': 'km', 'registration_date': '2017-09-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cd99747', 'expiration_date': '2026-01-29t16:01:06z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_1c8bbebfd754c739bceb35ce8db6b0c3.jpg', 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_7487eda138c7bd3609ee40b120876f59.jpg', 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_a8bdcd43e501fdf6e024a361308a5c80.jpg', 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_06cb499e67df44f3872c89b5cf726dd5.jpg', 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_2ecbb64dbf919fcdacdaebe5ccf7727c.jpg', 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_720d250f562c8f1ec3b389c27a7ea146.jpg', 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_05fcafc5e25cfd97a91d5d0600e99d13.jpg', 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_5c800ede8ddfbd91f3f3562ba1c42ac6.jpg', 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_ad9129961a3aed2455dc7601690bfc26.jpg', 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_6230b606383af187df045efda2d3180a.jpg', 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_26dd8ebae6992d016685071316caccc3.jpg', 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_be8fa49b408293d938656b760f95ecab.jpg', 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_efa1d1692f4d9b909d65676ca282aa36.jpg', 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_3963f8eb7ed21f4b9ca755264e7d919b.jpg', 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_f549fac3ee1c4c33a7f63c5c8d1fb28a.jpg', 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_51d63662fa9192be3e9299ed080d622b.png'], 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, le boulou', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 115, 'id': '178968db-49ba-53e1-9de6-6048929ab0b5', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_1c8bbebfd754c739bceb35ce8db6b0c3.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 78879}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_7487eda138c7bd3609ee40b120876f59.jpg', 'Width': 800, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 58128}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_a8bdcd43e501fdf6e024a361308a5c80.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68345}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_06cb499e67df44f3872c89b5cf726dd5.jpg', 'Width': 800, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 51293}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_2ecbb64dbf919fcdacdaebe5ccf7727c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 75452}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_720d250f562c8f1ec3b389c27a7ea146.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 69700}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_05fcafc5e25cfd97a91d5d0600e99d13.jpg', 'Width': 800, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 49919}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_5c800ede8ddfbd91f3f3562ba1c42ac6.jpg', 'Width': 800, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 60404}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_ad9129961a3aed2455dc7601690bfc26.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 75750}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_6230b606383af187df045efda2d3180a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 83220}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_26dd8ebae6992d016685071316caccc3.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 72385}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_be8fa49b408293d938656b760f95ecab.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 56735}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_efa1d1692f4d9b909d65676ca282aa36.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57572}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_3963f8eb7ed21f4b9ca755264e7d919b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62472}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_f549fac3ee1c4c33a7f63c5c8d1fb28a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 72433}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_51d63662fa9192be3e9299ed080d622b.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 82708}], 'current_year_diff': 9, 'age_in_months': 99, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 84537}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 99,
     'auction_title': '',
     'c_o_2_emission_value': 115,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:01:06z',
     'fuel_type': 'petrol',
     'id': '178968db-49ba-53e1-9de6-6048929ab0b5',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cd99747',
     'listing': 'auction',
     'location': 'fr, le boulou',
     'make': 'citroen',
     'make_model': 'citroen c3 aircross',
     'model': 'c3 aircross',
     'odometer': 84537,
     'odometer_in_km': 84537,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 16,
     'photo_urls': ['https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_1c8bbebfd754c739bceb35ce8db6b0c3.jpg',
                    'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_7487eda138c7bd3609ee40b120876f59.jpg',
                    'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_a8bdcd43e501fdf6e024a361308a5c80.jpg',
                    'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_06cb499e67df44f3872c89b5cf726dd5.jpg',
                    'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_2ecbb64dbf919fcdacdaebe5ccf7727c.jpg',
                    'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_720d250f562c8f1ec3b389c27a7ea146.jpg',
                    'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_05fcafc5e25cfd97a91d5d0600e99d13.jpg',
                    'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_5c800ede8ddfbd91f3f3562ba1c42ac6.jpg',
                    'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_ad9129961a3aed2455dc7601690bfc26.jpg',
                    'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_6230b606383af187df045efda2d3180a.jpg',
                    'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_26dd8ebae6992d016685071316caccc3.jpg',
                    'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_be8fa49b408293d938656b760f95ecab.jpg',
                    'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_efa1d1692f4d9b909d65676ca282aa36.jpg',
                    'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_3963f8eb7ed21f4b9ca755264e7d919b.jpg',
                    'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_f549fac3ee1c4c33a7f63c5c8d1fb28a.jpg',
                    'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_51d63662fa9192be3e9299ed080d622b.png'],
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 78879,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_1c8bbebfd754c739bceb35ce8db6b0c3.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 58128,
                 'Height': 450,
                 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_7487eda138c7bd3609ee40b120876f59.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 68345,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_a8bdcd43e501fdf6e024a361308a5c80.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51293,
                 'Height': 450,
                 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_06cb499e67df44f3872c89b5cf726dd5.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 75452,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_2ecbb64dbf919fcdacdaebe5ccf7727c.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 69700,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_720d250f562c8f1ec3b389c27a7ea146.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 49919,
                 'Height': 450,
                 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_05fcafc5e25cfd97a91d5d0600e99d13.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 60404,
                 'Height': 450,
                 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_5c800ede8ddfbd91f3f3562ba1c42ac6.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 75750,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_ad9129961a3aed2455dc7601690bfc26.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 83220,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_6230b606383af187df045efda2d3180a.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 72385,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_26dd8ebae6992d016685071316caccc3.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56735,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_be8fa49b408293d938656b760f95ecab.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57572,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_efa1d1692f4d9b909d65676ca282aa36.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 62472,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_3963f8eb7ed21f4b9ca755264e7d919b.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 72433,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_f549fac3ee1c4c33a7f63c5c8d1fb28a.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_15.png',
                 'Extension': 'png',
                 'FileSizeInBytes': 82708,
                 'Height': 525,
                 'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_51d63662fa9192be3e9299ed080d622b.png',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-09-30',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 aircross 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:01:06Z',
 'fuel_type': 'petrol',
 'id': '178968db-49ba-53e1-9de6-6048929ab0b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD99747',
 'listing': 'auction',
 'location': 'FR, Le Boulou',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 84537,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_1c8bbebfd754c739bceb35ce8db6b0c3.jpg',
                'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_7487eda138c7bd3609ee40b120876f59.jpg',
                'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_a8bdcd43e501fdf6e024a361308a5c80.jpg',
                'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_06cb499e67df44f3872c89b5cf726dd5.jpg',
                'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_2ecbb64dbf919fcdacdaebe5ccf7727c.jpg',
                'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_720d250f562c8f1ec3b389c27a7ea146.jpg',
                'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_05fcafc5e25cfd97a91d5d0600e99d13.jpg',
                'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_5c800ede8ddfbd91f3f3562ba1c42ac6.jpg',
                'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_ad9129961a3aed2455dc7601690bfc26.jpg',
                'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_6230b606383af187df045efda2d3180a.jpg',
                'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_26dd8ebae6992d016685071316caccc3.jpg',
                'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_be8fa49b408293d938656b760f95ecab.jpg',
                'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_efa1d1692f4d9b909d65676ca282aa36.jpg',
                'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_3963f8eb7ed21f4b9ca755264e7d919b.jpg',
                'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_f549fac3ee1c4c33a7f63c5c8d1fb28a.jpg',
                'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_51d63662fa9192be3e9299ed080d622b.png'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_1c8bbebfd754c739bceb35ce8db6b0c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58128,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_7487eda138c7bd3609ee40b120876f59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_a8bdcd43e501fdf6e024a361308a5c80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51293,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_06cb499e67df44f3872c89b5cf726dd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_2ecbb64dbf919fcdacdaebe5ccf7727c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69700,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_720d250f562c8f1ec3b389c27a7ea146.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49919,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_05fcafc5e25cfd97a91d5d0600e99d13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60404,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_5c800ede8ddfbd91f3f3562ba1c42ac6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_ad9129961a3aed2455dc7601690bfc26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83220,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_6230b606383af187df045efda2d3180a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72385,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_26dd8ebae6992d016685071316caccc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_be8fa49b408293d938656b760f95ecab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57572,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_efa1d1692f4d9b909d65676ca282aa36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_3963f8eb7ed21f4b9ca755264e7d919b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72433,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_f549fac3ee1c4c33a7f63c5c8d1fb28a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178968db-49ba-53e1-9de6-6048929ab0b5/178968db-49ba-53e1-9de6-6048929ab0b5_image_15.png',
             'Extension': 'png',
             'FileSizeInBytes': 82708,
             'Height': 525,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/2e/7c2e9e369d4554e89773054a0ed1fb76/pa/CD99747_51d63662fa9192be3e9299ed080d622b.png',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2017}
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CD99747%27 HTTP/1.1" 200 None
2026-01-29 06:00:42 [auto1.fr] INFO: Saving data for CD99747: {'created_time': 1769666442.44984, 'last_price_update_time': 1769666442.449854, 'auction_closing_time': 1769702466.0}
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CD99747') HTTP/1.1" 204 0
2026-01-29 06:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DL71358/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CE88723/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KW58357/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UK05835/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GG58617/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FK20372/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PX67710/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VN50741/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JH35342/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LF63766/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WY33267/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SV32349/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EK56691/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JJ40715/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MJ86885> (referer: https://www.auto1.com/v1/car-details-view/MJ86885/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2157061f-feee-5a6b-8ecd-1824baae5db4 with identifier: MJ86885
2026-01-29 06:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2157061f-feee-5a6b-8ecd-1824baae5db4 with scrape type 1
2026-01-29 06:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 2157061f-feee-5a6b-8ecd-1824baae5db4
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F52%252F1a5219605f0ba0d9d1b8a2d791b1d90f%252Fpa%252FMJ86885_6d8353bb12de2355be985ad1e8ac4327.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_6d8353bb12de2355be985ad1e8ac4327.jpg not downloaded yet
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F52%252F1a5219605f0ba0d9d1b8a2d791b1d90f%252Fpa%252FMJ86885_3eed1c454e9425286bfc29b455f5b1f5.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_3eed1c454e9425286bfc29b455f5b1f5.jpg not downloaded yet
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F52%252F1a5219605f0ba0d9d1b8a2d791b1d90f%252Fpa%252FMJ86885_d2b9723bed6d5da1e171386869893e50.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_d2b9723bed6d5da1e171386869893e50.jpg not downloaded yet
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F52%252F1a5219605f0ba0d9d1b8a2d791b1d90f%252Fpa%252FMJ86885_9629db44f0d417888b097e8edb8ea66c.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_9629db44f0d417888b097e8edb8ea66c.jpg not downloaded yet
2026-01-29 06:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FL57020/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F52%252F1a5219605f0ba0d9d1b8a2d791b1d90f%252Fpa%252FMJ86885_5f0375ad34dce18079603efa81c99fb4.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_5f0375ad34dce18079603efa81c99fb4.jpg not downloaded yet
2026-01-29 06:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F52%252F1a5219605f0ba0d9d1b8a2d791b1d90f%252Fpa%252FMJ86885_4177dc60a2a2e2621280730c6bb6616e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_4177dc60a2a2e2621280730c6bb6616e.jpg not downloaded yet
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F52%252F1a5219605f0ba0d9d1b8a2d791b1d90f%252Fpa%252FMJ86885_3c36ea22b86aa26a2cbbdc6db5e39a98.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_3c36ea22b86aa26a2cbbdc6db5e39a98.jpg not downloaded yet
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F52%252F1a5219605f0ba0d9d1b8a2d791b1d90f%252Fpa%252FMJ86885_c1571d950cbe70b3ecedb234d9e8ae02.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_c1571d950cbe70b3ecedb234d9e8ae02.jpg not downloaded yet
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F52%252F1a5219605f0ba0d9d1b8a2d791b1d90f%252Fpa%252FMJ86885_2b615445e80f61a6a007d1f0d443059d.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_2b615445e80f61a6a007d1f0d443059d.jpg not downloaded yet
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F52%252F1a5219605f0ba0d9d1b8a2d791b1d90f%252Fpa%252FMJ86885_c393c8d6b05ec3391ee2042774cc2d2c.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_c393c8d6b05ec3391ee2042774cc2d2c.jpg not downloaded yet
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F52%252F1a5219605f0ba0d9d1b8a2d791b1d90f%252Fpa%252FMJ86885_eb3ae2cca46f5441980df1d674301286.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_eb3ae2cca46f5441980df1d674301286.jpg not downloaded yet
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F52%252F1a5219605f0ba0d9d1b8a2d791b1d90f%252Fpa%252FMJ86885_a017f58076b8680971a3e3b44a1574f6.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_a017f58076b8680971a3e3b44a1574f6.jpg not downloaded yet
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F52%252F1a5219605f0ba0d9d1b8a2d791b1d90f%252Fpa%252FMJ86885_689d4ac093c78a54f7a37e99cab2e6ef.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_689d4ac093c78a54f7a37e99cab2e6ef.jpg not downloaded yet
2026-01-29 06:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BT80701/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F52%252F1a5219605f0ba0d9d1b8a2d791b1d90f%252Fpa%252FMJ86885_59c717bb3e73e2c881b9c097b5670a67.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_59c717bb3e73e2c881b9c097b5670a67.jpg not downloaded yet
2026-01-29 06:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F52%252F1a5219605f0ba0d9d1b8a2d791b1d90f%252Fpa%252FMJ86885_4ac30f6dc26360cad0e18132b04b2244.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_4ac30f6dc26360cad0e18132b04b2244.jpg not downloaded yet
2026-01-29 06:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DL71358> (referer: https://www.auto1.com/v1/car-details-view/DL71358/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F52%252F1a5219605f0ba0d9d1b8a2d791b1d90f%252Fpa%252FMJ86885_b359c5bfe962a5b3dee6c7485a4711ab.png%27 HTTP/1.1" 200 None
2026-01-29 06:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_b359c5bfe962a5b3dee6c7485a4711ab.png not downloaded yet
2026-01-29 06:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KW58357> (referer: https://www.auto1.com/v1/car-details-view/KW58357/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VF97823> (referer: https://www.auto1.com/v1/car-details-view/VF97823/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcd423c2-72b9-5ec0-bb40-7e1554a38ec3 with identifier: DL71358
2026-01-29 06:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcd423c2-72b9-5ec0-bb40-7e1554a38ec3 with scrape type 2
2026-01-29 06:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcd423c2-72b9-5ec0-bb40-7e1554a38ec3 with scrape type 2
2026-01-29 06:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fcd423c2-72b9-5ec0-bb40-7e1554a38ec3, identifier: DL71358
2026-01-29 06:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fcd423c2-72b9-5ec0-bb40-7e1554a38ec3 with identifier: DL71358
2026-01-29 06:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fcd423c2-72b9-5ec0-bb40-7e1554a38ec3 with identifier: DL71358
2026-01-29 06:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'nissan juke 1.2 tekna', 'price': 0, 'currency': 'eur', 'make': 'nissan', 'model': 'juke', 'transmission': 'manual', 'odometer': 103399, 'odometer_reading_unit': 'km', 'registration_date': '2018-06-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dl71358', 'expiration_date': '2026-01-29t16:32:25z', 'origin_country_code': 'fr', 'trim': 'tekna', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 115, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 128, 'id': 'fcd423c2-72b9-5ec0-bb40-7e1554a38ec3', 'current_year_diff': 8, 'age_in_months': 91, 'make_model': 'nissan juke', 'sanitized_make': 'nissan', 'odometer_in_km': 103399}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 91,
     'auction_title': '',
     'c_o_2_emission_value': 128,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 115,
     'expiration_date': '2026-01-29t16:32:25z',
     'fuel_type': 'petrol',
     'id': 'fcd423c2-72b9-5ec0-bb40-7e1554a38ec3',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dl71358',
     'listing': 'auction',
     'location': 'fr',
     'make': 'nissan',
     'make_model': 'nissan juke',
     'model': 'juke',
     'odometer': 103399,
     'odometer_in_km': 103399,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-06-26',
     'sanitized_make': 'nissan',
     'seats_number': 5,
     'seller_name': None,
     'title': 'nissan juke 1.2 tekna',
     'transmission': 'manual',
     'trim': 'tekna',
     'year': 2018}
2026-01-29 06:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: fcd423c2-72b9-5ec0-bb40-7e1554a38ec3 spider: auto1.fr
2026-01-29 06:00:45 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: fcd423c2-72b9-5ec0-bb40-7e1554a38ec3 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'nissan juke 1.2 tekna', 'price': 0, 'currency': 'eur', 'make': 'nissan', 'model': 'juke', 'transmission': 'manual', 'odometer': 103399, 'odometer_reading_unit': 'km', 'registration_date': '2018-06-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dl71358', 'expiration_date': '2026-01-29t16:32:25z', 'origin_country_code': 'fr', 'trim': 'tekna', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 115, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 128, 'id': 'fcd423c2-72b9-5ec0-bb40-7e1554a38ec3', 'current_year_diff': 8, 'age_in_months': 91, 'make_model': 'nissan juke', 'sanitized_make': 'nissan', 'odometer_in_km': 103399}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 91,
     'auction_title': '',
     'c_o_2_emission_value': 128,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 115,
     'expiration_date': '2026-01-29t16:32:25z',
     'fuel_type': 'petrol',
     'id': 'fcd423c2-72b9-5ec0-bb40-7e1554a38ec3',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dl71358',
     'listing': 'auction',
     'location': 'fr',
     'make': 'nissan',
     'make_model': 'nissan juke',
     'model': 'juke',
     'odometer': 103399,
     'odometer_in_km': 103399,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-06-26',
     'sanitized_make': 'nissan',
     'seats_number': 5,
     'seller_name': None,
     'title': 'nissan juke 1.2 tekna',
     'transmission': 'manual',
     'trim': 'tekna',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:32:25Z',
 'fuel_type': 'petrol',
 'id': 'fcd423c2-72b9-5ec0-bb40-7e1554a38ec3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL71358',
 'listing': 'auction',
 'location': 'FR',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 103399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Juke 1.2 Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2018}
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DL71358%27 HTTP/1.1" 200 None
2026-01-29 06:00:45 [auto1.fr] INFO: Saving data for DL71358: {'auction_closing_time': 1769704345.0, 'created_time': 1769533662.709758, 'last_price_update_time': 1769666445.501105}
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DL71358') HTTP/1.1" 204 0
2026-01-29 06:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_689d4ac093c78a54f7a37e99cab2e6ef.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_9629db44f0d417888b097e8edb8ea66c.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GG31907> (referer: https://www.auto1.com/v1/car-details-view/GG31907/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CE88723> (referer: https://www.auto1.com/v1/car-details-view/CE88723/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FK20372> (referer: https://www.auto1.com/v1/car-details-view/FK20372/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c9707d0-c65d-56d5-9437-42b8754a3918 with identifier: KW58357
2026-01-29 06:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c9707d0-c65d-56d5-9437-42b8754a3918 with scrape type 1
2026-01-29 06:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 4c9707d0-c65d-56d5-9437-42b8754a3918
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd1%252Ff1d1a2e97d7c9518d5af363c281f6ee5%252Fpa%252FKW58357_e39a75c32f59498fdd11adfeaa2c3d82.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_e39a75c32f59498fdd11adfeaa2c3d82.jpg not downloaded yet
2026-01-29 06:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b54ba443-b1a4-55ea-8bad-d36846b91e0d with identifier: VF97823
2026-01-29 06:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b54ba443-b1a4-55ea-8bad-d36846b91e0d with scrape type 2
2026-01-29 06:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b54ba443-b1a4-55ea-8bad-d36846b91e0d with scrape type 2
2026-01-29 06:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b54ba443-b1a4-55ea-8bad-d36846b91e0d, identifier: VF97823
2026-01-29 06:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b54ba443-b1a4-55ea-8bad-d36846b91e0d with identifier: VF97823
2026-01-29 06:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b54ba443-b1a4-55ea-8bad-d36846b91e0d with identifier: VF97823
2026-01-29 06:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 173613 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    173613
2026-01-29 06:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b54ba443-b1a4-55ea-8bad-d36846b91e0d spider: auto1.fr
2026-01-29 06:00:46 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: b54ba443-b1a4-55ea-8bad-d36846b91e0d due to rule: high_mileage_for_country.json, error: 173613 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    173613
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 155,
 'expiration_date': '2026-01-29T16:35:31Z',
 'fuel_type': 'petrol',
 'id': 'b54ba443-b1a4-55ea-8bad-d36846b91e0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF97823',
 'listing': 'auction',
 'location': 'FR',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 173613,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-08-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid Active X',
 'transmission': 'automatic',
 'trim': 'Active X',
 'year': 2022}
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VF97823%27 HTTP/1.1" 200 None
2026-01-29 06:00:46 [auto1.fr] INFO: Saving data for VF97823: {'auction_closing_time': 1769704531.0, 'created_time': 1767200878.433668, 'last_price_update_time': 1769666446.223668}
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VF97823') HTTP/1.1" 204 0
2026-01-29 06:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_a017f58076b8680971a3e3b44a1574f6.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd1%252Ff1d1a2e97d7c9518d5af363c281f6ee5%252Fpa%252FKW58357_f8aed69519ab8bb10c84c5484d49588c.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_f8aed69519ab8bb10c84c5484d49588c.jpg not downloaded yet
2026-01-29 06:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PX67710> (referer: https://www.auto1.com/v1/car-details-view/PX67710/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VN50741> (referer: https://www.auto1.com/v1/car-details-view/VN50741/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ffab9d0>
2026-01-29 06:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_12.jpg HTTP/1.1" 201 0
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F52%252F1a5219605f0ba0d9d1b8a2d791b1d90f%252Fpa%252FMJ86885_689d4ac093c78a54f7a37e99cab2e6ef.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_689d4ac093c78a54f7a37e99cab2e6ef.jpg saved to cache
2026-01-29 06:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 2157061f-feee-5a6b-8ecd-1824baae5db4
2026-01-29 06:00:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ffa8910>
2026-01-29 06:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_3.jpg HTTP/1.1" 201 0
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F52%252F1a5219605f0ba0d9d1b8a2d791b1d90f%252Fpa%252FMJ86885_9629db44f0d417888b097e8edb8ea66c.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_9629db44f0d417888b097e8edb8ea66c.jpg saved to cache
2026-01-29 06:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2157061f-feee-5a6b-8ecd-1824baae5db4
2026-01-29 06:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 723573d2-54ca-5b46-9891-b08194b3caf0 with identifier: GG31907
2026-01-29 06:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 723573d2-54ca-5b46-9891-b08194b3caf0 with scrape type 1
2026-01-29 06:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 723573d2-54ca-5b46-9891-b08194b3caf0
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc3%252Fa3c34fd558c85022b27578a89e14f350%252Fpa%252FGG31907_cee6d230b28eef72d345247009acabd3.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_cee6d230b28eef72d345247009acabd3.jpg not downloaded yet
2026-01-29 06:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49be7573-d487-5d42-ad63-5fa941b9a9db with identifier: CE88723
2026-01-29 06:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49be7573-d487-5d42-ad63-5fa941b9a9db with scrape type 2
2026-01-29 06:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49be7573-d487-5d42-ad63-5fa941b9a9db with scrape type 2
2026-01-29 06:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 49be7573-d487-5d42-ad63-5fa941b9a9db, identifier: CE88723
2026-01-29 06:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 003b4ab1-45b7-5fd6-804c-b72bc20afc24 with identifier: FK20372
2026-01-29 06:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 003b4ab1-45b7-5fd6-804c-b72bc20afc24 with scrape type 1
2026-01-29 06:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 003b4ab1-45b7-5fd6-804c-b72bc20afc24
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fa3%252F69a3ca5264c91412308607fa14a59748%252Fpa%252FFK20372_859ade7e831a82007eebbe0e21ff38d0.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_859ade7e831a82007eebbe0e21ff38d0.jpg not downloaded yet
2026-01-29 06:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_eb3ae2cca46f5441980df1d674301286.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd1%252Ff1d1a2e97d7c9518d5af363c281f6ee5%252Fpa%252FKW58357_2148422579898ec217e0d0bbf7895fdc.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_2148422579898ec217e0d0bbf7895fdc.jpg not downloaded yet
2026-01-29 06:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 49be7573-d487-5d42-ad63-5fa941b9a9db with identifier: CE88723
2026-01-29 06:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 49be7573-d487-5d42-ad63-5fa941b9a9db with identifier: CE88723
2026-01-29 06:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 49be7573-d487-5d42-ad63-5fa941b9a9db with identifier: CE88723 to the API
2026-01-29 06:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CE88723>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:27:43Z',
 'fuel_type': 'diesel',
 'id': '49be7573-d487-5d42-ad63-5fa941b9a9db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE88723',
 'listing': 'auction',
 'location': 'FR, Le Boulou',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 94815,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Active Business',
 'transmission': 'automatic',
 'trim': 'Active Business',
 'year': 2018}
2026-01-29 06:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CE88723%27 HTTP/1.1" 200 None
2026-01-29 06:00:48 [auto1.fr] INFO: Saving data for CE88723: {'auction_closing_time': 1769704063.0, 'created_time': 1768819255.96599, 'last_price_update_time': 1769666448.716865}
2026-01-29 06:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CE88723') HTTP/1.1" 204 0
2026-01-29 06:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_59c717bb3e73e2c881b9c097b5670a67.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc3%252Fa3c34fd558c85022b27578a89e14f350%252Fpa%252FGG31907_364195311ed170cac2f5c21584f128cb.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_364195311ed170cac2f5c21584f128cb.jpg not downloaded yet
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fa3%252F69a3ca5264c91412308607fa14a59748%252Fpa%252FFK20372_5af40c442df484a387ed1e6d22aa3815.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_5af40c442df484a387ed1e6d22aa3815.jpg not downloaded yet
2026-01-29 06:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_b359c5bfe962a5b3dee6c7485a4711ab.png> (referer: https://www.auto1.com/)
2026-01-29 06:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_4ac30f6dc26360cad0e18132b04b2244.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd1%252Ff1d1a2e97d7c9518d5af363c281f6ee5%252Fpa%252FKW58357_8431e4f322c7aa9f6d21ac67f7262dc3.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_8431e4f322c7aa9f6d21ac67f7262dc3.jpg not downloaded yet
2026-01-29 06:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JH35342> (referer: https://www.auto1.com/v1/car-details-view/JH35342/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GG58617> (referer: https://www.auto1.com/v1/car-details-view/GG58617/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WY33267> (referer: https://www.auto1.com/v1/car-details-view/WY33267/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff03510>
2026-01-29 06:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_11.jpg HTTP/1.1" 201 0
2026-01-29 06:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F52%252F1a5219605f0ba0d9d1b8a2d791b1d90f%252Fpa%252FMJ86885_a017f58076b8680971a3e3b44a1574f6.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_a017f58076b8680971a3e3b44a1574f6.jpg saved to cache
2026-01-29 06:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 2157061f-feee-5a6b-8ecd-1824baae5db4
2026-01-29 06:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97172644-6823-533e-aec1-54beb8e6e616 with identifier: PX67710
2026-01-29 06:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97172644-6823-533e-aec1-54beb8e6e616 with scrape type 1
2026-01-29 06:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 97172644-6823-533e-aec1-54beb8e6e616
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F1b%252F751bfe00f9e42b18e4b86d9e8399a4aa%252Fpa%252FPX67710_34c96a601a45167ce630f6d705bb7d85.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_34c96a601a45167ce630f6d705bb7d85.jpg not downloaded yet
2026-01-29 06:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ef36d74-e8ee-5736-8936-d2911663c290 with identifier: VN50741
2026-01-29 06:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ef36d74-e8ee-5736-8936-d2911663c290 with scrape type 1
2026-01-29 06:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 1ef36d74-e8ee-5736-8936-d2911663c290
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F61%252Ffd611d0434769392dd2879332ad0e2c0%252Fpa%252FVN50741_f4dc8d06eb89279f8ab2dae7847102aa.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_f4dc8d06eb89279f8ab2dae7847102aa.jpg already downloaded
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F61%252Ffd611d0434769392dd2879332ad0e2c0%252Fpa%252FVN50741_de01fc050ec5afb9d6e3d3e54ff6fcdf.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_de01fc050ec5afb9d6e3d3e54ff6fcdf.jpg already downloaded
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F61%252Ffd611d0434769392dd2879332ad0e2c0%252Fpa%252FVN50741_00c37b1a4e8c8ef01f7e00d5bb81ef05.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_00c37b1a4e8c8ef01f7e00d5bb81ef05.jpg already downloaded
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F61%252Ffd611d0434769392dd2879332ad0e2c0%252Fpa%252FVN50741_8fd5b0840defabe2ca5bea327c486364.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_8fd5b0840defabe2ca5bea327c486364.jpg already downloaded
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F61%252Ffd611d0434769392dd2879332ad0e2c0%252Fpa%252FVN50741_0c4683dd75370f5aaf109061b90a6014.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_0c4683dd75370f5aaf109061b90a6014.jpg already downloaded
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F61%252Ffd611d0434769392dd2879332ad0e2c0%252Fpa%252FVN50741_40f3b9a3eec33b3a225207849fba4b36.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_40f3b9a3eec33b3a225207849fba4b36.jpg already downloaded
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F61%252Ffd611d0434769392dd2879332ad0e2c0%252Fpa%252FVN50741_68eec63218b8c96d52e5d2d4c63b95a8.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_68eec63218b8c96d52e5d2d4c63b95a8.jpg already downloaded
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F61%252Ffd611d0434769392dd2879332ad0e2c0%252Fpa%252FVN50741_11a8b64b92e237f42af6fa7c657677da.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_11a8b64b92e237f42af6fa7c657677da.jpg already downloaded
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F61%252Ffd611d0434769392dd2879332ad0e2c0%252Fpa%252FVN50741_1f1a558dd31f163c670ce4a4fe4c4341.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_1f1a558dd31f163c670ce4a4fe4c4341.jpg already downloaded
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F61%252Ffd611d0434769392dd2879332ad0e2c0%252Fpa%252FVN50741_8a8cbb0efad17a0b7853b7839c6bc5e4.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_8a8cbb0efad17a0b7853b7839c6bc5e4.jpg already downloaded
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F61%252Ffd611d0434769392dd2879332ad0e2c0%252Fpa%252FVN50741_0648046186ae1c57484d194d1f7410e8.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_0648046186ae1c57484d194d1f7410e8.jpg already downloaded
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F61%252Ffd611d0434769392dd2879332ad0e2c0%252Fpa%252FVN50741_b544862e498e39c2d54dd1417caecfe8.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_b544862e498e39c2d54dd1417caecfe8.jpg already downloaded
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F61%252Ffd611d0434769392dd2879332ad0e2c0%252Fpa%252FVN50741_af8e78b503efa732b588138a12666dd6.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_af8e78b503efa732b588138a12666dd6.jpg already downloaded
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F61%252Ffd611d0434769392dd2879332ad0e2c0%252Fpa%252FVN50741_2150d622098e7f10d3caa57c3caece7d.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_2150d622098e7f10d3caa57c3caece7d.jpg already downloaded
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F61%252Ffd611d0434769392dd2879332ad0e2c0%252Fpa%252FVN50741_475c335ceb368558b7184e1905f5afd6.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_475c335ceb368558b7184e1905f5afd6.jpg already downloaded
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F61%252Ffd611d0434769392dd2879332ad0e2c0%252Fpa%252FVN50741_0cd3360303db9685c74e080c3152520e.png%27 HTTP/1.1" 200 None
2026-01-29 06:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_0cd3360303db9685c74e080c3152520e.png already downloaded
2026-01-29 06:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1ef36d74-e8ee-5736-8936-d2911663c290, identifier: VN50741
2026-01-29 06:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_e39a75c32f59498fdd11adfeaa2c3d82.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc3%252Fa3c34fd558c85022b27578a89e14f350%252Fpa%252FGG31907_6a9b48295fdf4945a92a87972b9afe0e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_6a9b48295fdf4945a92a87972b9afe0e.jpg not downloaded yet
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fa3%252F69a3ca5264c91412308607fa14a59748%252Fpa%252FFK20372_998ac03a5d7a79ca65c121f90416488e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_998ac03a5d7a79ca65c121f90416488e.jpg not downloaded yet
2026-01-29 06:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1ef36d74-e8ee-5736-8936-d2911663c290 with identifier: VN50741
2026-01-29 06:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1ef36d74-e8ee-5736-8936-d2911663c290 with identifier: VN50741
2026-01-29 06:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 166240 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    166240
2026-01-29 06:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 1ef36d74-e8ee-5736-8936-d2911663c290 spider: auto1.fr
2026-01-29 06:00:51 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 1ef36d74-e8ee-5736-8936-d2911663c290 due to rule: high_mileage_for_country.json, error: 166240 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    166240
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:36:53Z',
 'fuel_type': 'diesel',
 'id': '1ef36d74-e8ee-5736-8936-d2911663c290',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN50741',
 'listing': 'auction',
 'location': 'FR, Anais',
 'make': 'BMW',
 'model': '3er',
 'odometer': 166240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_f4dc8d06eb89279f8ab2dae7847102aa.jpg',
                'https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_de01fc050ec5afb9d6e3d3e54ff6fcdf.jpg',
                'https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_00c37b1a4e8c8ef01f7e00d5bb81ef05.jpg',
                'https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_8fd5b0840defabe2ca5bea327c486364.jpg',
                'https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_0c4683dd75370f5aaf109061b90a6014.jpg',
                'https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_40f3b9a3eec33b3a225207849fba4b36.jpg',
                'https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_68eec63218b8c96d52e5d2d4c63b95a8.jpg',
                'https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_11a8b64b92e237f42af6fa7c657677da.jpg',
                'https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_1f1a558dd31f163c670ce4a4fe4c4341.jpg',
                'https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_8a8cbb0efad17a0b7853b7839c6bc5e4.jpg',
                'https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_0648046186ae1c57484d194d1f7410e8.jpg',
                'https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_b544862e498e39c2d54dd1417caecfe8.jpg',
                'https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_af8e78b503efa732b588138a12666dd6.jpg',
                'https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_2150d622098e7f10d3caa57c3caece7d.jpg',
                'https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_475c335ceb368558b7184e1905f5afd6.jpg',
                'https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_0cd3360303db9685c74e080c3152520e.png'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ef36d74-e8ee-5736-8936-d2911663c290/1ef36d74-e8ee-5736-8936-d2911663c290_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69268,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_f4dc8d06eb89279f8ab2dae7847102aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ef36d74-e8ee-5736-8936-d2911663c290/1ef36d74-e8ee-5736-8936-d2911663c290_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71078,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_de01fc050ec5afb9d6e3d3e54ff6fcdf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ef36d74-e8ee-5736-8936-d2911663c290/1ef36d74-e8ee-5736-8936-d2911663c290_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_00c37b1a4e8c8ef01f7e00d5bb81ef05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ef36d74-e8ee-5736-8936-d2911663c290/1ef36d74-e8ee-5736-8936-d2911663c290_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_8fd5b0840defabe2ca5bea327c486364.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ef36d74-e8ee-5736-8936-d2911663c290/1ef36d74-e8ee-5736-8936-d2911663c290_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_0c4683dd75370f5aaf109061b90a6014.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ef36d74-e8ee-5736-8936-d2911663c290/1ef36d74-e8ee-5736-8936-d2911663c290_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_40f3b9a3eec33b3a225207849fba4b36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ef36d74-e8ee-5736-8936-d2911663c290/1ef36d74-e8ee-5736-8936-d2911663c290_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_68eec63218b8c96d52e5d2d4c63b95a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ef36d74-e8ee-5736-8936-d2911663c290/1ef36d74-e8ee-5736-8936-d2911663c290_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_11a8b64b92e237f42af6fa7c657677da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ef36d74-e8ee-5736-8936-d2911663c290/1ef36d74-e8ee-5736-8936-d2911663c290_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_1f1a558dd31f163c670ce4a4fe4c4341.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ef36d74-e8ee-5736-8936-d2911663c290/1ef36d74-e8ee-5736-8936-d2911663c290_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81515,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_8a8cbb0efad17a0b7853b7839c6bc5e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ef36d74-e8ee-5736-8936-d2911663c290/1ef36d74-e8ee-5736-8936-d2911663c290_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72121,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_0648046186ae1c57484d194d1f7410e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ef36d74-e8ee-5736-8936-d2911663c290/1ef36d74-e8ee-5736-8936-d2911663c290_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_b544862e498e39c2d54dd1417caecfe8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ef36d74-e8ee-5736-8936-d2911663c290/1ef36d74-e8ee-5736-8936-d2911663c290_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62155,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_af8e78b503efa732b588138a12666dd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ef36d74-e8ee-5736-8936-d2911663c290/1ef36d74-e8ee-5736-8936-d2911663c290_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2809167,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_2150d622098e7f10d3caa57c3caece7d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ef36d74-e8ee-5736-8936-d2911663c290/1ef36d74-e8ee-5736-8936-d2911663c290_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_475c335ceb368558b7184e1905f5afd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ef36d74-e8ee-5736-8936-d2911663c290/1ef36d74-e8ee-5736-8936-d2911663c290_image_15.png',
             'Extension': 'png',
             'FileSizeInBytes': 105516,
             'Height': 525,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/61/fd611d0434769392dd2879332ad0e2c0/pa/VN50741_0cd3360303db9685c74e080c3152520e.png',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320d GT M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN50741%27 HTTP/1.1" 200 None
2026-01-29 06:00:51 [auto1.fr] INFO: Saving data for VN50741: {'created_time': 1769666451.185456, 'last_price_update_time': 1769666451.18547, 'auction_closing_time': 1769704613.0}
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VN50741') HTTP/1.1" 204 0
2026-01-29 06:00:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f50fd90>
2026-01-29 06:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_10.jpg HTTP/1.1" 201 0
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F52%252F1a5219605f0ba0d9d1b8a2d791b1d90f%252Fpa%252FMJ86885_eb3ae2cca46f5441980df1d674301286.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_eb3ae2cca46f5441980df1d674301286.jpg saved to cache
2026-01-29 06:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 2157061f-feee-5a6b-8ecd-1824baae5db4
2026-01-29 06:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_f8aed69519ab8bb10c84c5484d49588c.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd1%252Ff1d1a2e97d7c9518d5af363c281f6ee5%252Fpa%252FKW58357_756773cf9dc2b3f904b6cbb9fdb5a2d9.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_756773cf9dc2b3f904b6cbb9fdb5a2d9.jpg not downloaded yet
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F1b%252F751bfe00f9e42b18e4b86d9e8399a4aa%252Fpa%252FPX67710_54f34a24a9afb79ac20dc6733da76e2b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_54f34a24a9afb79ac20dc6733da76e2b.jpg not downloaded yet
2026-01-29 06:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JJ40715> (referer: https://www.auto1.com/v1/car-details-view/JJ40715/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LF63766> (referer: https://www.auto1.com/v1/car-details-view/LF63766/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UK05835> (referer: https://www.auto1.com/v1/car-details-view/UK05835/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f5b1150>
2026-01-29 06:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_13.jpg HTTP/1.1" 201 0
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F52%252F1a5219605f0ba0d9d1b8a2d791b1d90f%252Fpa%252FMJ86885_59c717bb3e73e2c881b9c097b5670a67.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_59c717bb3e73e2c881b9c097b5670a67.jpg saved to cache
2026-01-29 06:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 2157061f-feee-5a6b-8ecd-1824baae5db4
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc3%252Fa3c34fd558c85022b27578a89e14f350%252Fpa%252FGG31907_960bda8c0335650dd9a0565cc43411ee.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_960bda8c0335650dd9a0565cc43411ee.jpg not downloaded yet
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fa3%252F69a3ca5264c91412308607fa14a59748%252Fpa%252FFK20372_bbf5ef85f9c3feb0f461975f833db6c8.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_bbf5ef85f9c3feb0f461975f833db6c8.jpg not downloaded yet
2026-01-29 06:00:52 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-01-29 06:00:52 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2026-01-29 06:00:52 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2026-01-29 06:00:52 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f40e8d0>
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_15.png HTTP/1.1" 201 0
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F52%252F1a5219605f0ba0d9d1b8a2d791b1d90f%252Fpa%252FMJ86885_b359c5bfe962a5b3dee6c7485a4711ab.png') HTTP/1.1" 204 0
2026-01-29 06:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_b359c5bfe962a5b3dee6c7485a4711ab.png saved to cache
2026-01-29 06:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 2157061f-feee-5a6b-8ecd-1824baae5db4
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f420c90>
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_14.jpg HTTP/1.1" 201 0
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F52%252F1a5219605f0ba0d9d1b8a2d791b1d90f%252Fpa%252FMJ86885_4ac30f6dc26360cad0e18132b04b2244.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_4ac30f6dc26360cad0e18132b04b2244.jpg saved to cache
2026-01-29 06:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 2157061f-feee-5a6b-8ecd-1824baae5db4
2026-01-29 06:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6382bce1-d32a-58ca-a715-2b2c7396dced with identifier: JH35342
2026-01-29 06:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6382bce1-d32a-58ca-a715-2b2c7396dced with scrape type 1
2026-01-29 06:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 6382bce1-d32a-58ca-a715-2b2c7396dced
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F93%252F9193e2d11d92bc64be9f8551fdcc6320%252Fpa%252FJH35342_be6ac4e6a52f25b204b7b11a0f8b284d.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_be6ac4e6a52f25b204b7b11a0f8b284d.jpg not downloaded yet
2026-01-29 06:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21109bf0-d0d8-539a-9de1-ceab88a402cf with identifier: GG58617
2026-01-29 06:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21109bf0-d0d8-539a-9de1-ceab88a402cf with scrape type 1
2026-01-29 06:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 21109bf0-d0d8-539a-9de1-ceab88a402cf
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F3d%252Fc83d4b60e21886deefd9794ad0b0cda8%252Fpa%252FGG58617_09e6faaa31087640e673304d135b0a24.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_09e6faaa31087640e673304d135b0a24.jpg not downloaded yet
2026-01-29 06:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1b9ec78-3bee-57c9-93cc-1d3106547e72 with identifier: WY33267
2026-01-29 06:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1b9ec78-3bee-57c9-93cc-1d3106547e72 with scrape type 1
2026-01-29 06:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item b1b9ec78-3bee-57c9-93cc-1d3106547e72
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe7%252Fcce79ac9da1faa0dc17b3660af524ec4%252Fpa%252FWY33267_9675191b70b5c3414f45cfd7aba4b85a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_9675191b70b5c3414f45cfd7aba4b85a.jpg already downloaded
2026-01-29 06:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe7%252Fcce79ac9da1faa0dc17b3660af524ec4%252Fpa%252FWY33267_00342108063d429387d1f742639feb04.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_00342108063d429387d1f742639feb04.jpg already downloaded
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe7%252Fcce79ac9da1faa0dc17b3660af524ec4%252Fpa%252FWY33267_1cbbeecca8bb398dcc1f6af133369d07.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_1cbbeecca8bb398dcc1f6af133369d07.jpg already downloaded
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe7%252Fcce79ac9da1faa0dc17b3660af524ec4%252Fpa%252FWY33267_f533eb77fa525b6ec7069be3b34f37fb.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_f533eb77fa525b6ec7069be3b34f37fb.jpg already downloaded
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe7%252Fcce79ac9da1faa0dc17b3660af524ec4%252Fpa%252FWY33267_3a5e1886c74c03c6b96609da142cf71b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_3a5e1886c74c03c6b96609da142cf71b.jpg already downloaded
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe7%252Fcce79ac9da1faa0dc17b3660af524ec4%252Fpa%252FWY33267_15d3d42ee56df3a85780a31cad11a300.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_15d3d42ee56df3a85780a31cad11a300.jpg already downloaded
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe7%252Fcce79ac9da1faa0dc17b3660af524ec4%252Fpa%252FWY33267_8c6c8170d6217eba4ff1685e8b8b6f27.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_8c6c8170d6217eba4ff1685e8b8b6f27.jpg already downloaded
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe7%252Fcce79ac9da1faa0dc17b3660af524ec4%252Fpa%252FWY33267_78e4f1b1bce808e0808f1d0a57c77f77.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_78e4f1b1bce808e0808f1d0a57c77f77.jpg already downloaded
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe7%252Fcce79ac9da1faa0dc17b3660af524ec4%252Fpa%252FWY33267_c95656a4bf3b8ded3f8cf2d48ea5ad19.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_c95656a4bf3b8ded3f8cf2d48ea5ad19.jpg already downloaded
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe7%252Fcce79ac9da1faa0dc17b3660af524ec4%252Fpa%252FWY33267_674e1a026aedb3f47d2763acb8cc242b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_674e1a026aedb3f47d2763acb8cc242b.jpg already downloaded
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe7%252Fcce79ac9da1faa0dc17b3660af524ec4%252Fpa%252FWY33267_5da69b222f13b2226e288c90baedb148.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_5da69b222f13b2226e288c90baedb148.jpg already downloaded
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe7%252Fcce79ac9da1faa0dc17b3660af524ec4%252Fpa%252FWY33267_72a9524d03fadfedd1b130d379671165.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_72a9524d03fadfedd1b130d379671165.jpg already downloaded
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe7%252Fcce79ac9da1faa0dc17b3660af524ec4%252Fpa%252FWY33267_d30143427225b7a0784b9e305929081f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_d30143427225b7a0784b9e305929081f.jpg already downloaded
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe7%252Fcce79ac9da1faa0dc17b3660af524ec4%252Fpa%252FWY33267_449236c3abf65869d85bbe6facd8115a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_449236c3abf65869d85bbe6facd8115a.jpg already downloaded
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe7%252Fcce79ac9da1faa0dc17b3660af524ec4%252Fpa%252FWY33267_c42bb9ea78eea8ab4d9f9a322b4eb69c.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_c42bb9ea78eea8ab4d9f9a322b4eb69c.jpg already downloaded
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fe7%252Fcce79ac9da1faa0dc17b3660af524ec4%252Fpa%252FWY33267_d41f3390cb426b9298b9f27df459b437.png%27 HTTP/1.1" 200 None
2026-01-29 06:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_d41f3390cb426b9298b9f27df459b437.png already downloaded
2026-01-29 06:00:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b1b9ec78-3bee-57c9-93cc-1d3106547e72, identifier: WY33267
2026-01-29 06:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_2148422579898ec217e0d0bbf7895fdc.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd1%252Ff1d1a2e97d7c9518d5af363c281f6ee5%252Fpa%252FKW58357_d63cab32dfe4bccb6f6fe4ab81d87749.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_d63cab32dfe4bccb6f6fe4ab81d87749.jpg not downloaded yet
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F1b%252F751bfe00f9e42b18e4b86d9e8399a4aa%252Fpa%252FPX67710_569d23f2b73ce81acc6d1bc12be6ab4a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_569d23f2b73ce81acc6d1bc12be6ab4a.jpg not downloaded yet
2026-01-29 06:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b1b9ec78-3bee-57c9-93cc-1d3106547e72 with identifier: WY33267
2026-01-29 06:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b1b9ec78-3bee-57c9-93cc-1d3106547e72 with identifier: WY33267
2026-01-29 06:00:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b1b9ec78-3bee-57c9-93cc-1d3106547e72 with identifier: WY33267 to the API
2026-01-29 06:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:00:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WY33267>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:42:40Z',
 'fuel_type': 'petrol',
 'id': 'b1b9ec78-3bee-57c9-93cc-1d3106547e72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY33267',
 'listing': 'auction',
 'location': 'FR, Marly-la-ville',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 38489,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_9675191b70b5c3414f45cfd7aba4b85a.jpg',
                'https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_00342108063d429387d1f742639feb04.jpg',
                'https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_1cbbeecca8bb398dcc1f6af133369d07.jpg',
                'https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_f533eb77fa525b6ec7069be3b34f37fb.jpg',
                'https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_3a5e1886c74c03c6b96609da142cf71b.jpg',
                'https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_15d3d42ee56df3a85780a31cad11a300.jpg',
                'https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_8c6c8170d6217eba4ff1685e8b8b6f27.jpg',
                'https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_78e4f1b1bce808e0808f1d0a57c77f77.jpg',
                'https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_c95656a4bf3b8ded3f8cf2d48ea5ad19.jpg',
                'https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_674e1a026aedb3f47d2763acb8cc242b.jpg',
                'https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_5da69b222f13b2226e288c90baedb148.jpg',
                'https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_72a9524d03fadfedd1b130d379671165.jpg',
                'https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_d30143427225b7a0784b9e305929081f.jpg',
                'https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_449236c3abf65869d85bbe6facd8115a.jpg',
                'https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_c42bb9ea78eea8ab4d9f9a322b4eb69c.jpg',
                'https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_d41f3390cb426b9298b9f27df459b437.png'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b9ec78-3bee-57c9-93cc-1d3106547e72/b1b9ec78-3bee-57c9-93cc-1d3106547e72_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_9675191b70b5c3414f45cfd7aba4b85a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b9ec78-3bee-57c9-93cc-1d3106547e72/b1b9ec78-3bee-57c9-93cc-1d3106547e72_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_00342108063d429387d1f742639feb04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b9ec78-3bee-57c9-93cc-1d3106547e72/b1b9ec78-3bee-57c9-93cc-1d3106547e72_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61537,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_1cbbeecca8bb398dcc1f6af133369d07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b9ec78-3bee-57c9-93cc-1d3106547e72/b1b9ec78-3bee-57c9-93cc-1d3106547e72_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_f533eb77fa525b6ec7069be3b34f37fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b9ec78-3bee-57c9-93cc-1d3106547e72/b1b9ec78-3bee-57c9-93cc-1d3106547e72_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2428092,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_3a5e1886c74c03c6b96609da142cf71b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b9ec78-3bee-57c9-93cc-1d3106547e72/b1b9ec78-3bee-57c9-93cc-1d3106547e72_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2468561,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_15d3d42ee56df3a85780a31cad11a300.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b9ec78-3bee-57c9-93cc-1d3106547e72/b1b9ec78-3bee-57c9-93cc-1d3106547e72_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_8c6c8170d6217eba4ff1685e8b8b6f27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b9ec78-3bee-57c9-93cc-1d3106547e72/b1b9ec78-3bee-57c9-93cc-1d3106547e72_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_78e4f1b1bce808e0808f1d0a57c77f77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b9ec78-3bee-57c9-93cc-1d3106547e72/b1b9ec78-3bee-57c9-93cc-1d3106547e72_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_c95656a4bf3b8ded3f8cf2d48ea5ad19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b9ec78-3bee-57c9-93cc-1d3106547e72/b1b9ec78-3bee-57c9-93cc-1d3106547e72_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_674e1a026aedb3f47d2763acb8cc242b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b9ec78-3bee-57c9-93cc-1d3106547e72/b1b9ec78-3bee-57c9-93cc-1d3106547e72_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_5da69b222f13b2226e288c90baedb148.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b9ec78-3bee-57c9-93cc-1d3106547e72/b1b9ec78-3bee-57c9-93cc-1d3106547e72_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_72a9524d03fadfedd1b130d379671165.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b9ec78-3bee-57c9-93cc-1d3106547e72/b1b9ec78-3bee-57c9-93cc-1d3106547e72_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_d30143427225b7a0784b9e305929081f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b9ec78-3bee-57c9-93cc-1d3106547e72/b1b9ec78-3bee-57c9-93cc-1d3106547e72_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_449236c3abf65869d85bbe6facd8115a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b9ec78-3bee-57c9-93cc-1d3106547e72/b1b9ec78-3bee-57c9-93cc-1d3106547e72_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_c42bb9ea78eea8ab4d9f9a322b4eb69c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b9ec78-3bee-57c9-93cc-1d3106547e72/b1b9ec78-3bee-57c9-93cc-1d3106547e72_image_15.png',
             'Extension': 'png',
             'FileSizeInBytes': 76634,
             'Height': 525,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/e7/cce79ac9da1faa0dc17b3660af524ec4/pa/WY33267_d41f3390cb426b9298b9f27df459b437.png',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-08-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2023}
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WY33267%27 HTTP/1.1" 200 None
2026-01-29 06:00:54 [auto1.fr] INFO: Saving data for WY33267: {'created_time': 1769666454.635407, 'last_price_update_time': 1769666454.635418, 'auction_closing_time': 1769704960.0}
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WY33267') HTTP/1.1" 204 0
2026-01-29 06:00:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f47ba50>
2026-01-29 06:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c9707d0-c65d-56d5-9437-42b8754a3918/4c9707d0-c65d-56d5-9437-42b8754a3918_image_0.jpg HTTP/1.1" 201 0
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd1%252Ff1d1a2e97d7c9518d5af363c281f6ee5%252Fpa%252FKW58357_e39a75c32f59498fdd11adfeaa2c3d82.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_e39a75c32f59498fdd11adfeaa2c3d82.jpg saved to cache
2026-01-29 06:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c9707d0-c65d-56d5-9437-42b8754a3918
2026-01-29 06:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_cee6d230b28eef72d345247009acabd3.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc3%252Fa3c34fd558c85022b27578a89e14f350%252Fpa%252FGG31907_28a1e3efc06052584b87dbf11f04d637.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_28a1e3efc06052584b87dbf11f04d637.jpg not downloaded yet
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fa3%252F69a3ca5264c91412308607fa14a59748%252Fpa%252FFK20372_2d8c239d5300fb8ce73a22f68ac01d4d.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_2d8c239d5300fb8ce73a22f68ac01d4d.jpg not downloaded yet
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F93%252F9193e2d11d92bc64be9f8551fdcc6320%252Fpa%252FJH35342_600dacc4e99d09d09bdc10c299381ce0.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_600dacc4e99d09d09bdc10c299381ce0.jpg not downloaded yet
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F3d%252Fc83d4b60e21886deefd9794ad0b0cda8%252Fpa%252FGG58617_9b2eecd84b9da523084805bff8eb5c17.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_9b2eecd84b9da523084805bff8eb5c17.jpg not downloaded yet
2026-01-29 06:00:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f44cd10>
2026-01-29 06:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c9707d0-c65d-56d5-9437-42b8754a3918/4c9707d0-c65d-56d5-9437-42b8754a3918_image_1.jpg HTTP/1.1" 201 0
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd1%252Ff1d1a2e97d7c9518d5af363c281f6ee5%252Fpa%252FKW58357_f8aed69519ab8bb10c84c5484d49588c.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_f8aed69519ab8bb10c84c5484d49588c.jpg saved to cache
2026-01-29 06:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c9707d0-c65d-56d5-9437-42b8754a3918
2026-01-29 06:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d10e014-0d08-5baa-9ecc-8088fb8db0fa with identifier: JJ40715
2026-01-29 06:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d10e014-0d08-5baa-9ecc-8088fb8db0fa with scrape type 1
2026-01-29 06:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 3d10e014-0d08-5baa-9ecc-8088fb8db0fa
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F14%252Fd91448ba963fc26723e66005f13ffbe0%252Fpa%252FJJ40715_abfa7801a812d68707e6d040c0bcb6c4.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_abfa7801a812d68707e6d040c0bcb6c4.jpg not downloaded yet
2026-01-29 06:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c1f0cdf-acc4-5f57-a8d7-27947424a965 with identifier: LF63766
2026-01-29 06:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c1f0cdf-acc4-5f57-a8d7-27947424a965 with scrape type 1
2026-01-29 06:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 7c1f0cdf-acc4-5f57-a8d7-27947424a965
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fb7%252F9ab73453bdadf759dcc0e6cd3396ec6b%252Fpa%252FLF63766_5b5fd765c5f95e668fb03891f0c2a437.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_5b5fd765c5f95e668fb03891f0c2a437.jpg already downloaded
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fb7%252F9ab73453bdadf759dcc0e6cd3396ec6b%252Fpa%252FLF63766_4a5f3ab6953bfa07bbe854c262487db5.png%27 HTTP/1.1" 200 None
2026-01-29 06:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_4a5f3ab6953bfa07bbe854c262487db5.png already downloaded
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fb7%252F9ab73453bdadf759dcc0e6cd3396ec6b%252Fpa%252FLF63766_04068e315d8e37ee4abfd5ce4d7afb6c.png%27 HTTP/1.1" 200 None
2026-01-29 06:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_04068e315d8e37ee4abfd5ce4d7afb6c.png already downloaded
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fb7%252F9ab73453bdadf759dcc0e6cd3396ec6b%252Fpa%252FLF63766_b78d9d4823ce67bb1ab151727d04b190.png%27 HTTP/1.1" 200 None
2026-01-29 06:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_b78d9d4823ce67bb1ab151727d04b190.png already downloaded
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fb7%252F9ab73453bdadf759dcc0e6cd3396ec6b%252Fpa%252FLF63766_68b03ae3053b0f3c5e4c911bc345308e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_68b03ae3053b0f3c5e4c911bc345308e.jpg already downloaded
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fb7%252F9ab73453bdadf759dcc0e6cd3396ec6b%252Fpa%252FLF63766_847d8630c1352022555f39088db341d5.png%27 HTTP/1.1" 200 None
2026-01-29 06:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_847d8630c1352022555f39088db341d5.png already downloaded
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fb7%252F9ab73453bdadf759dcc0e6cd3396ec6b%252Fpa%252FLF63766_0589b0b6b7cea37ad5c9afc908a956f2.png%27 HTTP/1.1" 200 None
2026-01-29 06:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_0589b0b6b7cea37ad5c9afc908a956f2.png already downloaded
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fb7%252F9ab73453bdadf759dcc0e6cd3396ec6b%252Fpa%252FLF63766_3db0395a4d1dee517369fbbe89460037.png%27 HTTP/1.1" 200 None
2026-01-29 06:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_3db0395a4d1dee517369fbbe89460037.png already downloaded
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fb7%252F9ab73453bdadf759dcc0e6cd3396ec6b%252Fpa%252FLF63766_183e437809aa17ef8e67df15867b7e29.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_183e437809aa17ef8e67df15867b7e29.jpg already downloaded
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fb7%252F9ab73453bdadf759dcc0e6cd3396ec6b%252Fpa%252FLF63766_99506f2610d6f987809f3523a4a49c74.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_99506f2610d6f987809f3523a4a49c74.jpg already downloaded
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fb7%252F9ab73453bdadf759dcc0e6cd3396ec6b%252Fpa%252FLF63766_a043a997bc63033578e9eee393cee094.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_a043a997bc63033578e9eee393cee094.jpg already downloaded
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fb7%252F9ab73453bdadf759dcc0e6cd3396ec6b%252Fpa%252FLF63766_57622ec1820cf2f67a38517aff3d18e4.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_57622ec1820cf2f67a38517aff3d18e4.jpg already downloaded
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fb7%252F9ab73453bdadf759dcc0e6cd3396ec6b%252Fpa%252FLF63766_d6b48009cdf3118fbf1aaae8ceb83cc7.png%27 HTTP/1.1" 200 None
2026-01-29 06:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_d6b48009cdf3118fbf1aaae8ceb83cc7.png already downloaded
2026-01-29 06:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7c1f0cdf-acc4-5f57-a8d7-27947424a965, identifier: LF63766
2026-01-29 06:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7615995-fff6-5c06-bd1c-d32e57dc1b4a with identifier: UK05835
2026-01-29 06:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7615995-fff6-5c06-bd1c-d32e57dc1b4a with scrape type 2
2026-01-29 06:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7615995-fff6-5c06-bd1c-d32e57dc1b4a with scrape type 2
2026-01-29 06:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e7615995-fff6-5c06-bd1c-d32e57dc1b4a, identifier: UK05835
2026-01-29 06:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_c393c8d6b05ec3391ee2042774cc2d2c.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_364195311ed170cac2f5c21584f128cb.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd1%252Ff1d1a2e97d7c9518d5af363c281f6ee5%252Fpa%252FKW58357_56662fe4bde51420fd332ea507e6deb8.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_56662fe4bde51420fd332ea507e6deb8.jpg not downloaded yet
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F1b%252F751bfe00f9e42b18e4b86d9e8399a4aa%252Fpa%252FPX67710_5b031116530c6b6572cb021f420560f2.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_5b031116530c6b6572cb021f420560f2.jpg not downloaded yet
2026-01-29 06:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FL57020> (referer: https://www.auto1.com/v1/car-details-view/FL57020/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7c1f0cdf-acc4-5f57-a8d7-27947424a965 with identifier: LF63766
2026-01-29 06:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7c1f0cdf-acc4-5f57-a8d7-27947424a965 with identifier: LF63766
2026-01-29 06:00:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7c1f0cdf-acc4-5f57-a8d7-27947424a965 with identifier: LF63766 to the API
2026-01-29 06:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LF63766>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 201,
 'expiration_date': '2026-01-29T16:26:47Z',
 'fuel_type': 'diesel',
 'id': '7c1f0cdf-acc4-5f57-a8d7-27947424a965',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF63766',
 'listing': 'auction',
 'location': 'FR, Fos sur Mer',
 'make': 'BMW',
 'model': '5er',
 'odometer': 96883,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 13,
 'photo_urls': ['https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_5b5fd765c5f95e668fb03891f0c2a437.jpg',
                'https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_4a5f3ab6953bfa07bbe854c262487db5.png',
                'https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_04068e315d8e37ee4abfd5ce4d7afb6c.png',
                'https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_b78d9d4823ce67bb1ab151727d04b190.png',
                'https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_68b03ae3053b0f3c5e4c911bc345308e.jpg',
                'https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_847d8630c1352022555f39088db341d5.png',
                'https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_0589b0b6b7cea37ad5c9afc908a956f2.png',
                'https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_3db0395a4d1dee517369fbbe89460037.png',
                'https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_183e437809aa17ef8e67df15867b7e29.jpg',
                'https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_99506f2610d6f987809f3523a4a49c74.jpg',
                'https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_a043a997bc63033578e9eee393cee094.jpg',
                'https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_57622ec1820cf2f67a38517aff3d18e4.jpg',
                'https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_d6b48009cdf3118fbf1aaae8ceb83cc7.png'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c1f0cdf-acc4-5f57-a8d7-27947424a965/7c1f0cdf-acc4-5f57-a8d7-27947424a965_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_5b5fd765c5f95e668fb03891f0c2a437.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c1f0cdf-acc4-5f57-a8d7-27947424a965/7c1f0cdf-acc4-5f57-a8d7-27947424a965_image_1.png',
             'Extension': 'png',
             'FileSizeInBytes': 194928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_4a5f3ab6953bfa07bbe854c262487db5.png',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c1f0cdf-acc4-5f57-a8d7-27947424a965/7c1f0cdf-acc4-5f57-a8d7-27947424a965_image_2.png',
             'Extension': 'png',
             'FileSizeInBytes': 194928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_04068e315d8e37ee4abfd5ce4d7afb6c.png',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c1f0cdf-acc4-5f57-a8d7-27947424a965/7c1f0cdf-acc4-5f57-a8d7-27947424a965_image_3.png',
             'Extension': 'png',
             'FileSizeInBytes': 194928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_b78d9d4823ce67bb1ab151727d04b190.png',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c1f0cdf-acc4-5f57-a8d7-27947424a965/7c1f0cdf-acc4-5f57-a8d7-27947424a965_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_68b03ae3053b0f3c5e4c911bc345308e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c1f0cdf-acc4-5f57-a8d7-27947424a965/7c1f0cdf-acc4-5f57-a8d7-27947424a965_image_5.png',
             'Extension': 'png',
             'FileSizeInBytes': 194928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_847d8630c1352022555f39088db341d5.png',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c1f0cdf-acc4-5f57-a8d7-27947424a965/7c1f0cdf-acc4-5f57-a8d7-27947424a965_image_6.png',
             'Extension': 'png',
             'FileSizeInBytes': 194928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_0589b0b6b7cea37ad5c9afc908a956f2.png',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c1f0cdf-acc4-5f57-a8d7-27947424a965/7c1f0cdf-acc4-5f57-a8d7-27947424a965_image_7.png',
             'Extension': 'png',
             'FileSizeInBytes': 194928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_3db0395a4d1dee517369fbbe89460037.png',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c1f0cdf-acc4-5f57-a8d7-27947424a965/7c1f0cdf-acc4-5f57-a8d7-27947424a965_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_183e437809aa17ef8e67df15867b7e29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c1f0cdf-acc4-5f57-a8d7-27947424a965/7c1f0cdf-acc4-5f57-a8d7-27947424a965_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_99506f2610d6f987809f3523a4a49c74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c1f0cdf-acc4-5f57-a8d7-27947424a965/7c1f0cdf-acc4-5f57-a8d7-27947424a965_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67976,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_a043a997bc63033578e9eee393cee094.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c1f0cdf-acc4-5f57-a8d7-27947424a965/7c1f0cdf-acc4-5f57-a8d7-27947424a965_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_57622ec1820cf2f67a38517aff3d18e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c1f0cdf-acc4-5f57-a8d7-27947424a965/7c1f0cdf-acc4-5f57-a8d7-27947424a965_image_12.png',
             'Extension': 'png',
             'FileSizeInBytes': 194928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/b7/9ab73453bdadf759dcc0e6cd3396ec6b/pa/LF63766_d6b48009cdf3118fbf1aaae8ceb83cc7.png',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 520d xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2023}
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LF63766%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.fr] INFO: Saving data for LF63766: {'created_time': 1769666457.172243, 'last_price_update_time': 1769666457.172256, 'auction_closing_time': 1769704007.0}
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LF63766') HTTP/1.1" 204 0
2026-01-29 06:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e7615995-fff6-5c06-bd1c-d32e57dc1b4a with identifier: UK05835
2026-01-29 06:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e7615995-fff6-5c06-bd1c-d32e57dc1b4a with identifier: UK05835
2026-01-29 06:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 5008 1.2 puretech active business', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '5008', 'transmission': 'manual', 'odometer': 58931, 'odometer_reading_unit': 'km', 'registration_date': '2021-04-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uk05835', 'expiration_date': '2026-01-29t16:02:13z', 'origin_country_code': 'fr', 'trim': 'active business', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 7, 'c_o_2_emission_value': 144, 'id': 'e7615995-fff6-5c06-bd1c-d32e57dc1b4a', 'current_year_diff': 5, 'age_in_months': 57, 'make_model': 'peugeot 5008', 'sanitized_make': 'peugeot', 'odometer_in_km': 58931}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 57,
     'auction_title': '',
     'c_o_2_emission_value': 144,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:02:13z',
     'fuel_type': 'petrol',
     'id': 'e7615995-fff6-5c06-bd1c-d32e57dc1b4a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uk05835',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'peugeot',
     'make_model': 'peugeot 5008',
     'model': '5008',
     'odometer': 58931,
     'odometer_in_km': 58931,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-04-27',
     'sanitized_make': 'peugeot',
     'seats_number': 7,
     'seller_name': None,
     'title': 'peugeot 5008 1.2 puretech active business',
     'transmission': 'manual',
     'trim': 'active business',
     'year': 2021}
2026-01-29 06:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: e7615995-fff6-5c06-bd1c-d32e57dc1b4a spider: auto1.fr
2026-01-29 06:00:57 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: e7615995-fff6-5c06-bd1c-d32e57dc1b4a due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 5008 1.2 puretech active business', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '5008', 'transmission': 'manual', 'odometer': 58931, 'odometer_reading_unit': 'km', 'registration_date': '2021-04-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uk05835', 'expiration_date': '2026-01-29t16:02:13z', 'origin_country_code': 'fr', 'trim': 'active business', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 7, 'c_o_2_emission_value': 144, 'id': 'e7615995-fff6-5c06-bd1c-d32e57dc1b4a', 'current_year_diff': 5, 'age_in_months': 57, 'make_model': 'peugeot 5008', 'sanitized_make': 'peugeot', 'odometer_in_km': 58931}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 57,
     'auction_title': '',
     'c_o_2_emission_value': 144,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:02:13z',
     'fuel_type': 'petrol',
     'id': 'e7615995-fff6-5c06-bd1c-d32e57dc1b4a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uk05835',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'peugeot',
     'make_model': 'peugeot 5008',
     'model': '5008',
     'odometer': 58931,
     'odometer_in_km': 58931,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-04-27',
     'sanitized_make': 'peugeot',
     'seats_number': 7,
     'seller_name': None,
     'title': 'peugeot 5008 1.2 puretech active business',
     'transmission': 'manual',
     'trim': 'active business',
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:02:13Z',
 'fuel_type': 'petrol',
 'id': 'e7615995-fff6-5c06-bd1c-d32e57dc1b4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK05835',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 58931,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-27',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 1.2 PureTech Active Business',
 'transmission': 'manual',
 'trim': 'Active Business',
 'year': 2021}
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UK05835%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [auto1.fr] INFO: Saving data for UK05835: {'auction_closing_time': 1769702533.0, 'created_time': 1768413235.330899, 'last_price_update_time': 1769666457.503296}
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UK05835') HTTP/1.1" 204 0
2026-01-29 06:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_3c36ea22b86aa26a2cbbdc6db5e39a98.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc3%252Fa3c34fd558c85022b27578a89e14f350%252Fpa%252FGG31907_2381108fdb04fd8ee0d4e97104e963b1.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_2381108fdb04fd8ee0d4e97104e963b1.jpg not downloaded yet
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fa3%252F69a3ca5264c91412308607fa14a59748%252Fpa%252FFK20372_e9cda09f92ac169372c962eb9cec6a19.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_e9cda09f92ac169372c962eb9cec6a19.jpg not downloaded yet
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F93%252F9193e2d11d92bc64be9f8551fdcc6320%252Fpa%252FJH35342_23a640fe5c95fa9b1b44e6b98013ab41.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_23a640fe5c95fa9b1b44e6b98013ab41.jpg not downloaded yet
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F3d%252Fc83d4b60e21886deefd9794ad0b0cda8%252Fpa%252FGG58617_26cf72d8ed1936fadca78f4707eda274.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_26cf72d8ed1936fadca78f4707eda274.jpg not downloaded yet
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F14%252Fd91448ba963fc26723e66005f13ffbe0%252Fpa%252FJJ40715_159b4a6f55cccd0f249134017817bcdd.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_159b4a6f55cccd0f249134017817bcdd.jpg not downloaded yet
2026-01-29 06:00:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f44ea50>
2026-01-29 06:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c9707d0-c65d-56d5-9437-42b8754a3918/4c9707d0-c65d-56d5-9437-42b8754a3918_image_2.jpg HTTP/1.1" 201 0
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd1%252Ff1d1a2e97d7c9518d5af363c281f6ee5%252Fpa%252FKW58357_2148422579898ec217e0d0bbf7895fdc.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_2148422579898ec217e0d0bbf7895fdc.jpg saved to cache
2026-01-29 06:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c9707d0-c65d-56d5-9437-42b8754a3918
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd1%252Ff1d1a2e97d7c9518d5af363c281f6ee5%252Fpa%252FKW58357_3691dce4658b1cf8221bbe1f07199a9f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_3691dce4658b1cf8221bbe1f07199a9f.jpg not downloaded yet
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F1b%252F751bfe00f9e42b18e4b86d9e8399a4aa%252Fpa%252FPX67710_97d23059de077e3af2898c16db666e7b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_97d23059de077e3af2898c16db666e7b.jpg not downloaded yet
2026-01-29 06:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BT80701> (referer: https://www.auto1.com/v1/car-details-view/BT80701/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:00:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6fe61e10>
2026-01-29 06:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_0.jpg HTTP/1.1" 201 0
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc3%252Fa3c34fd558c85022b27578a89e14f350%252Fpa%252FGG31907_cee6d230b28eef72d345247009acabd3.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_cee6d230b28eef72d345247009acabd3.jpg saved to cache
2026-01-29 06:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 723573d2-54ca-5b46-9891-b08194b3caf0
2026-01-29 06:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_2b615445e80f61a6a007d1f0d443059d.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_4177dc60a2a2e2621280730c6bb6616e.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc3%252Fa3c34fd558c85022b27578a89e14f350%252Fpa%252FGG31907_764245a32d885ca06f225d1fce83c1f8.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_764245a32d885ca06f225d1fce83c1f8.jpg not downloaded yet
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fa3%252F69a3ca5264c91412308607fa14a59748%252Fpa%252FFK20372_dac49c1e24e65753db844d37ce93add8.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_dac49c1e24e65753db844d37ce93add8.jpg not downloaded yet
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F93%252F9193e2d11d92bc64be9f8551fdcc6320%252Fpa%252FJH35342_ba77e078b56683b204381e74613678ac.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_ba77e078b56683b204381e74613678ac.jpg not downloaded yet
2026-01-29 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F3d%252Fc83d4b60e21886deefd9794ad0b0cda8%252Fpa%252FGG58617_09e4eb0aaa05e325fe26211d1a34d791.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_09e4eb0aaa05e325fe26211d1a34d791.jpg not downloaded yet
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F14%252Fd91448ba963fc26723e66005f13ffbe0%252Fpa%252FJJ40715_e94ee54e4a04904df7cb191d920f8322.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_e94ee54e4a04904df7cb191d920f8322.jpg not downloaded yet
2026-01-29 06:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_c1571d950cbe70b3ecedb234d9e8ae02.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_34c96a601a45167ce630f6d705bb7d85.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd1%252Ff1d1a2e97d7c9518d5af363c281f6ee5%252Fpa%252FKW58357_95f1cbc3de318fee35870f30e29bca21.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_95f1cbc3de318fee35870f30e29bca21.jpg not downloaded yet
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F1b%252F751bfe00f9e42b18e4b86d9e8399a4aa%252Fpa%252FPX67710_6de09de8edc1ae3bd6c53ce1b63076c5.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_6de09de8edc1ae3bd6c53ce1b63076c5.jpg not downloaded yet
2026-01-29 06:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f556250>
2026-01-29 06:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_9.jpg HTTP/1.1" 201 0
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F52%252F1a5219605f0ba0d9d1b8a2d791b1d90f%252Fpa%252FMJ86885_c393c8d6b05ec3391ee2042774cc2d2c.jpg') HTTP/1.1" 204 0
2026-01-29 06:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_c393c8d6b05ec3391ee2042774cc2d2c.jpg saved to cache
2026-01-29 06:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2157061f-feee-5a6b-8ecd-1824baae5db4
2026-01-29 06:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c25a910>
2026-01-29 06:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_1.jpg HTTP/1.1" 201 0
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc3%252Fa3c34fd558c85022b27578a89e14f350%252Fpa%252FGG31907_364195311ed170cac2f5c21584f128cb.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_364195311ed170cac2f5c21584f128cb.jpg saved to cache
2026-01-29 06:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 723573d2-54ca-5b46-9891-b08194b3caf0
2026-01-29 06:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 910dfa57-4c62-57de-8e5d-1c4692378c01 with identifier: FL57020
2026-01-29 06:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 910dfa57-4c62-57de-8e5d-1c4692378c01 with scrape type 1
2026-01-29 06:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 910dfa57-4c62-57de-8e5d-1c4692378c01
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F0e%252F840eb4bc9335aa79d4828ae3b7297b08%252Fpa%252FFL57020_6b3cc29cff7b013e3753bd3d07f50b8c.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_6b3cc29cff7b013e3753bd3d07f50b8c.jpg not downloaded yet
2026-01-29 06:01:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c143810>
2026-01-29 06:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_6.jpg HTTP/1.1" 201 0
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F52%252F1a5219605f0ba0d9d1b8a2d791b1d90f%252Fpa%252FMJ86885_3c36ea22b86aa26a2cbbdc6db5e39a98.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_3c36ea22b86aa26a2cbbdc6db5e39a98.jpg saved to cache
2026-01-29 06:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2157061f-feee-5a6b-8ecd-1824baae5db4
2026-01-29 06:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_6a9b48295fdf4945a92a87972b9afe0e.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc3%252Fa3c34fd558c85022b27578a89e14f350%252Fpa%252FGG31907_e7affb7c5f5f29592d462f93e3530a0e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_e7affb7c5f5f29592d462f93e3530a0e.jpg not downloaded yet
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fa3%252F69a3ca5264c91412308607fa14a59748%252Fpa%252FFK20372_fb492343f743942191f3ea02db2c5d53.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_fb492343f743942191f3ea02db2c5d53.jpg not downloaded yet
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F93%252F9193e2d11d92bc64be9f8551fdcc6320%252Fpa%252FJH35342_e09102289d95f8131d6d955927f8d897.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_e09102289d95f8131d6d955927f8d897.jpg not downloaded yet
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F3d%252Fc83d4b60e21886deefd9794ad0b0cda8%252Fpa%252FGG58617_198dd7f3048cb0d21213747071d40b2b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_198dd7f3048cb0d21213747071d40b2b.jpg not downloaded yet
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F14%252Fd91448ba963fc26723e66005f13ffbe0%252Fpa%252FJJ40715_e270f73453e5f1bea9d2667fd5660028.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_e270f73453e5f1bea9d2667fd5660028.jpg not downloaded yet
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd1%252Ff1d1a2e97d7c9518d5af363c281f6ee5%252Fpa%252FKW58357_c979430227bd1924df0c7f4a4ea01481.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_c979430227bd1924df0c7f4a4ea01481.jpg not downloaded yet
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F1b%252F751bfe00f9e42b18e4b86d9e8399a4aa%252Fpa%252FPX67710_10e4186bd1f5f9e85fa51df07d948dfa.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_10e4186bd1f5f9e85fa51df07d948dfa.jpg not downloaded yet
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F0e%252F840eb4bc9335aa79d4828ae3b7297b08%252Fpa%252FFL57020_3e3fd03e80989bad34b7db91a213e395.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_3e3fd03e80989bad34b7db91a213e395.jpg not downloaded yet
2026-01-29 06:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_8431e4f322c7aa9f6d21ac67f7262dc3.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_569d23f2b73ce81acc6d1bc12be6ab4a.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc3%252Fa3c34fd558c85022b27578a89e14f350%252Fpa%252FGG31907_c29ece51a9d0732a33c5fc22ad58e057.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_c29ece51a9d0732a33c5fc22ad58e057.jpg not downloaded yet
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fa3%252F69a3ca5264c91412308607fa14a59748%252Fpa%252FFK20372_cb03e9e36e2e94aa04aef2ad4c7c7154.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_cb03e9e36e2e94aa04aef2ad4c7c7154.jpg not downloaded yet
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F93%252F9193e2d11d92bc64be9f8551fdcc6320%252Fpa%252FJH35342_af158b810be02e3855adc229e981f2ee.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_af158b810be02e3855adc229e981f2ee.jpg not downloaded yet
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F3d%252Fc83d4b60e21886deefd9794ad0b0cda8%252Fpa%252FGG58617_44ab89b37378e3e81ca015ce525e0603.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_44ab89b37378e3e81ca015ce525e0603.jpg not downloaded yet
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F14%252Fd91448ba963fc26723e66005f13ffbe0%252Fpa%252FJJ40715_69be89f9de4844d3373721ce198b40ad.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_69be89f9de4844d3373721ce198b40ad.jpg not downloaded yet
2026-01-29 06:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35b628d9-cb99-5d80-8155-75c883f82fd6 with identifier: BT80701
2026-01-29 06:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35b628d9-cb99-5d80-8155-75c883f82fd6 with scrape type 2
2026-01-29 06:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35b628d9-cb99-5d80-8155-75c883f82fd6 with scrape type 2
2026-01-29 06:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 35b628d9-cb99-5d80-8155-75c883f82fd6, identifier: BT80701
2026-01-29 06:01:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c1c9ad0>
2026-01-29 06:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_8.jpg HTTP/1.1" 201 0
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F52%252F1a5219605f0ba0d9d1b8a2d791b1d90f%252Fpa%252FMJ86885_2b615445e80f61a6a007d1f0d443059d.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_2b615445e80f61a6a007d1f0d443059d.jpg saved to cache
2026-01-29 06:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2157061f-feee-5a6b-8ecd-1824baae5db4
2026-01-29 06:01:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f4650d0>
2026-01-29 06:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_5.jpg HTTP/1.1" 201 0
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F52%252F1a5219605f0ba0d9d1b8a2d791b1d90f%252Fpa%252FMJ86885_4177dc60a2a2e2621280730c6bb6616e.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_4177dc60a2a2e2621280730c6bb6616e.jpg saved to cache
2026-01-29 06:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2157061f-feee-5a6b-8ecd-1824baae5db4
2026-01-29 06:01:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f5e1cd0>
2026-01-29 06:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_7.jpg HTTP/1.1" 201 0
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F52%252F1a5219605f0ba0d9d1b8a2d791b1d90f%252Fpa%252FMJ86885_c1571d950cbe70b3ecedb234d9e8ae02.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_c1571d950cbe70b3ecedb234d9e8ae02.jpg saved to cache
2026-01-29 06:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2157061f-feee-5a6b-8ecd-1824baae5db4
2026-01-29 06:01:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff00f10>
2026-01-29 06:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97172644-6823-533e-aec1-54beb8e6e616/97172644-6823-533e-aec1-54beb8e6e616_image_0.jpg HTTP/1.1" 201 0
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F1b%252F751bfe00f9e42b18e4b86d9e8399a4aa%252Fpa%252FPX67710_34c96a601a45167ce630f6d705bb7d85.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_34c96a601a45167ce630f6d705bb7d85.jpg saved to cache
2026-01-29 06:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97172644-6823-533e-aec1-54beb8e6e616
2026-01-29 06:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_d63cab32dfe4bccb6f6fe4ab81d87749.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_09e6faaa31087640e673304d135b0a24.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_54f34a24a9afb79ac20dc6733da76e2b.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd1%252Ff1d1a2e97d7c9518d5af363c281f6ee5%252Fpa%252FKW58357_f7a1ca41e832503660c5e97169763351.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_f7a1ca41e832503660c5e97169763351.jpg not downloaded yet
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F1b%252F751bfe00f9e42b18e4b86d9e8399a4aa%252Fpa%252FPX67710_62b9fa5daab34133844178c7172f2f3e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_62b9fa5daab34133844178c7172f2f3e.jpg not downloaded yet
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F0e%252F840eb4bc9335aa79d4828ae3b7297b08%252Fpa%252FFL57020_1338f61139e5249da0fccc3c156d2f9b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_1338f61139e5249da0fccc3c156d2f9b.jpg not downloaded yet
2026-01-29 06:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 35b628d9-cb99-5d80-8155-75c883f82fd6 with identifier: BT80701
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-01-29 06:01:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 35b628d9-cb99-5d80-8155-75c883f82fd6 with identifier: BT80701
2026-01-29 06:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech affaire premium', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 57239, 'odometer_reading_unit': 'km', 'registration_date': '2018-07-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/bt80701', 'expiration_date': '2026-01-29t16:29:59z', 'origin_country_code': 'fr', 'trim': 'affaire premium', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 2, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 108, 'id': '35b628d9-cb99-5d80-8155-75c883f82fd6', 'current_year_diff': 8, 'age_in_months': 90, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 57239}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 90,
     'auction_title': '',
     'c_o_2_emission_value': 108,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:29:59z',
     'fuel_type': 'petrol',
     'id': '35b628d9-cb99-5d80-8155-75c883f82fd6',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/bt80701',
     'listing': 'auction',
     'location': 'fr',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 57239,
     'odometer_in_km': 57239,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-07-23',
     'sanitized_make': 'peugeot',
     'seats_number': 2,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech affaire premium',
     'transmission': 'manual',
     'trim': 'affaire premium',
     'year': 2018}
2026-01-29 06:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 35b628d9-cb99-5d80-8155-75c883f82fd6 spider: auto1.fr
2026-01-29 06:01:05 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 35b628d9-cb99-5d80-8155-75c883f82fd6 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech affaire premium', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 57239, 'odometer_reading_unit': 'km', 'registration_date': '2018-07-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/bt80701', 'expiration_date': '2026-01-29t16:29:59z', 'origin_country_code': 'fr', 'trim': 'affaire premium', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 2, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 108, 'id': '35b628d9-cb99-5d80-8155-75c883f82fd6', 'current_year_diff': 8, 'age_in_months': 90, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 57239}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 90,
     'auction_title': '',
     'c_o_2_emission_value': 108,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:29:59z',
     'fuel_type': 'petrol',
     'id': '35b628d9-cb99-5d80-8155-75c883f82fd6',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/bt80701',
     'listing': 'auction',
     'location': 'fr',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 57239,
     'odometer_in_km': 57239,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-07-23',
     'sanitized_make': 'peugeot',
     'seats_number': 2,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech affaire premium',
     'transmission': 'manual',
     'trim': 'affaire premium',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:29:59Z',
 'fuel_type': 'petrol',
 'id': '35b628d9-cb99-5d80-8155-75c883f82fd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT80701',
 'listing': 'auction',
 'location': 'FR',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 57239,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-23',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Affaire Premium',
 'transmission': 'manual',
 'trim': 'Affaire Premium',
 'year': 2018}
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BT80701%27 HTTP/1.1" 200 None
2026-01-29 06:01:05 [auto1.fr] INFO: Saving data for BT80701: {'auction_closing_time': 1769704199.0, 'created_time': 1769533551.281459, 'last_price_update_time': 1769666465.754539}
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BT80701') HTTP/1.1" 204 0
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc3%252Fa3c34fd558c85022b27578a89e14f350%252Fpa%252FGG31907_544c1dc6bf517bd4efd06fb01754642f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_544c1dc6bf517bd4efd06fb01754642f.jpg not downloaded yet
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fa3%252F69a3ca5264c91412308607fa14a59748%252Fpa%252FFK20372_542f2cad218469584871c937b14e637d.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_542f2cad218469584871c937b14e637d.jpg not downloaded yet
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F93%252F9193e2d11d92bc64be9f8551fdcc6320%252Fpa%252FJH35342_94b58ddb275111a959d852dcdad71b17.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_94b58ddb275111a959d852dcdad71b17.jpg not downloaded yet
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F3d%252Fc83d4b60e21886deefd9794ad0b0cda8%252Fpa%252FGG58617_d744632b8aecd3d993d02c91a2028691.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_d744632b8aecd3d993d02c91a2028691.jpg not downloaded yet
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F14%252Fd91448ba963fc26723e66005f13ffbe0%252Fpa%252FJJ40715_8e72b0f8a86c061f3d54f4228987b975.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_8e72b0f8a86c061f3d54f4228987b975.jpg not downloaded yet
2026-01-29 06:01:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f4dff10>
2026-01-29 06:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_2.jpg HTTP/1.1" 201 0
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc3%252Fa3c34fd558c85022b27578a89e14f350%252Fpa%252FGG31907_6a9b48295fdf4945a92a87972b9afe0e.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_6a9b48295fdf4945a92a87972b9afe0e.jpg saved to cache
2026-01-29 06:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 723573d2-54ca-5b46-9891-b08194b3caf0
2026-01-29 06:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_9b2eecd84b9da523084805bff8eb5c17.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd1%252Ff1d1a2e97d7c9518d5af363c281f6ee5%252Fpa%252FKW58357_a22b05333f0d837f46d3763abf100703.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_a22b05333f0d837f46d3763abf100703.jpg not downloaded yet
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F1b%252F751bfe00f9e42b18e4b86d9e8399a4aa%252Fpa%252FPX67710_2b1488688cde2d7695b4b9e8685ae372.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_2b1488688cde2d7695b4b9e8685ae372.jpg not downloaded yet
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F0e%252F840eb4bc9335aa79d4828ae3b7297b08%252Fpa%252FFL57020_aa336ea981c24de49987aac7227e5ede.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_aa336ea981c24de49987aac7227e5ede.jpg not downloaded yet
2026-01-29 06:01:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ffb5750>
2026-01-29 06:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c9707d0-c65d-56d5-9437-42b8754a3918/4c9707d0-c65d-56d5-9437-42b8754a3918_image_3.jpg HTTP/1.1" 201 0
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd1%252Ff1d1a2e97d7c9518d5af363c281f6ee5%252Fpa%252FKW58357_8431e4f322c7aa9f6d21ac67f7262dc3.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_8431e4f322c7aa9f6d21ac67f7262dc3.jpg saved to cache
2026-01-29 06:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c9707d0-c65d-56d5-9437-42b8754a3918
2026-01-29 06:01:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff1a750>
2026-01-29 06:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97172644-6823-533e-aec1-54beb8e6e616/97172644-6823-533e-aec1-54beb8e6e616_image_2.jpg HTTP/1.1" 201 0
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F1b%252F751bfe00f9e42b18e4b86d9e8399a4aa%252Fpa%252FPX67710_569d23f2b73ce81acc6d1bc12be6ab4a.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_569d23f2b73ce81acc6d1bc12be6ab4a.jpg saved to cache
2026-01-29 06:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 97172644-6823-533e-aec1-54beb8e6e616
2026-01-29 06:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_3691dce4658b1cf8221bbe1f07199a9f.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_159b4a6f55cccd0f249134017817bcdd.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_97d23059de077e3af2898c16db666e7b.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_abfa7801a812d68707e6d040c0bcb6c4.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc3%252Fa3c34fd558c85022b27578a89e14f350%252Fpa%252FGG31907_0d1c53018b6ac04252ca002007e3ac84.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_0d1c53018b6ac04252ca002007e3ac84.jpg not downloaded yet
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fa3%252F69a3ca5264c91412308607fa14a59748%252Fpa%252FFK20372_f78ee62924f3893acb248be4ce5694a7.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_f78ee62924f3893acb248be4ce5694a7.jpg not downloaded yet
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F93%252F9193e2d11d92bc64be9f8551fdcc6320%252Fpa%252FJH35342_ec2df915b5ac1a167b4f72a0291adf5a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_ec2df915b5ac1a167b4f72a0291adf5a.jpg not downloaded yet
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F3d%252Fc83d4b60e21886deefd9794ad0b0cda8%252Fpa%252FGG58617_a3460f3cb0e8a362a9d9a22dbbb90ad6.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_a3460f3cb0e8a362a9d9a22dbbb90ad6.jpg not downloaded yet
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F14%252Fd91448ba963fc26723e66005f13ffbe0%252Fpa%252FJJ40715_c9ff5d0aa5dd65c481e0986d2a8ee2a8.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_c9ff5d0aa5dd65c481e0986d2a8ee2a8.jpg not downloaded yet
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd1%252Ff1d1a2e97d7c9518d5af363c281f6ee5%252Fpa%252FKW58357_f393c6a24ab0044101c6df08aef2cef9.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_f393c6a24ab0044101c6df08aef2cef9.jpg not downloaded yet
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F1b%252F751bfe00f9e42b18e4b86d9e8399a4aa%252Fpa%252FPX67710_b94afa695d4357a2fe308df7cd69e53d.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_b94afa695d4357a2fe308df7cd69e53d.jpg not downloaded yet
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F0e%252F840eb4bc9335aa79d4828ae3b7297b08%252Fpa%252FFL57020_0a7c91027ddb0f1f37d04ef75c10627e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_0a7c91027ddb0f1f37d04ef75c10627e.jpg not downloaded yet
2026-01-29 06:01:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f4012d0>
2026-01-29 06:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c9707d0-c65d-56d5-9437-42b8754a3918/4c9707d0-c65d-56d5-9437-42b8754a3918_image_5.jpg HTTP/1.1" 201 0
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd1%252Ff1d1a2e97d7c9518d5af363c281f6ee5%252Fpa%252FKW58357_d63cab32dfe4bccb6f6fe4ab81d87749.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_d63cab32dfe4bccb6f6fe4ab81d87749.jpg saved to cache
2026-01-29 06:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4c9707d0-c65d-56d5-9437-42b8754a3918
2026-01-29 06:01:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f4fa890>
2026-01-29 06:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_0.jpg HTTP/1.1" 201 0
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F3d%252Fc83d4b60e21886deefd9794ad0b0cda8%252Fpa%252FGG58617_09e6faaa31087640e673304d135b0a24.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_09e6faaa31087640e673304d135b0a24.jpg saved to cache
2026-01-29 06:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 21109bf0-d0d8-539a-9de1-ceab88a402cf
2026-01-29 06:01:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f59df10>
2026-01-29 06:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97172644-6823-533e-aec1-54beb8e6e616/97172644-6823-533e-aec1-54beb8e6e616_image_1.jpg HTTP/1.1" 201 0
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F1b%252F751bfe00f9e42b18e4b86d9e8399a4aa%252Fpa%252FPX67710_54f34a24a9afb79ac20dc6733da76e2b.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_54f34a24a9afb79ac20dc6733da76e2b.jpg saved to cache
2026-01-29 06:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 97172644-6823-533e-aec1-54beb8e6e616
2026-01-29 06:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_26cf72d8ed1936fadca78f4707eda274.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc3%252Fa3c34fd558c85022b27578a89e14f350%252Fpa%252FGG31907_66a7303bb2b0ac6dfa95e8183eef2380.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_66a7303bb2b0ac6dfa95e8183eef2380.jpg not downloaded yet
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fa3%252F69a3ca5264c91412308607fa14a59748%252Fpa%252FFK20372_770c96fb128e8b8f14847124a2f64cfc.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_770c96fb128e8b8f14847124a2f64cfc.jpg not downloaded yet
2026-01-29 06:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F93%252F9193e2d11d92bc64be9f8551fdcc6320%252Fpa%252FJH35342_722e2fd69bf65092e5d3ff6698c5997f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_722e2fd69bf65092e5d3ff6698c5997f.jpg not downloaded yet
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F3d%252Fc83d4b60e21886deefd9794ad0b0cda8%252Fpa%252FGG58617_f6d609b4cf26bf948875d819a78a5b53.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_f6d609b4cf26bf948875d819a78a5b53.jpg not downloaded yet
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F14%252Fd91448ba963fc26723e66005f13ffbe0%252Fpa%252FJJ40715_761f3ec5761e5174cfc5e54c9b62e728.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_761f3ec5761e5174cfc5e54c9b62e728.jpg not downloaded yet
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd1%252Ff1d1a2e97d7c9518d5af363c281f6ee5%252Fpa%252FKW58357_4a2375543582080b497c6e77cb2e5598.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_4a2375543582080b497c6e77cb2e5598.jpg not downloaded yet
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F1b%252F751bfe00f9e42b18e4b86d9e8399a4aa%252Fpa%252FPX67710_6903e9ef1cd4ff25646a856360660943.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_6903e9ef1cd4ff25646a856360660943.jpg not downloaded yet
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F0e%252F840eb4bc9335aa79d4828ae3b7297b08%252Fpa%252FFL57020_ac383441c49ae4fc0d383de1fe38a584.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_ac383441c49ae4fc0d383de1fe38a584.jpg not downloaded yet
2026-01-29 06:01:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff19b50>
2026-01-29 06:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_1.jpg HTTP/1.1" 201 0
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F3d%252Fc83d4b60e21886deefd9794ad0b0cda8%252Fpa%252FGG58617_9b2eecd84b9da523084805bff8eb5c17.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_9b2eecd84b9da523084805bff8eb5c17.jpg saved to cache
2026-01-29 06:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 21109bf0-d0d8-539a-9de1-ceab88a402cf
2026-01-29 06:01:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f43f750>
2026-01-29 06:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c9707d0-c65d-56d5-9437-42b8754a3918/4c9707d0-c65d-56d5-9437-42b8754a3918_image_7.jpg HTTP/1.1" 201 0
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd1%252Ff1d1a2e97d7c9518d5af363c281f6ee5%252Fpa%252FKW58357_3691dce4658b1cf8221bbe1f07199a9f.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_3691dce4658b1cf8221bbe1f07199a9f.jpg saved to cache
2026-01-29 06:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4c9707d0-c65d-56d5-9437-42b8754a3918
2026-01-29 06:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c097850>
2026-01-29 06:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d10e014-0d08-5baa-9ecc-8088fb8db0fa/3d10e014-0d08-5baa-9ecc-8088fb8db0fa_image_1.jpg HTTP/1.1" 201 0
2026-01-29 06:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F14%252Fd91448ba963fc26723e66005f13ffbe0%252Fpa%252FJJ40715_159b4a6f55cccd0f249134017817bcdd.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_159b4a6f55cccd0f249134017817bcdd.jpg saved to cache
2026-01-29 06:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3d10e014-0d08-5baa-9ecc-8088fb8db0fa
2026-01-29 06:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f44d210>
2026-01-29 06:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97172644-6823-533e-aec1-54beb8e6e616/97172644-6823-533e-aec1-54beb8e6e616_image_4.jpg HTTP/1.1" 201 0
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F1b%252F751bfe00f9e42b18e4b86d9e8399a4aa%252Fpa%252FPX67710_97d23059de077e3af2898c16db666e7b.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_97d23059de077e3af2898c16db666e7b.jpg saved to cache
2026-01-29 06:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 97172644-6823-533e-aec1-54beb8e6e616
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f31cd90>
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d10e014-0d08-5baa-9ecc-8088fb8db0fa/3d10e014-0d08-5baa-9ecc-8088fb8db0fa_image_0.jpg HTTP/1.1" 201 0
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F14%252Fd91448ba963fc26723e66005f13ffbe0%252Fpa%252FJJ40715_abfa7801a812d68707e6d040c0bcb6c4.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_abfa7801a812d68707e6d040c0bcb6c4.jpg saved to cache
2026-01-29 06:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3d10e014-0d08-5baa-9ecc-8088fb8db0fa
2026-01-29 06:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_198dd7f3048cb0d21213747071d40b2b.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_e94ee54e4a04904df7cb191d920f8322.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_e270f73453e5f1bea9d2667fd5660028.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_23a640fe5c95fa9b1b44e6b98013ab41.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:13 [scrapy.extensions.logstats] INFO: Crawled 80 pages (at 80 pages/min), scraped 13 items (at 13 items/min)
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc3%252Fa3c34fd558c85022b27578a89e14f350%252Fpa%252FGG31907_fe045205d8d4c9df00cf6d523f61d06e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_fe045205d8d4c9df00cf6d523f61d06e.jpg not downloaded yet
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fa3%252F69a3ca5264c91412308607fa14a59748%252Fpa%252FFK20372_45b00d78a373d6e3df63f2e1ff883481.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_45b00d78a373d6e3df63f2e1ff883481.jpg not downloaded yet
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F93%252F9193e2d11d92bc64be9f8551fdcc6320%252Fpa%252FJH35342_069b83a902d1ae40113daa0bf37d87bf.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_069b83a902d1ae40113daa0bf37d87bf.jpg not downloaded yet
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F3d%252Fc83d4b60e21886deefd9794ad0b0cda8%252Fpa%252FGG58617_8cb36492af022bd031a3d8ce29e06879.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_8cb36492af022bd031a3d8ce29e06879.jpg not downloaded yet
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F14%252Fd91448ba963fc26723e66005f13ffbe0%252Fpa%252FJJ40715_843459725f160118ce07e7abad8f7a5d.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_843459725f160118ce07e7abad8f7a5d.jpg not downloaded yet
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd1%252Ff1d1a2e97d7c9518d5af363c281f6ee5%252Fpa%252FKW58357_9de109f10872988b94bcf14c583dbf66.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_9de109f10872988b94bcf14c583dbf66.jpg not downloaded yet
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F1b%252F751bfe00f9e42b18e4b86d9e8399a4aa%252Fpa%252FPX67710_fcacec280fc7e274f3b918783159706c.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_fcacec280fc7e274f3b918783159706c.jpg not downloaded yet
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F0e%252F840eb4bc9335aa79d4828ae3b7297b08%252Fpa%252FFL57020_7b582b7db1aabf6df8960e84d8e195fb.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_7b582b7db1aabf6df8960e84d8e195fb.jpg not downloaded yet
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f4b4a10>
2026-01-29 06:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_2.jpg HTTP/1.1" 201 0
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F3d%252Fc83d4b60e21886deefd9794ad0b0cda8%252Fpa%252FGG58617_26cf72d8ed1936fadca78f4707eda274.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_26cf72d8ed1936fadca78f4707eda274.jpg saved to cache
2026-01-29 06:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 21109bf0-d0d8-539a-9de1-ceab88a402cf
2026-01-29 06:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_3e3fd03e80989bad34b7db91a213e395.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc3%252Fa3c34fd558c85022b27578a89e14f350%252Fpa%252FGG31907_e2150f3c8e97196200484049d56e1aee.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_e2150f3c8e97196200484049d56e1aee.jpg not downloaded yet
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fa3%252F69a3ca5264c91412308607fa14a59748%252Fpa%252FFK20372_72b8de5875079e3d2a0de339ed58e8e2.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_72b8de5875079e3d2a0de339ed58e8e2.jpg not downloaded yet
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F93%252F9193e2d11d92bc64be9f8551fdcc6320%252Fpa%252FJH35342_d0fa987a98802bbea27f7aa84610fa61.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_d0fa987a98802bbea27f7aa84610fa61.jpg not downloaded yet
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F3d%252Fc83d4b60e21886deefd9794ad0b0cda8%252Fpa%252FGG58617_b721838b9df7d6eb70946f2f13bd8198.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_b721838b9df7d6eb70946f2f13bd8198.jpg not downloaded yet
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F14%252Fd91448ba963fc26723e66005f13ffbe0%252Fpa%252FJJ40715_105f0eb31f892ad4654dcd4626a9158d.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_105f0eb31f892ad4654dcd4626a9158d.jpg not downloaded yet
2026-01-29 06:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_c979430227bd1924df0c7f4a4ea01481.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_aa336ea981c24de49987aac7227e5ede.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_10e4186bd1f5f9e85fa51df07d948dfa.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd1%252Ff1d1a2e97d7c9518d5af363c281f6ee5%252Fpa%252FKW58357_fce9cd399b993b5e0c70a90e5c84fa51.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_fce9cd399b993b5e0c70a90e5c84fa51.jpg not downloaded yet
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F1b%252F751bfe00f9e42b18e4b86d9e8399a4aa%252Fpa%252FPX67710_f5d1af22871cde4e46f2334c23983415.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_f5d1af22871cde4e46f2334c23983415.jpg not downloaded yet
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F0e%252F840eb4bc9335aa79d4828ae3b7297b08%252Fpa%252FFL57020_bd703bf1604ce5ccecb1e95d76ec4ae3.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_bd703bf1604ce5ccecb1e95d76ec4ae3.jpg not downloaded yet
2026-01-29 06:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_1338f61139e5249da0fccc3c156d2f9b.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc3%252Fa3c34fd558c85022b27578a89e14f350%252Fpa%252FGG31907_2f49eebb59c8a3c577379e160de56eef.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_2f49eebb59c8a3c577379e160de56eef.jpg not downloaded yet
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fa3%252F69a3ca5264c91412308607fa14a59748%252Fpa%252FFK20372_017e04db67e0a1e68b72c53e253cb933.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_017e04db67e0a1e68b72c53e253cb933.jpg not downloaded yet
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F93%252F9193e2d11d92bc64be9f8551fdcc6320%252Fpa%252FJH35342_5b2f87c5a38f8b4be4ed331d9114dd92.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_5b2f87c5a38f8b4be4ed331d9114dd92.jpg not downloaded yet
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F3d%252Fc83d4b60e21886deefd9794ad0b0cda8%252Fpa%252FGG58617_b6364e3c6dfc6a82bb617509b9d7de04.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_b6364e3c6dfc6a82bb617509b9d7de04.jpg not downloaded yet
2026-01-29 06:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F14%252Fd91448ba963fc26723e66005f13ffbe0%252Fpa%252FJJ40715_5086e5077d0a7319bc99d64200453c21.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_5086e5077d0a7319bc99d64200453c21.jpg not downloaded yet
2026-01-29 06:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f463410>
2026-01-29 06:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-29 06:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_4.jpg HTTP/1.1" 201 0
2026-01-29 06:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F3d%252Fc83d4b60e21886deefd9794ad0b0cda8%252Fpa%252FGG58617_198dd7f3048cb0d21213747071d40b2b.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_198dd7f3048cb0d21213747071d40b2b.jpg saved to cache
2026-01-29 06:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 21109bf0-d0d8-539a-9de1-ceab88a402cf
2026-01-29 06:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f5a41d0>
2026-01-29 06:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d10e014-0d08-5baa-9ecc-8088fb8db0fa/3d10e014-0d08-5baa-9ecc-8088fb8db0fa_image_2.jpg HTTP/1.1" 201 0
2026-01-29 06:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F14%252Fd91448ba963fc26723e66005f13ffbe0%252Fpa%252FJJ40715_e94ee54e4a04904df7cb191d920f8322.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_e94ee54e4a04904df7cb191d920f8322.jpg saved to cache
2026-01-29 06:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3d10e014-0d08-5baa-9ecc-8088fb8db0fa
2026-01-29 06:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f402e50>
2026-01-29 06:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d10e014-0d08-5baa-9ecc-8088fb8db0fa/3d10e014-0d08-5baa-9ecc-8088fb8db0fa_image_3.jpg HTTP/1.1" 201 0
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F14%252Fd91448ba963fc26723e66005f13ffbe0%252Fpa%252FJJ40715_e270f73453e5f1bea9d2667fd5660028.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_e270f73453e5f1bea9d2667fd5660028.jpg saved to cache
2026-01-29 06:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3d10e014-0d08-5baa-9ecc-8088fb8db0fa
2026-01-29 06:01:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f30bdd0>
2026-01-29 06:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6382bce1-d32a-58ca-a715-2b2c7396dced/6382bce1-d32a-58ca-a715-2b2c7396dced_image_2.jpg HTTP/1.1" 201 0
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F93%252F9193e2d11d92bc64be9f8551fdcc6320%252Fpa%252FJH35342_23a640fe5c95fa9b1b44e6b98013ab41.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_23a640fe5c95fa9b1b44e6b98013ab41.jpg saved to cache
2026-01-29 06:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6382bce1-d32a-58ca-a715-2b2c7396dced
2026-01-29 06:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_2b1488688cde2d7695b4b9e8685ae372.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F1b%252F751bfe00f9e42b18e4b86d9e8399a4aa%252Fpa%252FPX67710_1a008adb503d4e535b0463dd1018ad16.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_1a008adb503d4e535b0463dd1018ad16.jpg not downloaded yet
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F0e%252F840eb4bc9335aa79d4828ae3b7297b08%252Fpa%252FFL57020_e728bcaf61a360753328e30fd0ff8c48.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_e728bcaf61a360753328e30fd0ff8c48.jpg not downloaded yet
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc3%252Fa3c34fd558c85022b27578a89e14f350%252Fpa%252FGG31907_ac70e1c458573e38c2ccba5b73c1c85e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_ac70e1c458573e38c2ccba5b73c1c85e.jpg not downloaded yet
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fa3%252F69a3ca5264c91412308607fa14a59748%252Fpa%252FFK20372_f4e876b77280bd99f27e62db347d957d.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_f4e876b77280bd99f27e62db347d957d.jpg not downloaded yet
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F93%252F9193e2d11d92bc64be9f8551fdcc6320%252Fpa%252FJH35342_f182774b792d3c328f67007bd2626956.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_f182774b792d3c328f67007bd2626956.jpg not downloaded yet
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F3d%252Fc83d4b60e21886deefd9794ad0b0cda8%252Fpa%252FGG58617_911f2dfee802dd3ccbe60fa10c86f1eb.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_911f2dfee802dd3ccbe60fa10c86f1eb.jpg not downloaded yet
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F14%252Fd91448ba963fc26723e66005f13ffbe0%252Fpa%252FJJ40715_ba22eb2df9a33e752307702ad7fd46f5.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_ba22eb2df9a33e752307702ad7fd46f5.jpg not downloaded yet
2026-01-29 06:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_c9ff5d0aa5dd65c481e0986d2a8ee2a8.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_8e72b0f8a86c061f3d54f4228987b975.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_a22b05333f0d837f46d3763abf100703.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F1b%252F751bfe00f9e42b18e4b86d9e8399a4aa%252Fpa%252FPX67710_2662127756b4422e2a2fa142403241b1.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_2662127756b4422e2a2fa142403241b1.jpg not downloaded yet
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F0e%252F840eb4bc9335aa79d4828ae3b7297b08%252Fpa%252FFL57020_7f650e02cea18bfce644ade2685ae713.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_7f650e02cea18bfce644ade2685ae713.jpg not downloaded yet
2026-01-29 06:01:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c09b390>
2026-01-29 06:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_910dfa57-4c62-57de-8e5d-1c4692378c01/910dfa57-4c62-57de-8e5d-1c4692378c01_image_1.jpg HTTP/1.1" 201 0
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F0e%252F840eb4bc9335aa79d4828ae3b7297b08%252Fpa%252FFL57020_3e3fd03e80989bad34b7db91a213e395.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_3e3fd03e80989bad34b7db91a213e395.jpg saved to cache
2026-01-29 06:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 910dfa57-4c62-57de-8e5d-1c4692378c01
2026-01-29 06:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c05f290>
2026-01-29 06:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c9707d0-c65d-56d5-9437-42b8754a3918/4c9707d0-c65d-56d5-9437-42b8754a3918_image_9.jpg HTTP/1.1" 201 0
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd1%252Ff1d1a2e97d7c9518d5af363c281f6ee5%252Fpa%252FKW58357_c979430227bd1924df0c7f4a4ea01481.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_c979430227bd1924df0c7f4a4ea01481.jpg saved to cache
2026-01-29 06:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4c9707d0-c65d-56d5-9437-42b8754a3918
2026-01-29 06:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c099e10>
2026-01-29 06:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_910dfa57-4c62-57de-8e5d-1c4692378c01/910dfa57-4c62-57de-8e5d-1c4692378c01_image_3.jpg HTTP/1.1" 201 0
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F0e%252F840eb4bc9335aa79d4828ae3b7297b08%252Fpa%252FFL57020_aa336ea981c24de49987aac7227e5ede.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_aa336ea981c24de49987aac7227e5ede.jpg saved to cache
2026-01-29 06:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 910dfa57-4c62-57de-8e5d-1c4692378c01
2026-01-29 06:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f4dfed0>
2026-01-29 06:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97172644-6823-533e-aec1-54beb8e6e616/97172644-6823-533e-aec1-54beb8e6e616_image_6.jpg HTTP/1.1" 201 0
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F1b%252F751bfe00f9e42b18e4b86d9e8399a4aa%252Fpa%252FPX67710_10e4186bd1f5f9e85fa51df07d948dfa.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_10e4186bd1f5f9e85fa51df07d948dfa.jpg saved to cache
2026-01-29 06:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 97172644-6823-533e-aec1-54beb8e6e616
2026-01-29 06:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff47e90>
2026-01-29 06:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_910dfa57-4c62-57de-8e5d-1c4692378c01/910dfa57-4c62-57de-8e5d-1c4692378c01_image_2.jpg HTTP/1.1" 201 0
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F0e%252F840eb4bc9335aa79d4828ae3b7297b08%252Fpa%252FFL57020_1338f61139e5249da0fccc3c156d2f9b.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_1338f61139e5249da0fccc3c156d2f9b.jpg saved to cache
2026-01-29 06:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 910dfa57-4c62-57de-8e5d-1c4692378c01
2026-01-29 06:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_761f3ec5761e5174cfc5e54c9b62e728.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F93%252F9193e2d11d92bc64be9f8551fdcc6320%252Fpa%252FJH35342_a68b4fe08ec445f2e2194b7821045152.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_a68b4fe08ec445f2e2194b7821045152.jpg not downloaded yet
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F3d%252Fc83d4b60e21886deefd9794ad0b0cda8%252Fpa%252FGG58617_75acec70d38b2b03ed9ea15a46c8b71a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_75acec70d38b2b03ed9ea15a46c8b71a.jpg not downloaded yet
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F14%252Fd91448ba963fc26723e66005f13ffbe0%252Fpa%252FJJ40715_8138442ffdb60a04d3a87c0eca356fbf.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_8138442ffdb60a04d3a87c0eca356fbf.jpg not downloaded yet
2026-01-29 06:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_f6d609b4cf26bf948875d819a78a5b53.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F1b%252F751bfe00f9e42b18e4b86d9e8399a4aa%252Fpa%252FPX67710_c2095ae1a523eb355d8b699a89ea0dde.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_c2095ae1a523eb355d8b699a89ea0dde.jpg not downloaded yet
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F0e%252F840eb4bc9335aa79d4828ae3b7297b08%252Fpa%252FFL57020_7added1ff437d363fa7c92463df86641.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_7added1ff437d363fa7c92463df86641.jpg not downloaded yet
2026-01-29 06:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f5b0310>
2026-01-29 06:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97172644-6823-533e-aec1-54beb8e6e616/97172644-6823-533e-aec1-54beb8e6e616_image_8.jpg HTTP/1.1" 201 0
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F1b%252F751bfe00f9e42b18e4b86d9e8399a4aa%252Fpa%252FPX67710_2b1488688cde2d7695b4b9e8685ae372.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_2b1488688cde2d7695b4b9e8685ae372.jpg saved to cache
2026-01-29 06:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 97172644-6823-533e-aec1-54beb8e6e616
2026-01-29 06:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_722e2fd69bf65092e5d3ff6698c5997f.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_843459725f160118ce07e7abad8f7a5d.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_770c96fb128e8b8f14847124a2f64cfc.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F93%252F9193e2d11d92bc64be9f8551fdcc6320%252Fpa%252FJH35342_697f4314addd5ed5f3e051e9da654822.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_697f4314addd5ed5f3e051e9da654822.jpg not downloaded yet
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F3d%252Fc83d4b60e21886deefd9794ad0b0cda8%252Fpa%252FGG58617_fb57bdb0bc4eaa09784137ad77fac259.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_fb57bdb0bc4eaa09784137ad77fac259.jpg not downloaded yet
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F14%252Fd91448ba963fc26723e66005f13ffbe0%252Fpa%252FJJ40715_db78cfa961af73a281f7653acf27fd8a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_db78cfa961af73a281f7653acf27fd8a.jpg not downloaded yet
2026-01-29 06:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6feada90>
2026-01-29 06:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d10e014-0d08-5baa-9ecc-8088fb8db0fa/3d10e014-0d08-5baa-9ecc-8088fb8db0fa_image_6.jpg HTTP/1.1" 201 0
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F14%252Fd91448ba963fc26723e66005f13ffbe0%252Fpa%252FJJ40715_c9ff5d0aa5dd65c481e0986d2a8ee2a8.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_c9ff5d0aa5dd65c481e0986d2a8ee2a8.jpg saved to cache
2026-01-29 06:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3d10e014-0d08-5baa-9ecc-8088fb8db0fa
2026-01-29 06:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c0a5390>
2026-01-29 06:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d10e014-0d08-5baa-9ecc-8088fb8db0fa/3d10e014-0d08-5baa-9ecc-8088fb8db0fa_image_5.jpg HTTP/1.1" 201 0
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F14%252Fd91448ba963fc26723e66005f13ffbe0%252Fpa%252FJJ40715_8e72b0f8a86c061f3d54f4228987b975.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_8e72b0f8a86c061f3d54f4228987b975.jpg saved to cache
2026-01-29 06:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3d10e014-0d08-5baa-9ecc-8088fb8db0fa
2026-01-29 06:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ffe7150>
2026-01-29 06:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c9707d0-c65d-56d5-9437-42b8754a3918/4c9707d0-c65d-56d5-9437-42b8754a3918_image_11.jpg HTTP/1.1" 201 0
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd1%252Ff1d1a2e97d7c9518d5af363c281f6ee5%252Fpa%252FKW58357_a22b05333f0d837f46d3763abf100703.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_a22b05333f0d837f46d3763abf100703.jpg saved to cache
2026-01-29 06:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 4c9707d0-c65d-56d5-9437-42b8754a3918
2026-01-29 06:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_b721838b9df7d6eb70946f2f13bd8198.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_105f0eb31f892ad4654dcd4626a9158d.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F0e%252F840eb4bc9335aa79d4828ae3b7297b08%252Fpa%252FFL57020_547c558451aa88d5ff9d40f45a1e49c4.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_547c558451aa88d5ff9d40f45a1e49c4.jpg not downloaded yet
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F93%252F9193e2d11d92bc64be9f8551fdcc6320%252Fpa%252FJH35342_1717d02284e2df740a4167cbbb97b5b8.png%27 HTTP/1.1" 200 None
2026-01-29 06:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_1717d02284e2df740a4167cbbb97b5b8.png not downloaded yet
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F3d%252Fc83d4b60e21886deefd9794ad0b0cda8%252Fpa%252FGG58617_abe1b3dc47b4c34510e44f0728f21d5d.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_abe1b3dc47b4c34510e44f0728f21d5d.jpg not downloaded yet
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F14%252Fd91448ba963fc26723e66005f13ffbe0%252Fpa%252FJJ40715_93ede286d2f44a7c9ce4334e1b2e7c0a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_93ede286d2f44a7c9ce4334e1b2e7c0a.jpg not downloaded yet
2026-01-29 06:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c1756d0>
2026-01-29 06:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d10e014-0d08-5baa-9ecc-8088fb8db0fa/3d10e014-0d08-5baa-9ecc-8088fb8db0fa_image_7.jpg HTTP/1.1" 201 0
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F14%252Fd91448ba963fc26723e66005f13ffbe0%252Fpa%252FJJ40715_761f3ec5761e5174cfc5e54c9b62e728.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_761f3ec5761e5174cfc5e54c9b62e728.jpg saved to cache
2026-01-29 06:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3d10e014-0d08-5baa-9ecc-8088fb8db0fa
2026-01-29 06:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f521d10>
2026-01-29 06:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_8.jpg HTTP/1.1" 201 0
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F3d%252Fc83d4b60e21886deefd9794ad0b0cda8%252Fpa%252FGG58617_f6d609b4cf26bf948875d819a78a5b53.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_f6d609b4cf26bf948875d819a78a5b53.jpg saved to cache
2026-01-29 06:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 21109bf0-d0d8-539a-9de1-ceab88a402cf
2026-01-29 06:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_d0fa987a98802bbea27f7aa84610fa61.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F0e%252F840eb4bc9335aa79d4828ae3b7297b08%252Fpa%252FFL57020_7a3b7f03b52898542bb900ed82281eb6.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_7a3b7f03b52898542bb900ed82281eb6.jpg not downloaded yet
2026-01-29 06:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c1769d0>
2026-01-29 06:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6382bce1-d32a-58ca-a715-2b2c7396dced/6382bce1-d32a-58ca-a715-2b2c7396dced_image_8.jpg HTTP/1.1" 201 0
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F93%252F9193e2d11d92bc64be9f8551fdcc6320%252Fpa%252FJH35342_722e2fd69bf65092e5d3ff6698c5997f.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_722e2fd69bf65092e5d3ff6698c5997f.jpg saved to cache
2026-01-29 06:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6382bce1-d32a-58ca-a715-2b2c7396dced
2026-01-29 06:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f3b73d0>
2026-01-29 06:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d10e014-0d08-5baa-9ecc-8088fb8db0fa/3d10e014-0d08-5baa-9ecc-8088fb8db0fa_image_8.jpg HTTP/1.1" 201 0
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F14%252Fd91448ba963fc26723e66005f13ffbe0%252Fpa%252FJJ40715_843459725f160118ce07e7abad8f7a5d.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_843459725f160118ce07e7abad8f7a5d.jpg saved to cache
2026-01-29 06:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3d10e014-0d08-5baa-9ecc-8088fb8db0fa
2026-01-29 06:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff45e10>
2026-01-29 06:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_11.jpg HTTP/1.1" 201 0
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fa3%252F69a3ca5264c91412308607fa14a59748%252Fpa%252FFK20372_770c96fb128e8b8f14847124a2f64cfc.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_770c96fb128e8b8f14847124a2f64cfc.jpg saved to cache
2026-01-29 06:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 003b4ab1-45b7-5fd6-804c-b72bc20afc24
2026-01-29 06:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_72b8de5875079e3d2a0de339ed58e8e2.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_1a008adb503d4e535b0463dd1018ad16.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F14%252Fd91448ba963fc26723e66005f13ffbe0%252Fpa%252FJJ40715_6ceec50bcd1bd856b36c755fecefe960.png%27 HTTP/1.1" 200 None
2026-01-29 06:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_6ceec50bcd1bd856b36c755fecefe960.png not downloaded yet
2026-01-29 06:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_bd703bf1604ce5ccecb1e95d76ec4ae3.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_e728bcaf61a360753328e30fd0ff8c48.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F0e%252F840eb4bc9335aa79d4828ae3b7297b08%252Fpa%252FFL57020_365fdf9a5fb9640e1e265ca61df597e9.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_365fdf9a5fb9640e1e265ca61df597e9.jpg not downloaded yet
2026-01-29 06:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c0a4350>
2026-01-29 06:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_10.jpg HTTP/1.1" 201 0
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F3d%252Fc83d4b60e21886deefd9794ad0b0cda8%252Fpa%252FGG58617_b721838b9df7d6eb70946f2f13bd8198.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_b721838b9df7d6eb70946f2f13bd8198.jpg saved to cache
2026-01-29 06:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 21109bf0-d0d8-539a-9de1-ceab88a402cf
2026-01-29 06:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c1540d0>
2026-01-29 06:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d10e014-0d08-5baa-9ecc-8088fb8db0fa/3d10e014-0d08-5baa-9ecc-8088fb8db0fa_image_9.jpg HTTP/1.1" 201 0
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F14%252Fd91448ba963fc26723e66005f13ffbe0%252Fpa%252FJJ40715_105f0eb31f892ad4654dcd4626a9158d.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_105f0eb31f892ad4654dcd4626a9158d.jpg saved to cache
2026-01-29 06:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3d10e014-0d08-5baa-9ecc-8088fb8db0fa
2026-01-29 06:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_5086e5077d0a7319bc99d64200453c21.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f485a90>
2026-01-29 06:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6382bce1-d32a-58ca-a715-2b2c7396dced/6382bce1-d32a-58ca-a715-2b2c7396dced_image_10.jpg HTTP/1.1" 201 0
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F93%252F9193e2d11d92bc64be9f8551fdcc6320%252Fpa%252FJH35342_d0fa987a98802bbea27f7aa84610fa61.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_d0fa987a98802bbea27f7aa84610fa61.jpg saved to cache
2026-01-29 06:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 6382bce1-d32a-58ca-a715-2b2c7396dced
2026-01-29 06:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_ba22eb2df9a33e752307702ad7fd46f5.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_7f650e02cea18bfce644ade2685ae713.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F0e%252F840eb4bc9335aa79d4828ae3b7297b08%252Fpa%252FFL57020_0bb7651af949b521c627e14d6799b25a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_0bb7651af949b521c627e14d6799b25a.jpg not downloaded yet
2026-01-29 06:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_8138442ffdb60a04d3a87c0eca356fbf.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_75acec70d38b2b03ed9ea15a46c8b71a.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f306b50>
2026-01-29 06:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_13.jpg HTTP/1.1" 201 0
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fa3%252F69a3ca5264c91412308607fa14a59748%252Fpa%252FFK20372_72b8de5875079e3d2a0de339ed58e8e2.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_72b8de5875079e3d2a0de339ed58e8e2.jpg saved to cache
2026-01-29 06:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 003b4ab1-45b7-5fd6-804c-b72bc20afc24
2026-01-29 06:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f59df90>
2026-01-29 06:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97172644-6823-533e-aec1-54beb8e6e616/97172644-6823-533e-aec1-54beb8e6e616_image_13.jpg HTTP/1.1" 201 0
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F1b%252F751bfe00f9e42b18e4b86d9e8399a4aa%252Fpa%252FPX67710_1a008adb503d4e535b0463dd1018ad16.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_1a008adb503d4e535b0463dd1018ad16.jpg saved to cache
2026-01-29 06:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 97172644-6823-533e-aec1-54beb8e6e616
2026-01-29 06:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f59db90>
2026-01-29 06:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_910dfa57-4c62-57de-8e5d-1c4692378c01/910dfa57-4c62-57de-8e5d-1c4692378c01_image_7.jpg HTTP/1.1" 201 0
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F0e%252F840eb4bc9335aa79d4828ae3b7297b08%252Fpa%252FFL57020_bd703bf1604ce5ccecb1e95d76ec4ae3.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_bd703bf1604ce5ccecb1e95d76ec4ae3.jpg saved to cache
2026-01-29 06:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 910dfa57-4c62-57de-8e5d-1c4692378c01
2026-01-29 06:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6fe0d2d0>
2026-01-29 06:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_910dfa57-4c62-57de-8e5d-1c4692378c01/910dfa57-4c62-57de-8e5d-1c4692378c01_image_8.jpg HTTP/1.1" 201 0
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F0e%252F840eb4bc9335aa79d4828ae3b7297b08%252Fpa%252FFL57020_e728bcaf61a360753328e30fd0ff8c48.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_e728bcaf61a360753328e30fd0ff8c48.jpg saved to cache
2026-01-29 06:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 910dfa57-4c62-57de-8e5d-1c4692378c01
2026-01-29 06:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_a68b4fe08ec445f2e2194b7821045152.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F0e%252F840eb4bc9335aa79d4828ae3b7297b08%252Fpa%252FFL57020_a176ba9db3b7b292ecc152b47c4b2db7.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_a176ba9db3b7b292ecc152b47c4b2db7.jpg not downloaded yet
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff6d750>
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d10e014-0d08-5baa-9ecc-8088fb8db0fa/3d10e014-0d08-5baa-9ecc-8088fb8db0fa_image_10.jpg HTTP/1.1" 201 0
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F14%252Fd91448ba963fc26723e66005f13ffbe0%252Fpa%252FJJ40715_5086e5077d0a7319bc99d64200453c21.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_5086e5077d0a7319bc99d64200453c21.jpg saved to cache
2026-01-29 06:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 3d10e014-0d08-5baa-9ecc-8088fb8db0fa
2026-01-29 06:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_7added1ff437d363fa7c92463df86641.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_c2095ae1a523eb355d8b699a89ea0dde.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f56fe10>
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d10e014-0d08-5baa-9ecc-8088fb8db0fa/3d10e014-0d08-5baa-9ecc-8088fb8db0fa_image_11.jpg HTTP/1.1" 201 0
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F14%252Fd91448ba963fc26723e66005f13ffbe0%252Fpa%252FJJ40715_ba22eb2df9a33e752307702ad7fd46f5.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_ba22eb2df9a33e752307702ad7fd46f5.jpg saved to cache
2026-01-29 06:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 3d10e014-0d08-5baa-9ecc-8088fb8db0fa
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f57add0>
2026-01-29 06:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_910dfa57-4c62-57de-8e5d-1c4692378c01/910dfa57-4c62-57de-8e5d-1c4692378c01_image_9.jpg HTTP/1.1" 201 0
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F0e%252F840eb4bc9335aa79d4828ae3b7297b08%252Fpa%252FFL57020_7f650e02cea18bfce644ade2685ae713.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_7f650e02cea18bfce644ade2685ae713.jpg saved to cache
2026-01-29 06:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 910dfa57-4c62-57de-8e5d-1c4692378c01
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f588e90>
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d10e014-0d08-5baa-9ecc-8088fb8db0fa/3d10e014-0d08-5baa-9ecc-8088fb8db0fa_image_12.jpg HTTP/1.1" 201 0
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F14%252Fd91448ba963fc26723e66005f13ffbe0%252Fpa%252FJJ40715_8138442ffdb60a04d3a87c0eca356fbf.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_8138442ffdb60a04d3a87c0eca356fbf.jpg saved to cache
2026-01-29 06:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 3d10e014-0d08-5baa-9ecc-8088fb8db0fa
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f58bb50>
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_13.jpg HTTP/1.1" 201 0
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F3d%252Fc83d4b60e21886deefd9794ad0b0cda8%252Fpa%252FGG58617_75acec70d38b2b03ed9ea15a46c8b71a.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_75acec70d38b2b03ed9ea15a46c8b71a.jpg saved to cache
2026-01-29 06:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 21109bf0-d0d8-539a-9de1-ceab88a402cf
2026-01-29 06:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_547c558451aa88d5ff9d40f45a1e49c4.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_93ede286d2f44a7c9ce4334e1b2e7c0a.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_abe1b3dc47b4c34510e44f0728f21d5d.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c1b1f90>
2026-01-29 06:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6382bce1-d32a-58ca-a715-2b2c7396dced/6382bce1-d32a-58ca-a715-2b2c7396dced_image_13.jpg HTTP/1.1" 201 0
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F93%252F9193e2d11d92bc64be9f8551fdcc6320%252Fpa%252FJH35342_a68b4fe08ec445f2e2194b7821045152.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_a68b4fe08ec445f2e2194b7821045152.jpg saved to cache
2026-01-29 06:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 6382bce1-d32a-58ca-a715-2b2c7396dced
2026-01-29 06:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff71b50>
2026-01-29 06:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_910dfa57-4c62-57de-8e5d-1c4692378c01/910dfa57-4c62-57de-8e5d-1c4692378c01_image_10.jpg HTTP/1.1" 201 0
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F0e%252F840eb4bc9335aa79d4828ae3b7297b08%252Fpa%252FFL57020_7added1ff437d363fa7c92463df86641.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_7added1ff437d363fa7c92463df86641.jpg saved to cache
2026-01-29 06:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 910dfa57-4c62-57de-8e5d-1c4692378c01
2026-01-29 06:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f3975d0>
2026-01-29 06:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97172644-6823-533e-aec1-54beb8e6e616/97172644-6823-533e-aec1-54beb8e6e616_image_15.jpg HTTP/1.1" 201 0
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F1b%252F751bfe00f9e42b18e4b86d9e8399a4aa%252Fpa%252FPX67710_c2095ae1a523eb355d8b699a89ea0dde.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_c2095ae1a523eb355d8b699a89ea0dde.jpg saved to cache
2026-01-29 06:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 97172644-6823-533e-aec1-54beb8e6e616
2026-01-29 06:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_859ade7e831a82007eebbe0e21ff38d0.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_5af40c442df484a387ed1e6d22aa3815.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_7a3b7f03b52898542bb900ed82281eb6.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_365fdf9a5fb9640e1e265ca61df597e9.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_1717d02284e2df740a4167cbbb97b5b8.png> (referer: https://www.auto1.com/)
2026-01-29 06:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_6ceec50bcd1bd856b36c755fecefe960.png> (referer: https://www.auto1.com/)
2026-01-29 06:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff91490>
2026-01-29 06:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_910dfa57-4c62-57de-8e5d-1c4692378c01/910dfa57-4c62-57de-8e5d-1c4692378c01_image_11.jpg HTTP/1.1" 201 0
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F0e%252F840eb4bc9335aa79d4828ae3b7297b08%252Fpa%252FFL57020_547c558451aa88d5ff9d40f45a1e49c4.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_547c558451aa88d5ff9d40f45a1e49c4.jpg saved to cache
2026-01-29 06:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 910dfa57-4c62-57de-8e5d-1c4692378c01
2026-01-29 06:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c1db310>
2026-01-29 06:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d10e014-0d08-5baa-9ecc-8088fb8db0fa/3d10e014-0d08-5baa-9ecc-8088fb8db0fa_image_14.jpg HTTP/1.1" 201 0
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F14%252Fd91448ba963fc26723e66005f13ffbe0%252Fpa%252FJJ40715_93ede286d2f44a7c9ce4334e1b2e7c0a.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_93ede286d2f44a7c9ce4334e1b2e7c0a.jpg saved to cache
2026-01-29 06:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 3d10e014-0d08-5baa-9ecc-8088fb8db0fa
2026-01-29 06:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c1b2390>
2026-01-29 06:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_15.jpg HTTP/1.1" 201 0
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F3d%252Fc83d4b60e21886deefd9794ad0b0cda8%252Fpa%252FGG58617_abe1b3dc47b4c34510e44f0728f21d5d.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_abe1b3dc47b4c34510e44f0728f21d5d.jpg saved to cache
2026-01-29 06:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 21109bf0-d0d8-539a-9de1-ceab88a402cf
2026-01-29 06:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_db78cfa961af73a281f7653acf27fd8a.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_0bb7651af949b521c627e14d6799b25a.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_911f2dfee802dd3ccbe60fa10c86f1eb.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_2662127756b4422e2a2fa142403241b1.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_697f4314addd5ed5f3e051e9da654822.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_a176ba9db3b7b292ecc152b47c4b2db7.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_fb57bdb0bc4eaa09784137ad77fac259.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_998ac03a5d7a79ca65c121f90416488e.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-29 06:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c21c550>
2026-01-29 06:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_0.jpg HTTP/1.1" 201 0
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fa3%252F69a3ca5264c91412308607fa14a59748%252Fpa%252FFK20372_859ade7e831a82007eebbe0e21ff38d0.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_859ade7e831a82007eebbe0e21ff38d0.jpg saved to cache
2026-01-29 06:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 003b4ab1-45b7-5fd6-804c-b72bc20afc24
2026-01-29 06:01:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-29 06:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f432710>
2026-01-29 06:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_1.jpg HTTP/1.1" 201 0
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fa3%252F69a3ca5264c91412308607fa14a59748%252Fpa%252FFK20372_5af40c442df484a387ed1e6d22aa3815.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_5af40c442df484a387ed1e6d22aa3815.jpg saved to cache
2026-01-29 06:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 003b4ab1-45b7-5fd6-804c-b72bc20afc24
2026-01-29 06:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6fed9fd0>
2026-01-29 06:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_910dfa57-4c62-57de-8e5d-1c4692378c01/910dfa57-4c62-57de-8e5d-1c4692378c01_image_12.jpg HTTP/1.1" 201 0
2026-01-29 06:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F0e%252F840eb4bc9335aa79d4828ae3b7297b08%252Fpa%252FFL57020_7a3b7f03b52898542bb900ed82281eb6.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_7a3b7f03b52898542bb900ed82281eb6.jpg saved to cache
2026-01-29 06:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 910dfa57-4c62-57de-8e5d-1c4692378c01
2026-01-29 06:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c155f50>
2026-01-29 06:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_910dfa57-4c62-57de-8e5d-1c4692378c01/910dfa57-4c62-57de-8e5d-1c4692378c01_image_13.jpg HTTP/1.1" 201 0
2026-01-29 06:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F0e%252F840eb4bc9335aa79d4828ae3b7297b08%252Fpa%252FFL57020_365fdf9a5fb9640e1e265ca61df597e9.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_365fdf9a5fb9640e1e265ca61df597e9.jpg saved to cache
2026-01-29 06:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 910dfa57-4c62-57de-8e5d-1c4692378c01
2026-01-29 06:01:30 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-01-29 06:01:30 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2026-01-29 06:01:30 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2026-01-29 06:01:30 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2026-01-29 06:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6fedba50>
2026-01-29 06:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6382bce1-d32a-58ca-a715-2b2c7396dced/6382bce1-d32a-58ca-a715-2b2c7396dced_image_15.png HTTP/1.1" 201 0
2026-01-29 06:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F93%252F9193e2d11d92bc64be9f8551fdcc6320%252Fpa%252FJH35342_1717d02284e2df740a4167cbbb97b5b8.png') HTTP/1.1" 204 0
2026-01-29 06:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_1717d02284e2df740a4167cbbb97b5b8.png saved to cache
2026-01-29 06:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 6382bce1-d32a-58ca-a715-2b2c7396dced
2026-01-29 06:01:30 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-01-29 06:01:30 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2026-01-29 06:01:30 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2026-01-29 06:01:30 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2026-01-29 06:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f3c1110>
2026-01-29 06:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d10e014-0d08-5baa-9ecc-8088fb8db0fa/3d10e014-0d08-5baa-9ecc-8088fb8db0fa_image_15.png HTTP/1.1" 201 0
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F14%252Fd91448ba963fc26723e66005f13ffbe0%252Fpa%252FJJ40715_6ceec50bcd1bd856b36c755fecefe960.png') HTTP/1.1" 204 0
2026-01-29 06:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_6ceec50bcd1bd856b36c755fecefe960.png saved to cache
2026-01-29 06:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 3d10e014-0d08-5baa-9ecc-8088fb8db0fa
2026-01-29 06:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_f182774b792d3c328f67007bd2626956.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_f4e876b77280bd99f27e62db347d957d.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f42cd90>
2026-01-29 06:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d10e014-0d08-5baa-9ecc-8088fb8db0fa/3d10e014-0d08-5baa-9ecc-8088fb8db0fa_image_13.jpg HTTP/1.1" 201 0
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F14%252Fd91448ba963fc26723e66005f13ffbe0%252Fpa%252FJJ40715_db78cfa961af73a281f7653acf27fd8a.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_db78cfa961af73a281f7653acf27fd8a.jpg saved to cache
2026-01-29 06:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 3d10e014-0d08-5baa-9ecc-8088fb8db0fa
2026-01-29 06:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f42fb10>
2026-01-29 06:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_910dfa57-4c62-57de-8e5d-1c4692378c01/910dfa57-4c62-57de-8e5d-1c4692378c01_image_14.jpg HTTP/1.1" 201 0
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F0e%252F840eb4bc9335aa79d4828ae3b7297b08%252Fpa%252FFL57020_0bb7651af949b521c627e14d6799b25a.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_0bb7651af949b521c627e14d6799b25a.jpg saved to cache
2026-01-29 06:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 910dfa57-4c62-57de-8e5d-1c4692378c01
2026-01-29 06:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c1922d0>
2026-01-29 06:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_12.jpg HTTP/1.1" 201 0
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F3d%252Fc83d4b60e21886deefd9794ad0b0cda8%252Fpa%252FGG58617_911f2dfee802dd3ccbe60fa10c86f1eb.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_911f2dfee802dd3ccbe60fa10c86f1eb.jpg saved to cache
2026-01-29 06:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 21109bf0-d0d8-539a-9de1-ceab88a402cf
2026-01-29 06:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff4ce10>
2026-01-29 06:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97172644-6823-533e-aec1-54beb8e6e616/97172644-6823-533e-aec1-54beb8e6e616_image_14.jpg HTTP/1.1" 201 0
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F1b%252F751bfe00f9e42b18e4b86d9e8399a4aa%252Fpa%252FPX67710_2662127756b4422e2a2fa142403241b1.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_2662127756b4422e2a2fa142403241b1.jpg saved to cache
2026-01-29 06:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 97172644-6823-533e-aec1-54beb8e6e616
2026-01-29 06:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c1eb4d0>
2026-01-29 06:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6382bce1-d32a-58ca-a715-2b2c7396dced/6382bce1-d32a-58ca-a715-2b2c7396dced_image_14.jpg HTTP/1.1" 201 0
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F93%252F9193e2d11d92bc64be9f8551fdcc6320%252Fpa%252FJH35342_697f4314addd5ed5f3e051e9da654822.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_697f4314addd5ed5f3e051e9da654822.jpg saved to cache
2026-01-29 06:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 6382bce1-d32a-58ca-a715-2b2c7396dced
2026-01-29 06:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff1e2d0>
2026-01-29 06:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_910dfa57-4c62-57de-8e5d-1c4692378c01/910dfa57-4c62-57de-8e5d-1c4692378c01_image_15.jpg HTTP/1.1" 201 0
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F0e%252F840eb4bc9335aa79d4828ae3b7297b08%252Fpa%252FFL57020_a176ba9db3b7b292ecc152b47c4b2db7.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_a176ba9db3b7b292ecc152b47c4b2db7.jpg saved to cache
2026-01-29 06:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 910dfa57-4c62-57de-8e5d-1c4692378c01
2026-01-29 06:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c0b4050>
2026-01-29 06:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_14.jpg HTTP/1.1" 201 0
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F3d%252Fc83d4b60e21886deefd9794ad0b0cda8%252Fpa%252FGG58617_fb57bdb0bc4eaa09784137ad77fac259.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_fb57bdb0bc4eaa09784137ad77fac259.jpg saved to cache
2026-01-29 06:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 21109bf0-d0d8-539a-9de1-ceab88a402cf
2026-01-29 06:01:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-29 06:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff1d4d0>
2026-01-29 06:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_2.jpg HTTP/1.1" 201 0
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fa3%252F69a3ca5264c91412308607fa14a59748%252Fpa%252FFK20372_998ac03a5d7a79ca65c121f90416488e.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_998ac03a5d7a79ca65c121f90416488e.jpg saved to cache
2026-01-29 06:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 003b4ab1-45b7-5fd6-804c-b72bc20afc24
2026-01-29 06:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c29a0d0>
2026-01-29 06:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6382bce1-d32a-58ca-a715-2b2c7396dced/6382bce1-d32a-58ca-a715-2b2c7396dced_image_12.jpg HTTP/1.1" 201 0
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F93%252F9193e2d11d92bc64be9f8551fdcc6320%252Fpa%252FJH35342_f182774b792d3c328f67007bd2626956.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_f182774b792d3c328f67007bd2626956.jpg saved to cache
2026-01-29 06:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 6382bce1-d32a-58ca-a715-2b2c7396dced
2026-01-29 06:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ffa1e90>
2026-01-29 06:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_15.jpg HTTP/1.1" 201 0
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fa3%252F69a3ca5264c91412308607fa14a59748%252Fpa%252FFK20372_f4e876b77280bd99f27e62db347d957d.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_f4e876b77280bd99f27e62db347d957d.jpg saved to cache
2026-01-29 06:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 003b4ab1-45b7-5fd6-804c-b72bc20afc24
2026-01-29 06:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_5b2f87c5a38f8b4be4ed331d9114dd92.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_f5d1af22871cde4e46f2334c23983415.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_e2150f3c8e97196200484049d56e1aee.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_b6364e3c6dfc6a82bb617509b9d7de04.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_ac70e1c458573e38c2ccba5b73c1c85e.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_017e04db67e0a1e68b72c53e253cb933.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_fce9cd399b993b5e0c70a90e5c84fa51.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_2f49eebb59c8a3c577379e160de56eef.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_fe045205d8d4c9df00cf6d523f61d06e.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_7b582b7db1aabf6df8960e84d8e195fb.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_fcacec280fc7e274f3b918783159706c.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_45b00d78a373d6e3df63f2e1ff883481.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_ac383441c49ae4fc0d383de1fe38a584.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_9de109f10872988b94bcf14c583dbf66.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_8cb36492af022bd031a3d8ce29e06879.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_069b83a902d1ae40113daa0bf37d87bf.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_6903e9ef1cd4ff25646a856360660943.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f43f550>
2026-01-29 06:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6382bce1-d32a-58ca-a715-2b2c7396dced/6382bce1-d32a-58ca-a715-2b2c7396dced_image_11.jpg HTTP/1.1" 201 0
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F93%252F9193e2d11d92bc64be9f8551fdcc6320%252Fpa%252FJH35342_5b2f87c5a38f8b4be4ed331d9114dd92.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_5b2f87c5a38f8b4be4ed331d9114dd92.jpg saved to cache
2026-01-29 06:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 6382bce1-d32a-58ca-a715-2b2c7396dced
2026-01-29 06:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_f78ee62924f3893acb248be4ce5694a7.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_4a2375543582080b497c6e77cb2e5598.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_66a7303bb2b0ac6dfa95e8183eef2380.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_b94afa695d4357a2fe308df7cd69e53d.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_ec2df915b5ac1a167b4f72a0291adf5a.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_a3460f3cb0e8a362a9d9a22dbbb90ad6.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_f393c6a24ab0044101c6df08aef2cef9.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_0a7c91027ddb0f1f37d04ef75c10627e.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff910d0>
2026-01-29 06:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97172644-6823-533e-aec1-54beb8e6e616/97172644-6823-533e-aec1-54beb8e6e616_image_12.jpg HTTP/1.1" 201 0
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F1b%252F751bfe00f9e42b18e4b86d9e8399a4aa%252Fpa%252FPX67710_f5d1af22871cde4e46f2334c23983415.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_f5d1af22871cde4e46f2334c23983415.jpg saved to cache
2026-01-29 06:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 97172644-6823-533e-aec1-54beb8e6e616
2026-01-29 06:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ffb1510>
2026-01-29 06:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_13.jpg HTTP/1.1" 201 0
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc3%252Fa3c34fd558c85022b27578a89e14f350%252Fpa%252FGG31907_e2150f3c8e97196200484049d56e1aee.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_e2150f3c8e97196200484049d56e1aee.jpg saved to cache
2026-01-29 06:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 723573d2-54ca-5b46-9891-b08194b3caf0
2026-01-29 06:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f31d490>
2026-01-29 06:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_11.jpg HTTP/1.1" 201 0
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F3d%252Fc83d4b60e21886deefd9794ad0b0cda8%252Fpa%252FGG58617_b6364e3c6dfc6a82bb617509b9d7de04.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_b6364e3c6dfc6a82bb617509b9d7de04.jpg saved to cache
2026-01-29 06:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 21109bf0-d0d8-539a-9de1-ceab88a402cf
2026-01-29 06:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ffb1090>
2026-01-29 06:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_15.jpg HTTP/1.1" 201 0
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc3%252Fa3c34fd558c85022b27578a89e14f350%252Fpa%252FGG31907_ac70e1c458573e38c2ccba5b73c1c85e.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_ac70e1c458573e38c2ccba5b73c1c85e.jpg saved to cache
2026-01-29 06:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 723573d2-54ca-5b46-9891-b08194b3caf0
2026-01-29 06:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f31c410>
2026-01-29 06:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_14.jpg HTTP/1.1" 201 0
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fa3%252F69a3ca5264c91412308607fa14a59748%252Fpa%252FFK20372_017e04db67e0a1e68b72c53e253cb933.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_017e04db67e0a1e68b72c53e253cb933.jpg saved to cache
2026-01-29 06:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 003b4ab1-45b7-5fd6-804c-b72bc20afc24
2026-01-29 06:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f5b7590>
2026-01-29 06:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c9707d0-c65d-56d5-9437-42b8754a3918/4c9707d0-c65d-56d5-9437-42b8754a3918_image_15.jpg HTTP/1.1" 201 0
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd1%252Ff1d1a2e97d7c9518d5af363c281f6ee5%252Fpa%252FKW58357_fce9cd399b993b5e0c70a90e5c84fa51.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_fce9cd399b993b5e0c70a90e5c84fa51.jpg saved to cache
2026-01-29 06:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 4c9707d0-c65d-56d5-9437-42b8754a3918
2026-01-29 06:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c109210>
2026-01-29 06:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_14.jpg HTTP/1.1" 201 0
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc3%252Fa3c34fd558c85022b27578a89e14f350%252Fpa%252FGG31907_2f49eebb59c8a3c577379e160de56eef.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_2f49eebb59c8a3c577379e160de56eef.jpg saved to cache
2026-01-29 06:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 723573d2-54ca-5b46-9891-b08194b3caf0
2026-01-29 06:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c27c810>
2026-01-29 06:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_12.jpg HTTP/1.1" 201 0
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc3%252Fa3c34fd558c85022b27578a89e14f350%252Fpa%252FGG31907_fe045205d8d4c9df00cf6d523f61d06e.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_fe045205d8d4c9df00cf6d523f61d06e.jpg saved to cache
2026-01-29 06:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 723573d2-54ca-5b46-9891-b08194b3caf0
2026-01-29 06:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff1d010>
2026-01-29 06:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_910dfa57-4c62-57de-8e5d-1c4692378c01/910dfa57-4c62-57de-8e5d-1c4692378c01_image_6.jpg HTTP/1.1" 201 0
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F0e%252F840eb4bc9335aa79d4828ae3b7297b08%252Fpa%252FFL57020_7b582b7db1aabf6df8960e84d8e195fb.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_7b582b7db1aabf6df8960e84d8e195fb.jpg saved to cache
2026-01-29 06:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 910dfa57-4c62-57de-8e5d-1c4692378c01
2026-01-29 06:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f3f3290>
2026-01-29 06:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97172644-6823-533e-aec1-54beb8e6e616/97172644-6823-533e-aec1-54beb8e6e616_image_11.jpg HTTP/1.1" 201 0
2026-01-29 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F1b%252F751bfe00f9e42b18e4b86d9e8399a4aa%252Fpa%252FPX67710_fcacec280fc7e274f3b918783159706c.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_fcacec280fc7e274f3b918783159706c.jpg saved to cache
2026-01-29 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 97172644-6823-533e-aec1-54beb8e6e616
2026-01-29 06:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f3f6490>
2026-01-29 06:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_12.jpg HTTP/1.1" 201 0
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fa3%252F69a3ca5264c91412308607fa14a59748%252Fpa%252FFK20372_45b00d78a373d6e3df63f2e1ff883481.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_45b00d78a373d6e3df63f2e1ff883481.jpg saved to cache
2026-01-29 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 003b4ab1-45b7-5fd6-804c-b72bc20afc24
2026-01-29 06:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f2039d0>
2026-01-29 06:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_910dfa57-4c62-57de-8e5d-1c4692378c01/910dfa57-4c62-57de-8e5d-1c4692378c01_image_5.jpg HTTP/1.1" 201 0
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F0e%252F840eb4bc9335aa79d4828ae3b7297b08%252Fpa%252FFL57020_ac383441c49ae4fc0d383de1fe38a584.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_ac383441c49ae4fc0d383de1fe38a584.jpg saved to cache
2026-01-29 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 910dfa57-4c62-57de-8e5d-1c4692378c01
2026-01-29 06:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f3cb5d0>
2026-01-29 06:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c9707d0-c65d-56d5-9437-42b8754a3918/4c9707d0-c65d-56d5-9437-42b8754a3918_image_14.jpg HTTP/1.1" 201 0
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd1%252Ff1d1a2e97d7c9518d5af363c281f6ee5%252Fpa%252FKW58357_9de109f10872988b94bcf14c583dbf66.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_9de109f10872988b94bcf14c583dbf66.jpg saved to cache
2026-01-29 06:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 4c9707d0-c65d-56d5-9437-42b8754a3918
2026-01-29 06:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f31ef50>
2026-01-29 06:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_9.jpg HTTP/1.1" 201 0
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F3d%252Fc83d4b60e21886deefd9794ad0b0cda8%252Fpa%252FGG58617_8cb36492af022bd031a3d8ce29e06879.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_8cb36492af022bd031a3d8ce29e06879.jpg saved to cache
2026-01-29 06:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 21109bf0-d0d8-539a-9de1-ceab88a402cf
2026-01-29 06:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f3e8410>
2026-01-29 06:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6382bce1-d32a-58ca-a715-2b2c7396dced/6382bce1-d32a-58ca-a715-2b2c7396dced_image_9.jpg HTTP/1.1" 201 0
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F93%252F9193e2d11d92bc64be9f8551fdcc6320%252Fpa%252FJH35342_069b83a902d1ae40113daa0bf37d87bf.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_069b83a902d1ae40113daa0bf37d87bf.jpg saved to cache
2026-01-29 06:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6382bce1-d32a-58ca-a715-2b2c7396dced
2026-01-29 06:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c10a550>
2026-01-29 06:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97172644-6823-533e-aec1-54beb8e6e616/97172644-6823-533e-aec1-54beb8e6e616_image_10.jpg HTTP/1.1" 201 0
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F1b%252F751bfe00f9e42b18e4b86d9e8399a4aa%252Fpa%252FPX67710_6903e9ef1cd4ff25646a856360660943.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_6903e9ef1cd4ff25646a856360660943.jpg saved to cache
2026-01-29 06:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 97172644-6823-533e-aec1-54beb8e6e616
2026-01-29 06:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c148710>
2026-01-29 06:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_10.jpg HTTP/1.1" 201 0
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fa3%252F69a3ca5264c91412308607fa14a59748%252Fpa%252FFK20372_f78ee62924f3893acb248be4ce5694a7.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_f78ee62924f3893acb248be4ce5694a7.jpg saved to cache
2026-01-29 06:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 003b4ab1-45b7-5fd6-804c-b72bc20afc24
2026-01-29 06:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c1550d0>
2026-01-29 06:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c9707d0-c65d-56d5-9437-42b8754a3918/4c9707d0-c65d-56d5-9437-42b8754a3918_image_13.jpg HTTP/1.1" 201 0
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd1%252Ff1d1a2e97d7c9518d5af363c281f6ee5%252Fpa%252FKW58357_4a2375543582080b497c6e77cb2e5598.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_4a2375543582080b497c6e77cb2e5598.jpg saved to cache
2026-01-29 06:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 4c9707d0-c65d-56d5-9437-42b8754a3918
2026-01-29 06:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f54cf90>
2026-01-29 06:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_11.jpg HTTP/1.1" 201 0
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc3%252Fa3c34fd558c85022b27578a89e14f350%252Fpa%252FGG31907_66a7303bb2b0ac6dfa95e8183eef2380.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_66a7303bb2b0ac6dfa95e8183eef2380.jpg saved to cache
2026-01-29 06:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 723573d2-54ca-5b46-9891-b08194b3caf0
2026-01-29 06:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f569b10>
2026-01-29 06:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97172644-6823-533e-aec1-54beb8e6e616/97172644-6823-533e-aec1-54beb8e6e616_image_9.jpg HTTP/1.1" 201 0
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F1b%252F751bfe00f9e42b18e4b86d9e8399a4aa%252Fpa%252FPX67710_b94afa695d4357a2fe308df7cd69e53d.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_b94afa695d4357a2fe308df7cd69e53d.jpg saved to cache
2026-01-29 06:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 97172644-6823-533e-aec1-54beb8e6e616
2026-01-29 06:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c0ef390>
2026-01-29 06:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6382bce1-d32a-58ca-a715-2b2c7396dced/6382bce1-d32a-58ca-a715-2b2c7396dced_image_7.jpg HTTP/1.1" 201 0
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F93%252F9193e2d11d92bc64be9f8551fdcc6320%252Fpa%252FJH35342_ec2df915b5ac1a167b4f72a0291adf5a.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_ec2df915b5ac1a167b4f72a0291adf5a.jpg saved to cache
2026-01-29 06:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6382bce1-d32a-58ca-a715-2b2c7396dced
2026-01-29 06:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6feeeb50>
2026-01-29 06:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_7.jpg HTTP/1.1" 201 0
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F3d%252Fc83d4b60e21886deefd9794ad0b0cda8%252Fpa%252FGG58617_a3460f3cb0e8a362a9d9a22dbbb90ad6.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_a3460f3cb0e8a362a9d9a22dbbb90ad6.jpg saved to cache
2026-01-29 06:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 21109bf0-d0d8-539a-9de1-ceab88a402cf
2026-01-29 06:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff75ad0>
2026-01-29 06:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c9707d0-c65d-56d5-9437-42b8754a3918/4c9707d0-c65d-56d5-9437-42b8754a3918_image_12.jpg HTTP/1.1" 201 0
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd1%252Ff1d1a2e97d7c9518d5af363c281f6ee5%252Fpa%252FKW58357_f393c6a24ab0044101c6df08aef2cef9.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_f393c6a24ab0044101c6df08aef2cef9.jpg saved to cache
2026-01-29 06:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 4c9707d0-c65d-56d5-9437-42b8754a3918
2026-01-29 06:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f56a710>
2026-01-29 06:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_910dfa57-4c62-57de-8e5d-1c4692378c01/910dfa57-4c62-57de-8e5d-1c4692378c01_image_4.jpg HTTP/1.1" 201 0
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F0e%252F840eb4bc9335aa79d4828ae3b7297b08%252Fpa%252FFL57020_0a7c91027ddb0f1f37d04ef75c10627e.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_0a7c91027ddb0f1f37d04ef75c10627e.jpg saved to cache
2026-01-29 06:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 910dfa57-4c62-57de-8e5d-1c4692378c01
2026-01-29 06:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_0d1c53018b6ac04252ca002007e3ac84.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_94b58ddb275111a959d852dcdad71b17.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_d744632b8aecd3d993d02c91a2028691.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_69be89f9de4844d3373721ce198b40ad.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_f7a1ca41e832503660c5e97169763351.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_544c1dc6bf517bd4efd06fb01754642f.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_542f2cad218469584871c937b14e637d.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_62b9fa5daab34133844178c7172f2f3e.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_44ab89b37378e3e81ca015ce525e0603.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_af158b810be02e3855adc229e981f2ee.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_e7affb7c5f5f29592d462f93e3530a0e.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_c29ece51a9d0732a33c5fc22ad58e057.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_e09102289d95f8131d6d955927f8d897.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_6b3cc29cff7b013e3753bd3d07f50b8c.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f308850>
2026-01-29 06:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_10.jpg HTTP/1.1" 201 0
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc3%252Fa3c34fd558c85022b27578a89e14f350%252Fpa%252FGG31907_0d1c53018b6ac04252ca002007e3ac84.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_0d1c53018b6ac04252ca002007e3ac84.jpg saved to cache
2026-01-29 06:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 723573d2-54ca-5b46-9891-b08194b3caf0
2026-01-29 06:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_95f1cbc3de318fee35870f30e29bca21.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_09e4eb0aaa05e325fe26211d1a34d791.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_ba77e078b56683b204381e74613678ac.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_764245a32d885ca06f225d1fce83c1f8.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_6de09de8edc1ae3bd6c53ce1b63076c5.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f44c110>
2026-01-29 06:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6382bce1-d32a-58ca-a715-2b2c7396dced/6382bce1-d32a-58ca-a715-2b2c7396dced_image_6.jpg HTTP/1.1" 201 0
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F93%252F9193e2d11d92bc64be9f8551fdcc6320%252Fpa%252FJH35342_94b58ddb275111a959d852dcdad71b17.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_94b58ddb275111a959d852dcdad71b17.jpg saved to cache
2026-01-29 06:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6382bce1-d32a-58ca-a715-2b2c7396dced
2026-01-29 06:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ffa3e50>
2026-01-29 06:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_6.jpg HTTP/1.1" 201 0
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F3d%252Fc83d4b60e21886deefd9794ad0b0cda8%252Fpa%252FGG58617_d744632b8aecd3d993d02c91a2028691.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_d744632b8aecd3d993d02c91a2028691.jpg saved to cache
2026-01-29 06:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 21109bf0-d0d8-539a-9de1-ceab88a402cf
2026-01-29 06:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f5556d0>
2026-01-29 06:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d10e014-0d08-5baa-9ecc-8088fb8db0fa/3d10e014-0d08-5baa-9ecc-8088fb8db0fa_image_4.jpg HTTP/1.1" 201 0
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F14%252Fd91448ba963fc26723e66005f13ffbe0%252Fpa%252FJJ40715_69be89f9de4844d3373721ce198b40ad.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_69be89f9de4844d3373721ce198b40ad.jpg saved to cache
2026-01-29 06:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3d10e014-0d08-5baa-9ecc-8088fb8db0fa
2026-01-29 06:01:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3d10e014-0d08-5baa-9ecc-8088fb8db0fa, skipping ID generation
2026-01-29 06:01:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d10e014-0d08-5baa-9ecc-8088fb8db0fa with scrape type 1
2026-01-29 06:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3d10e014-0d08-5baa-9ecc-8088fb8db0fa from tracking dictionaries
2026-01-29 06:01:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3d10e014-0d08-5baa-9ecc-8088fb8db0fa sending to next pipeline
2026-01-29 06:01:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3d10e014-0d08-5baa-9ecc-8088fb8db0fa, identifier: JJ40715
2026-01-29 06:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f54fb10>
2026-01-29 06:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c9707d0-c65d-56d5-9437-42b8754a3918/4c9707d0-c65d-56d5-9437-42b8754a3918_image_10.jpg HTTP/1.1" 201 0
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd1%252Ff1d1a2e97d7c9518d5af363c281f6ee5%252Fpa%252FKW58357_f7a1ca41e832503660c5e97169763351.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_f7a1ca41e832503660c5e97169763351.jpg saved to cache
2026-01-29 06:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 4c9707d0-c65d-56d5-9437-42b8754a3918
2026-01-29 06:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c0eead0>
2026-01-29 06:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_9.jpg HTTP/1.1" 201 0
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc3%252Fa3c34fd558c85022b27578a89e14f350%252Fpa%252FGG31907_544c1dc6bf517bd4efd06fb01754642f.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_544c1dc6bf517bd4efd06fb01754642f.jpg saved to cache
2026-01-29 06:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 723573d2-54ca-5b46-9891-b08194b3caf0
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff92fd0>
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_9.jpg HTTP/1.1" 201 0
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fa3%252F69a3ca5264c91412308607fa14a59748%252Fpa%252FFK20372_542f2cad218469584871c937b14e637d.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_542f2cad218469584871c937b14e637d.jpg saved to cache
2026-01-29 06:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 003b4ab1-45b7-5fd6-804c-b72bc20afc24
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f45bd50>
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97172644-6823-533e-aec1-54beb8e6e616/97172644-6823-533e-aec1-54beb8e6e616_image_7.jpg HTTP/1.1" 201 0
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F1b%252F751bfe00f9e42b18e4b86d9e8399a4aa%252Fpa%252FPX67710_62b9fa5daab34133844178c7172f2f3e.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_62b9fa5daab34133844178c7172f2f3e.jpg saved to cache
2026-01-29 06:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 97172644-6823-533e-aec1-54beb8e6e616
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c1dbed0>
2026-01-29 06:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_5.jpg HTTP/1.1" 201 0
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F3d%252Fc83d4b60e21886deefd9794ad0b0cda8%252Fpa%252FGG58617_44ab89b37378e3e81ca015ce525e0603.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_44ab89b37378e3e81ca015ce525e0603.jpg saved to cache
2026-01-29 06:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 21109bf0-d0d8-539a-9de1-ceab88a402cf
2026-01-29 06:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f54fcd0>
2026-01-29 06:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6382bce1-d32a-58ca-a715-2b2c7396dced/6382bce1-d32a-58ca-a715-2b2c7396dced_image_5.jpg HTTP/1.1" 201 0
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F93%252F9193e2d11d92bc64be9f8551fdcc6320%252Fpa%252FJH35342_af158b810be02e3855adc229e981f2ee.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_af158b810be02e3855adc229e981f2ee.jpg saved to cache
2026-01-29 06:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6382bce1-d32a-58ca-a715-2b2c7396dced
2026-01-29 06:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff76150>
2026-01-29 06:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_7.jpg HTTP/1.1" 201 0
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc3%252Fa3c34fd558c85022b27578a89e14f350%252Fpa%252FGG31907_e7affb7c5f5f29592d462f93e3530a0e.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_e7affb7c5f5f29592d462f93e3530a0e.jpg saved to cache
2026-01-29 06:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 723573d2-54ca-5b46-9891-b08194b3caf0
2026-01-29 06:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff1dcd0>
2026-01-29 06:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_8.jpg HTTP/1.1" 201 0
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc3%252Fa3c34fd558c85022b27578a89e14f350%252Fpa%252FGG31907_c29ece51a9d0732a33c5fc22ad58e057.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_c29ece51a9d0732a33c5fc22ad58e057.jpg saved to cache
2026-01-29 06:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 723573d2-54ca-5b46-9891-b08194b3caf0
2026-01-29 06:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff1c150>
2026-01-29 06:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6382bce1-d32a-58ca-a715-2b2c7396dced/6382bce1-d32a-58ca-a715-2b2c7396dced_image_4.jpg HTTP/1.1" 201 0
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F93%252F9193e2d11d92bc64be9f8551fdcc6320%252Fpa%252FJH35342_e09102289d95f8131d6d955927f8d897.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_e09102289d95f8131d6d955927f8d897.jpg saved to cache
2026-01-29 06:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6382bce1-d32a-58ca-a715-2b2c7396dced
2026-01-29 06:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f421210>
2026-01-29 06:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_910dfa57-4c62-57de-8e5d-1c4692378c01/910dfa57-4c62-57de-8e5d-1c4692378c01_image_0.jpg HTTP/1.1" 201 0
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F0e%252F840eb4bc9335aa79d4828ae3b7297b08%252Fpa%252FFL57020_6b3cc29cff7b013e3753bd3d07f50b8c.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_6b3cc29cff7b013e3753bd3d07f50b8c.jpg saved to cache
2026-01-29 06:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 910dfa57-4c62-57de-8e5d-1c4692378c01
2026-01-29 06:01:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 910dfa57-4c62-57de-8e5d-1c4692378c01, skipping ID generation
2026-01-29 06:01:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 910dfa57-4c62-57de-8e5d-1c4692378c01 with scrape type 1
2026-01-29 06:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 910dfa57-4c62-57de-8e5d-1c4692378c01 from tracking dictionaries
2026-01-29 06:01:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 910dfa57-4c62-57de-8e5d-1c4692378c01 sending to next pipeline
2026-01-29 06:01:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 910dfa57-4c62-57de-8e5d-1c4692378c01, identifier: FL57020
2026-01-29 06:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_56662fe4bde51420fd332ea507e6deb8.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3d10e014-0d08-5baa-9ecc-8088fb8db0fa with identifier: JJ40715
2026-01-29 06:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3d10e014-0d08-5baa-9ecc-8088fb8db0fa with identifier: JJ40715
2026-01-29 06:01:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3d10e014-0d08-5baa-9ecc-8088fb8db0fa with identifier: JJ40715 to the API
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_69be89f9de4844d3373721ce198b40ad.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.5L',
 'engine_horse_power': 313,
 'expiration_date': '2026-01-29T16:06:47Z',
 'fuel_type': 'hybrid',
 'id': '3d10e014-0d08-5baa-9ecc-8088fb8db0fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ40715',
 'listing': 'auction',
 'location': 'FR, Compiègne',
 'make': 'Lexus',
 'model': 'RX-Serie',
 'odometer': 90421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d10e014-0d08-5baa-9ecc-8088fb8db0fa/3d10e014-0d08-5baa-9ecc-8088fb8db0fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69532,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_abfa7801a812d68707e6d040c0bcb6c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d10e014-0d08-5baa-9ecc-8088fb8db0fa/3d10e014-0d08-5baa-9ecc-8088fb8db0fa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_159b4a6f55cccd0f249134017817bcdd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d10e014-0d08-5baa-9ecc-8088fb8db0fa/3d10e014-0d08-5baa-9ecc-8088fb8db0fa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60661,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_e94ee54e4a04904df7cb191d920f8322.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d10e014-0d08-5baa-9ecc-8088fb8db0fa/3d10e014-0d08-5baa-9ecc-8088fb8db0fa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_e270f73453e5f1bea9d2667fd5660028.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d10e014-0d08-5baa-9ecc-8088fb8db0fa/3d10e014-0d08-5baa-9ecc-8088fb8db0fa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_69be89f9de4844d3373721ce198b40ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d10e014-0d08-5baa-9ecc-8088fb8db0fa/3d10e014-0d08-5baa-9ecc-8088fb8db0fa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_8e72b0f8a86c061f3d54f4228987b975.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d10e014-0d08-5baa-9ecc-8088fb8db0fa/3d10e014-0d08-5baa-9ecc-8088fb8db0fa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_c9ff5d0aa5dd65c481e0986d2a8ee2a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d10e014-0d08-5baa-9ecc-8088fb8db0fa/3d10e014-0d08-5baa-9ecc-8088fb8db0fa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64988,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_761f3ec5761e5174cfc5e54c9b62e728.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d10e014-0d08-5baa-9ecc-8088fb8db0fa/3d10e014-0d08-5baa-9ecc-8088fb8db0fa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_843459725f160118ce07e7abad8f7a5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d10e014-0d08-5baa-9ecc-8088fb8db0fa/3d10e014-0d08-5baa-9ecc-8088fb8db0fa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_105f0eb31f892ad4654dcd4626a9158d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d10e014-0d08-5baa-9ecc-8088fb8db0fa/3d10e014-0d08-5baa-9ecc-8088fb8db0fa_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_5086e5077d0a7319bc99d64200453c21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d10e014-0d08-5baa-9ecc-8088fb8db0fa/3d10e014-0d08-5baa-9ecc-8088fb8db0fa_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_ba22eb2df9a33e752307702ad7fd46f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d10e014-0d08-5baa-9ecc-8088fb8db0fa/3d10e014-0d08-5baa-9ecc-8088fb8db0fa_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_8138442ffdb60a04d3a87c0eca356fbf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d10e014-0d08-5baa-9ecc-8088fb8db0fa/3d10e014-0d08-5baa-9ecc-8088fb8db0fa_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_db78cfa961af73a281f7653acf27fd8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d10e014-0d08-5baa-9ecc-8088fb8db0fa/3d10e014-0d08-5baa-9ecc-8088fb8db0fa_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_93ede286d2f44a7c9ce4334e1b2e7c0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d10e014-0d08-5baa-9ecc-8088fb8db0fa/3d10e014-0d08-5baa-9ecc-8088fb8db0fa_image_15.png',
             'Extension': 'png',
             'FileSizeInBytes': 112709,
             'Height': 525,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/14/d91448ba963fc26723e66005f13ffbe0/pa/JJ40715_6ceec50bcd1bd856b36c755fecefe960.png',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lexus RX-Serie RX 450h Pack AWD',
 'transmission': 'automatic',
 'trim': 'Pack AWD',
 'year': 2020}
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ40715%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.fr] INFO: Saving data for JJ40715: {'created_time': 1769666511.443347, 'last_price_update_time': 1769666511.443365, 'auction_closing_time': 1769702807.0}
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JJ40715') HTTP/1.1" 204 0
2026-01-29 06:01:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 910dfa57-4c62-57de-8e5d-1c4692378c01 with identifier: FL57020
2026-01-29 06:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 910dfa57-4c62-57de-8e5d-1c4692378c01 with identifier: FL57020
2026-01-29 06:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 194262 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    194262
2026-01-29 06:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 910dfa57-4c62-57de-8e5d-1c4692378c01 spider: auto1.fr
2026-01-29 06:01:51 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 910dfa57-4c62-57de-8e5d-1c4692378c01 due to rule: high_mileage_for_country.json, error: 194262 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    194262
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.7L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:36:09Z',
 'fuel_type': 'diesel',
 'id': '910dfa57-4c62-57de-8e5d-1c4692378c01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL57020',
 'listing': 'auction',
 'location': 'FR, Maromme',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 194262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_910dfa57-4c62-57de-8e5d-1c4692378c01/910dfa57-4c62-57de-8e5d-1c4692378c01_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_6b3cc29cff7b013e3753bd3d07f50b8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_910dfa57-4c62-57de-8e5d-1c4692378c01/910dfa57-4c62-57de-8e5d-1c4692378c01_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_3e3fd03e80989bad34b7db91a213e395.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_910dfa57-4c62-57de-8e5d-1c4692378c01/910dfa57-4c62-57de-8e5d-1c4692378c01_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70275,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_1338f61139e5249da0fccc3c156d2f9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_910dfa57-4c62-57de-8e5d-1c4692378c01/910dfa57-4c62-57de-8e5d-1c4692378c01_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_aa336ea981c24de49987aac7227e5ede.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_910dfa57-4c62-57de-8e5d-1c4692378c01/910dfa57-4c62-57de-8e5d-1c4692378c01_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_0a7c91027ddb0f1f37d04ef75c10627e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_910dfa57-4c62-57de-8e5d-1c4692378c01/910dfa57-4c62-57de-8e5d-1c4692378c01_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_ac383441c49ae4fc0d383de1fe38a584.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_910dfa57-4c62-57de-8e5d-1c4692378c01/910dfa57-4c62-57de-8e5d-1c4692378c01_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_7b582b7db1aabf6df8960e84d8e195fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_910dfa57-4c62-57de-8e5d-1c4692378c01/910dfa57-4c62-57de-8e5d-1c4692378c01_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_bd703bf1604ce5ccecb1e95d76ec4ae3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_910dfa57-4c62-57de-8e5d-1c4692378c01/910dfa57-4c62-57de-8e5d-1c4692378c01_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_e728bcaf61a360753328e30fd0ff8c48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_910dfa57-4c62-57de-8e5d-1c4692378c01/910dfa57-4c62-57de-8e5d-1c4692378c01_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_7f650e02cea18bfce644ade2685ae713.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_910dfa57-4c62-57de-8e5d-1c4692378c01/910dfa57-4c62-57de-8e5d-1c4692378c01_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61464,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_7added1ff437d363fa7c92463df86641.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_910dfa57-4c62-57de-8e5d-1c4692378c01/910dfa57-4c62-57de-8e5d-1c4692378c01_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_547c558451aa88d5ff9d40f45a1e49c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_910dfa57-4c62-57de-8e5d-1c4692378c01/910dfa57-4c62-57de-8e5d-1c4692378c01_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_7a3b7f03b52898542bb900ed82281eb6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_910dfa57-4c62-57de-8e5d-1c4692378c01/910dfa57-4c62-57de-8e5d-1c4692378c01_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59532,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_365fdf9a5fb9640e1e265ca61df597e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_910dfa57-4c62-57de-8e5d-1c4692378c01/910dfa57-4c62-57de-8e5d-1c4692378c01_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_0bb7651af949b521c627e14d6799b25a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_910dfa57-4c62-57de-8e5d-1c4692378c01/910dfa57-4c62-57de-8e5d-1c4692378c01_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68275,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/0e/840eb4bc9335aa79d4828ae3b7297b08/pa/FL57020_a176ba9db3b7b292ecc152b47c4b2db7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.7 CRDi GT Line 2WD',
 'transmission': 'automatic',
 'trim': 'GT Line 2WD',
 'year': 2017}
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FL57020%27 HTTP/1.1" 200 None
2026-01-29 06:01:51 [auto1.fr] INFO: Saving data for FL57020: {'created_time': 1769666511.793906, 'last_price_update_time': 1769666511.793948, 'auction_closing_time': 1769704569.0}
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FL57020') HTTP/1.1" 204 0
2026-01-29 06:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_5b031116530c6b6572cb021f420560f2.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_2381108fdb04fd8ee0d4e97104e963b1.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff4fb10>
2026-01-29 06:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c9707d0-c65d-56d5-9437-42b8754a3918/4c9707d0-c65d-56d5-9437-42b8754a3918_image_8.jpg HTTP/1.1" 201 0
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd1%252Ff1d1a2e97d7c9518d5af363c281f6ee5%252Fpa%252FKW58357_95f1cbc3de318fee35870f30e29bca21.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_95f1cbc3de318fee35870f30e29bca21.jpg saved to cache
2026-01-29 06:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4c9707d0-c65d-56d5-9437-42b8754a3918
2026-01-29 06:01:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff1b310>
2026-01-29 06:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_3.jpg HTTP/1.1" 201 0
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F3d%252Fc83d4b60e21886deefd9794ad0b0cda8%252Fpa%252FGG58617_09e4eb0aaa05e325fe26211d1a34d791.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_09e4eb0aaa05e325fe26211d1a34d791.jpg saved to cache
2026-01-29 06:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 21109bf0-d0d8-539a-9de1-ceab88a402cf
2026-01-29 06:01:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21109bf0-d0d8-539a-9de1-ceab88a402cf, skipping ID generation
2026-01-29 06:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21109bf0-d0d8-539a-9de1-ceab88a402cf with scrape type 1
2026-01-29 06:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 21109bf0-d0d8-539a-9de1-ceab88a402cf from tracking dictionaries
2026-01-29 06:01:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 21109bf0-d0d8-539a-9de1-ceab88a402cf sending to next pipeline
2026-01-29 06:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 21109bf0-d0d8-539a-9de1-ceab88a402cf, identifier: GG58617
2026-01-29 06:01:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff18850>
2026-01-29 06:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6382bce1-d32a-58ca-a715-2b2c7396dced/6382bce1-d32a-58ca-a715-2b2c7396dced_image_3.jpg HTTP/1.1" 201 0
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F93%252F9193e2d11d92bc64be9f8551fdcc6320%252Fpa%252FJH35342_ba77e078b56683b204381e74613678ac.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_ba77e078b56683b204381e74613678ac.jpg saved to cache
2026-01-29 06:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6382bce1-d32a-58ca-a715-2b2c7396dced
2026-01-29 06:01:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f3a8490>
2026-01-29 06:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_6.jpg HTTP/1.1" 201 0
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc3%252Fa3c34fd558c85022b27578a89e14f350%252Fpa%252FGG31907_764245a32d885ca06f225d1fce83c1f8.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_764245a32d885ca06f225d1fce83c1f8.jpg saved to cache
2026-01-29 06:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 723573d2-54ca-5b46-9891-b08194b3caf0
2026-01-29 06:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c136350>
2026-01-29 06:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97172644-6823-533e-aec1-54beb8e6e616/97172644-6823-533e-aec1-54beb8e6e616_image_5.jpg HTTP/1.1" 201 0
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F1b%252F751bfe00f9e42b18e4b86d9e8399a4aa%252Fpa%252FPX67710_6de09de8edc1ae3bd6c53ce1b63076c5.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_6de09de8edc1ae3bd6c53ce1b63076c5.jpg saved to cache
2026-01-29 06:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 97172644-6823-533e-aec1-54beb8e6e616
2026-01-29 06:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_600dacc4e99d09d09bdc10c299381ce0.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 21109bf0-d0d8-539a-9de1-ceab88a402cf with identifier: GG58617
2026-01-29 06:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 21109bf0-d0d8-539a-9de1-ceab88a402cf with identifier: GG58617
2026-01-29 06:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 24458, 'odometer_reading_unit': 'km', 'registration_date': '2020-04-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gg58617', 'expiration_date': '2026-01-29t16:50:47z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, saint-maximin', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 139, 'id': '21109bf0-d0d8-539a-9de1-ceab88a402cf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_09e6faaa31087640e673304d135b0a24.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 69539}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_9b2eecd84b9da523084805bff8eb5c17.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60491}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_26cf72d8ed1936fadca78f4707eda274.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63953}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_09e4eb0aaa05e325fe26211d1a34d791.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 53532}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_198dd7f3048cb0d21213747071d40b2b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 55714}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_44ab89b37378e3e81ca015ce525e0603.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65960}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_d744632b8aecd3d993d02c91a2028691.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 51804}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_a3460f3cb0e8a362a9d9a22dbbb90ad6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63620}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_f6d609b4cf26bf948875d819a78a5b53.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67412}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_8cb36492af022bd031a3d8ce29e06879.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 51718}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_b721838b9df7d6eb70946f2f13bd8198.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58936}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_b6364e3c6dfc6a82bb617509b9d7de04.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 54675}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_911f2dfee802dd3ccbe60fa10c86f1eb.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 64635}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_75acec70d38b2b03ed9ea15a46c8b71a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 41984}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_fb57bdb0bc4eaa09784137ad77fac259.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 89864}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_abe1b3dc47b4c34510e44f0728f21d5d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67103}], 'current_year_diff': 6, 'age_in_months': 69, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 24458}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 69,
     'auction_title': '',
     'c_o_2_emission_value': 139,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:50:47z',
     'fuel_type': 'petrol',
     'id': '21109bf0-d0d8-539a-9de1-ceab88a402cf',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gg58617',
     'listing': 'auction',
     'location': 'fr, saint-maximin',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 24458,
     'odometer_in_km': 24458,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 16,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 69539,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_09e6faaa31087640e673304d135b0a24.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 60491,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_9b2eecd84b9da523084805bff8eb5c17.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 63953,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_26cf72d8ed1936fadca78f4707eda274.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 53532,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_09e4eb0aaa05e325fe26211d1a34d791.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 55714,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_198dd7f3048cb0d21213747071d40b2b.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 65960,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_44ab89b37378e3e81ca015ce525e0603.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51804,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_d744632b8aecd3d993d02c91a2028691.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 63620,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_a3460f3cb0e8a362a9d9a22dbbb90ad6.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 67412,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_f6d609b4cf26bf948875d819a78a5b53.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51718,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_8cb36492af022bd031a3d8ce29e06879.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 58936,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_b721838b9df7d6eb70946f2f13bd8198.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 54675,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_b6364e3c6dfc6a82bb617509b9d7de04.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 64635,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_911f2dfee802dd3ccbe60fa10c86f1eb.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 41984,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_75acec70d38b2b03ed9ea15a46c8b71a.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 89864,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_fb57bdb0bc4eaa09784137ad77fac259.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 67103,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_abe1b3dc47b4c34510e44f0728f21d5d.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-04-23',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'automatic',
     'trim': 'allure',
     'year': 2020}
2026-01-29 06:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 21109bf0-d0d8-539a-9de1-ceab88a402cf spider: auto1.fr
2026-01-29 06:01:53 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 21109bf0-d0d8-539a-9de1-ceab88a402cf due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 24458, 'odometer_reading_unit': 'km', 'registration_date': '2020-04-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gg58617', 'expiration_date': '2026-01-29t16:50:47z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, saint-maximin', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 139, 'id': '21109bf0-d0d8-539a-9de1-ceab88a402cf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_09e6faaa31087640e673304d135b0a24.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 69539}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_9b2eecd84b9da523084805bff8eb5c17.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60491}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_26cf72d8ed1936fadca78f4707eda274.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63953}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_09e4eb0aaa05e325fe26211d1a34d791.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 53532}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_198dd7f3048cb0d21213747071d40b2b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 55714}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_44ab89b37378e3e81ca015ce525e0603.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65960}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_d744632b8aecd3d993d02c91a2028691.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 51804}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_a3460f3cb0e8a362a9d9a22dbbb90ad6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63620}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_f6d609b4cf26bf948875d819a78a5b53.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67412}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_8cb36492af022bd031a3d8ce29e06879.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 51718}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_b721838b9df7d6eb70946f2f13bd8198.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58936}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_b6364e3c6dfc6a82bb617509b9d7de04.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 54675}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_911f2dfee802dd3ccbe60fa10c86f1eb.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 64635}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_75acec70d38b2b03ed9ea15a46c8b71a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 41984}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_fb57bdb0bc4eaa09784137ad77fac259.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 89864}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_abe1b3dc47b4c34510e44f0728f21d5d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67103}], 'current_year_diff': 6, 'age_in_months': 69, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 24458}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 69,
     'auction_title': '',
     'c_o_2_emission_value': 139,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:50:47z',
     'fuel_type': 'petrol',
     'id': '21109bf0-d0d8-539a-9de1-ceab88a402cf',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gg58617',
     'listing': 'auction',
     'location': 'fr, saint-maximin',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 24458,
     'odometer_in_km': 24458,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 16,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 69539,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_09e6faaa31087640e673304d135b0a24.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 60491,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_9b2eecd84b9da523084805bff8eb5c17.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 63953,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_26cf72d8ed1936fadca78f4707eda274.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 53532,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_09e4eb0aaa05e325fe26211d1a34d791.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 55714,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_198dd7f3048cb0d21213747071d40b2b.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 65960,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_44ab89b37378e3e81ca015ce525e0603.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51804,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_d744632b8aecd3d993d02c91a2028691.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 63620,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_a3460f3cb0e8a362a9d9a22dbbb90ad6.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 67412,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_f6d609b4cf26bf948875d819a78a5b53.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51718,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_8cb36492af022bd031a3d8ce29e06879.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 58936,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_b721838b9df7d6eb70946f2f13bd8198.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 54675,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_b6364e3c6dfc6a82bb617509b9d7de04.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 64635,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_911f2dfee802dd3ccbe60fa10c86f1eb.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 41984,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_75acec70d38b2b03ed9ea15a46c8b71a.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 89864,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_fb57bdb0bc4eaa09784137ad77fac259.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 67103,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_abe1b3dc47b4c34510e44f0728f21d5d.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-04-23',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'automatic',
     'trim': 'allure',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:50:47Z',
 'fuel_type': 'petrol',
 'id': '21109bf0-d0d8-539a-9de1-ceab88a402cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG58617',
 'listing': 'auction',
 'location': 'FR, Saint-Maximin',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 24458,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69539,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_09e6faaa31087640e673304d135b0a24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_9b2eecd84b9da523084805bff8eb5c17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_26cf72d8ed1936fadca78f4707eda274.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53532,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_09e4eb0aaa05e325fe26211d1a34d791.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_198dd7f3048cb0d21213747071d40b2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_44ab89b37378e3e81ca015ce525e0603.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_d744632b8aecd3d993d02c91a2028691.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_a3460f3cb0e8a362a9d9a22dbbb90ad6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67412,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_f6d609b4cf26bf948875d819a78a5b53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51718,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_8cb36492af022bd031a3d8ce29e06879.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_b721838b9df7d6eb70946f2f13bd8198.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_b6364e3c6dfc6a82bb617509b9d7de04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_911f2dfee802dd3ccbe60fa10c86f1eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_75acec70d38b2b03ed9ea15a46c8b71a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_fb57bdb0bc4eaa09784137ad77fac259.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21109bf0-d0d8-539a-9de1-ceab88a402cf/21109bf0-d0d8-539a-9de1-ceab88a402cf_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/3d/c83d4b60e21886deefd9794ad0b0cda8/pa/GG58617_abe1b3dc47b4c34510e44f0728f21d5d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-04-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2020}
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG58617%27 HTTP/1.1" 200 None
2026-01-29 06:01:53 [auto1.fr] INFO: Saving data for GG58617: {'created_time': 1769666513.769985, 'last_price_update_time': 1769666513.769999, 'auction_closing_time': 1769705447.0}
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GG58617') HTTP/1.1" 204 0
2026-01-29 06:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f419490>
2026-01-29 06:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-29 06:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c9707d0-c65d-56d5-9437-42b8754a3918/4c9707d0-c65d-56d5-9437-42b8754a3918_image_6.jpg HTTP/1.1" 201 0
2026-01-29 06:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd1%252Ff1d1a2e97d7c9518d5af363c281f6ee5%252Fpa%252FKW58357_56662fe4bde51420fd332ea507e6deb8.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_56662fe4bde51420fd332ea507e6deb8.jpg saved to cache
2026-01-29 06:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4c9707d0-c65d-56d5-9437-42b8754a3918
2026-01-29 06:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_be6ac4e6a52f25b204b7b11a0f8b284d.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f47f050>
2026-01-29 06:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97172644-6823-533e-aec1-54beb8e6e616/97172644-6823-533e-aec1-54beb8e6e616_image_3.jpg HTTP/1.1" 201 0
2026-01-29 06:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F1b%252F751bfe00f9e42b18e4b86d9e8399a4aa%252Fpa%252FPX67710_5b031116530c6b6572cb021f420560f2.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_5b031116530c6b6572cb021f420560f2.jpg saved to cache
2026-01-29 06:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 97172644-6823-533e-aec1-54beb8e6e616
2026-01-29 06:01:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 97172644-6823-533e-aec1-54beb8e6e616, skipping ID generation
2026-01-29 06:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97172644-6823-533e-aec1-54beb8e6e616 with scrape type 1
2026-01-29 06:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 97172644-6823-533e-aec1-54beb8e6e616 from tracking dictionaries
2026-01-29 06:01:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 97172644-6823-533e-aec1-54beb8e6e616 sending to next pipeline
2026-01-29 06:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 97172644-6823-533e-aec1-54beb8e6e616, identifier: PX67710
2026-01-29 06:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f477150>
2026-01-29 06:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_5.jpg HTTP/1.1" 201 0
2026-01-29 06:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc3%252Fa3c34fd558c85022b27578a89e14f350%252Fpa%252FGG31907_2381108fdb04fd8ee0d4e97104e963b1.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_2381108fdb04fd8ee0d4e97104e963b1.jpg saved to cache
2026-01-29 06:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 723573d2-54ca-5b46-9891-b08194b3caf0
2026-01-29 06:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_28a1e3efc06052584b87dbf11f04d637.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 97172644-6823-533e-aec1-54beb8e6e616 with identifier: PX67710
2026-01-29 06:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 97172644-6823-533e-aec1-54beb8e6e616 with identifier: PX67710
2026-01-29 06:01:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 97172644-6823-533e-aec1-54beb8e6e616 with identifier: PX67710 to the API
2026-01-29 06:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:01:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_5b031116530c6b6572cb021f420560f2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 265,
 'expiration_date': '2026-01-29T16:49:16Z',
 'fuel_type': 'hybrid',
 'id': '97172644-6823-533e-aec1-54beb8e6e616',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX67710',
 'listing': 'auction',
 'location': 'FR, Montivillier',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 55135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97172644-6823-533e-aec1-54beb8e6e616/97172644-6823-533e-aec1-54beb8e6e616_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72924,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_34c96a601a45167ce630f6d705bb7d85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97172644-6823-533e-aec1-54beb8e6e616/97172644-6823-533e-aec1-54beb8e6e616_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_54f34a24a9afb79ac20dc6733da76e2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97172644-6823-533e-aec1-54beb8e6e616/97172644-6823-533e-aec1-54beb8e6e616_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_569d23f2b73ce81acc6d1bc12be6ab4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97172644-6823-533e-aec1-54beb8e6e616/97172644-6823-533e-aec1-54beb8e6e616_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_5b031116530c6b6572cb021f420560f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97172644-6823-533e-aec1-54beb8e6e616/97172644-6823-533e-aec1-54beb8e6e616_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_97d23059de077e3af2898c16db666e7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97172644-6823-533e-aec1-54beb8e6e616/97172644-6823-533e-aec1-54beb8e6e616_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_6de09de8edc1ae3bd6c53ce1b63076c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97172644-6823-533e-aec1-54beb8e6e616/97172644-6823-533e-aec1-54beb8e6e616_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_10e4186bd1f5f9e85fa51df07d948dfa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97172644-6823-533e-aec1-54beb8e6e616/97172644-6823-533e-aec1-54beb8e6e616_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56700,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_62b9fa5daab34133844178c7172f2f3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97172644-6823-533e-aec1-54beb8e6e616/97172644-6823-533e-aec1-54beb8e6e616_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_2b1488688cde2d7695b4b9e8685ae372.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97172644-6823-533e-aec1-54beb8e6e616/97172644-6823-533e-aec1-54beb8e6e616_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_b94afa695d4357a2fe308df7cd69e53d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97172644-6823-533e-aec1-54beb8e6e616/97172644-6823-533e-aec1-54beb8e6e616_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58700,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_6903e9ef1cd4ff25646a856360660943.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97172644-6823-533e-aec1-54beb8e6e616/97172644-6823-533e-aec1-54beb8e6e616_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_fcacec280fc7e274f3b918783159706c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97172644-6823-533e-aec1-54beb8e6e616/97172644-6823-533e-aec1-54beb8e6e616_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_f5d1af22871cde4e46f2334c23983415.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97172644-6823-533e-aec1-54beb8e6e616/97172644-6823-533e-aec1-54beb8e6e616_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49270,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_1a008adb503d4e535b0463dd1018ad16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97172644-6823-533e-aec1-54beb8e6e616/97172644-6823-533e-aec1-54beb8e6e616_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_2662127756b4422e2a2fa142403241b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97172644-6823-533e-aec1-54beb8e6e616/97172644-6823-533e-aec1-54beb8e6e616_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/1b/751bfe00f9e42b18e4b86d9e8399a4aa/pa/PX67710_c2095ae1a523eb355d8b699a89ea0dde.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Plug-in Hybrid Executive 4WD',
 'transmission': 'automatic',
 'trim': 'Executive 4WD',
 'year': 2022}
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX67710%27 HTTP/1.1" 200 None
2026-01-29 06:01:56 [auto1.fr] INFO: Saving data for PX67710: {'created_time': 1769666516.209445, 'last_price_update_time': 1769666516.209455, 'auction_closing_time': 1769705356.0}
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PX67710') HTTP/1.1" 204 0
2026-01-29 06:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f474510>
2026-01-29 06:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6382bce1-d32a-58ca-a715-2b2c7396dced/6382bce1-d32a-58ca-a715-2b2c7396dced_image_1.jpg HTTP/1.1" 201 0
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F93%252F9193e2d11d92bc64be9f8551fdcc6320%252Fpa%252FJH35342_600dacc4e99d09d09bdc10c299381ce0.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_600dacc4e99d09d09bdc10c299381ce0.jpg saved to cache
2026-01-29 06:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6382bce1-d32a-58ca-a715-2b2c7396dced
2026-01-29 06:01:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_960bda8c0335650dd9a0565cc43411ee.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f53ec50>
2026-01-29 06:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6382bce1-d32a-58ca-a715-2b2c7396dced/6382bce1-d32a-58ca-a715-2b2c7396dced_image_0.jpg HTTP/1.1" 201 0
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F93%252F9193e2d11d92bc64be9f8551fdcc6320%252Fpa%252FJH35342_be6ac4e6a52f25b204b7b11a0f8b284d.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_be6ac4e6a52f25b204b7b11a0f8b284d.jpg saved to cache
2026-01-29 06:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6382bce1-d32a-58ca-a715-2b2c7396dced
2026-01-29 06:01:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6382bce1-d32a-58ca-a715-2b2c7396dced, skipping ID generation
2026-01-29 06:01:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6382bce1-d32a-58ca-a715-2b2c7396dced with scrape type 1
2026-01-29 06:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6382bce1-d32a-58ca-a715-2b2c7396dced from tracking dictionaries
2026-01-29 06:01:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6382bce1-d32a-58ca-a715-2b2c7396dced sending to next pipeline
2026-01-29 06:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6382bce1-d32a-58ca-a715-2b2c7396dced, identifier: JH35342
2026-01-29 06:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c334e50>
2026-01-29 06:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_4.jpg HTTP/1.1" 201 0
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc3%252Fa3c34fd558c85022b27578a89e14f350%252Fpa%252FGG31907_28a1e3efc06052584b87dbf11f04d637.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_28a1e3efc06052584b87dbf11f04d637.jpg saved to cache
2026-01-29 06:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 723573d2-54ca-5b46-9891-b08194b3caf0
2026-01-29 06:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6382bce1-d32a-58ca-a715-2b2c7396dced with identifier: JH35342
2026-01-29 06:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6382bce1-d32a-58ca-a715-2b2c7396dced with identifier: JH35342
2026-01-29 06:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'crafter' containing 'crafter'
2026-01-29 06:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 6382bce1-d32a-58ca-a715-2b2c7396dced spider: auto1.fr
2026-01-29 06:01:57 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 6382bce1-d32a-58ca-a715-2b2c7396dced due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'crafter' containing 'crafter'
{'auction_title': '',
 'c_o_2_emission_value': 193,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:11:28Z',
 'fuel_type': 'diesel',
 'id': '6382bce1-d32a-58ca-a715-2b2c7396dced',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH35342',
 'listing': 'auction',
 'location': 'FR, Saint-Lô',
 'make': 'Volkswagen',
 'model': 'Crafter',
 'odometer': 99124,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6382bce1-d32a-58ca-a715-2b2c7396dced/6382bce1-d32a-58ca-a715-2b2c7396dced_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_be6ac4e6a52f25b204b7b11a0f8b284d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6382bce1-d32a-58ca-a715-2b2c7396dced/6382bce1-d32a-58ca-a715-2b2c7396dced_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_600dacc4e99d09d09bdc10c299381ce0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6382bce1-d32a-58ca-a715-2b2c7396dced/6382bce1-d32a-58ca-a715-2b2c7396dced_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_23a640fe5c95fa9b1b44e6b98013ab41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6382bce1-d32a-58ca-a715-2b2c7396dced/6382bce1-d32a-58ca-a715-2b2c7396dced_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_ba77e078b56683b204381e74613678ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6382bce1-d32a-58ca-a715-2b2c7396dced/6382bce1-d32a-58ca-a715-2b2c7396dced_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_e09102289d95f8131d6d955927f8d897.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6382bce1-d32a-58ca-a715-2b2c7396dced/6382bce1-d32a-58ca-a715-2b2c7396dced_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_af158b810be02e3855adc229e981f2ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6382bce1-d32a-58ca-a715-2b2c7396dced/6382bce1-d32a-58ca-a715-2b2c7396dced_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_94b58ddb275111a959d852dcdad71b17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6382bce1-d32a-58ca-a715-2b2c7396dced/6382bce1-d32a-58ca-a715-2b2c7396dced_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49447,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_ec2df915b5ac1a167b4f72a0291adf5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6382bce1-d32a-58ca-a715-2b2c7396dced/6382bce1-d32a-58ca-a715-2b2c7396dced_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_722e2fd69bf65092e5d3ff6698c5997f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6382bce1-d32a-58ca-a715-2b2c7396dced/6382bce1-d32a-58ca-a715-2b2c7396dced_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_069b83a902d1ae40113daa0bf37d87bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6382bce1-d32a-58ca-a715-2b2c7396dced/6382bce1-d32a-58ca-a715-2b2c7396dced_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_d0fa987a98802bbea27f7aa84610fa61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6382bce1-d32a-58ca-a715-2b2c7396dced/6382bce1-d32a-58ca-a715-2b2c7396dced_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59397,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_5b2f87c5a38f8b4be4ed331d9114dd92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6382bce1-d32a-58ca-a715-2b2c7396dced/6382bce1-d32a-58ca-a715-2b2c7396dced_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_f182774b792d3c328f67007bd2626956.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6382bce1-d32a-58ca-a715-2b2c7396dced/6382bce1-d32a-58ca-a715-2b2c7396dced_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_a68b4fe08ec445f2e2194b7821045152.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6382bce1-d32a-58ca-a715-2b2c7396dced/6382bce1-d32a-58ca-a715-2b2c7396dced_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_697f4314addd5ed5f3e051e9da654822.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6382bce1-d32a-58ca-a715-2b2c7396dced/6382bce1-d32a-58ca-a715-2b2c7396dced_image_15.png',
             'Extension': 'png',
             'FileSizeInBytes': 123172,
             'Height': 525,
             'OriginUrl': 'https://img-pa.auto1.com/img91/93/9193e2d11d92bc64be9f8551fdcc6320/pa/JH35342_1717d02284e2df740a4167cbbb97b5b8.png',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-26',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Volkswagen Crafter 2.0 TDI Kasten 30 mittellang FWD',
 'transmission': 'manual',
 'trim': 'Kasten 30 mittellang FWD',
 'year': 2017}
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JH35342%27 HTTP/1.1" 200 None
2026-01-29 06:01:57 [auto1.fr] INFO: Saving data for JH35342: {'created_time': 1769666517.661705, 'last_price_update_time': 1769666517.661715, 'auction_closing_time': 1769703088.0}
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JH35342') HTTP/1.1" 204 0
2026-01-29 06:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_756773cf9dc2b3f904b6cbb9fdb5a2d9.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_5f0375ad34dce18079603efa81c99fb4.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c09a350>
2026-01-29 06:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_3.jpg HTTP/1.1" 201 0
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc3%252Fa3c34fd558c85022b27578a89e14f350%252Fpa%252FGG31907_960bda8c0335650dd9a0565cc43411ee.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_960bda8c0335650dd9a0565cc43411ee.jpg saved to cache
2026-01-29 06:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 723573d2-54ca-5b46-9891-b08194b3caf0
2026-01-29 06:01:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 723573d2-54ca-5b46-9891-b08194b3caf0, skipping ID generation
2026-01-29 06:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 723573d2-54ca-5b46-9891-b08194b3caf0 with scrape type 1
2026-01-29 06:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 723573d2-54ca-5b46-9891-b08194b3caf0 from tracking dictionaries
2026-01-29 06:01:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 723573d2-54ca-5b46-9891-b08194b3caf0 sending to next pipeline
2026-01-29 06:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 723573d2-54ca-5b46-9891-b08194b3caf0, identifier: GG31907
2026-01-29 06:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 723573d2-54ca-5b46-9891-b08194b3caf0 with identifier: GG31907
2026-01-29 06:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 723573d2-54ca-5b46-9891-b08194b3caf0 with identifier: GG31907
2026-01-29 06:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'ds automobiles ds7 crossback 1.6 puretech performance line plus', 'price': 0, 'currency': 'eur', 'make': 'ds automobiles', 'model': 'ds7 crossback', 'transmission': 'automatic', 'odometer': 154682, 'odometer_reading_unit': 'km', 'registration_date': '2019-02-04', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gg31907', 'expiration_date': '2026-01-29t16:26:31z', 'origin_country_code': 'fr', 'trim': 'performance line plus', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 181, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.6l', 'location': 'fr, metz', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 132, 'id': '723573d2-54ca-5b46-9891-b08194b3caf0', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_cee6d230b28eef72d345247009acabd3.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76498}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_364195311ed170cac2f5c21584f128cb.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76474}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_6a9b48295fdf4945a92a87972b9afe0e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 77613}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_960bda8c0335650dd9a0565cc43411ee.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60630}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_28a1e3efc06052584b87dbf11f04d637.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70462}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_2381108fdb04fd8ee0d4e97104e963b1.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 85244}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_764245a32d885ca06f225d1fce83c1f8.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61807}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_e7affb7c5f5f29592d462f93e3530a0e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70734}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_c29ece51a9d0732a33c5fc22ad58e057.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 74146}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_544c1dc6bf517bd4efd06fb01754642f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 41527}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_0d1c53018b6ac04252ca002007e3ac84.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 54753}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_66a7303bb2b0ac6dfa95e8183eef2380.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 56482}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_fe045205d8d4c9df00cf6d523f61d06e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 53989}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_e2150f3c8e97196200484049d56e1aee.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 39403}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_2f49eebb59c8a3c577379e160de56eef.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 85628}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_ac70e1c458573e38c2ccba5b73c1c85e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63785}], 'current_year_diff': 7, 'age_in_months': 83, 'make_model': 'ds automobiles ds7 crossback', 'sanitized_make': 'dsautomobiles', 'odometer_in_km': 154682}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 83,
     'auction_title': '',
     'c_o_2_emission_value': 132,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.6l',
     'engine_horse_power': 181,
     'expiration_date': '2026-01-29t16:26:31z',
     'fuel_type': 'petrol',
     'id': '723573d2-54ca-5b46-9891-b08194b3caf0',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gg31907',
     'listing': 'auction',
     'location': 'fr, metz',
     'make': 'ds automobiles',
     'make_model': 'ds automobiles ds7 crossback',
     'model': 'ds7 crossback',
     'odometer': 154682,
     'odometer_in_km': 154682,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 16,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 76498,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_cee6d230b28eef72d345247009acabd3.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 76474,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_364195311ed170cac2f5c21584f128cb.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 77613,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_6a9b48295fdf4945a92a87972b9afe0e.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 60630,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_960bda8c0335650dd9a0565cc43411ee.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 70462,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_28a1e3efc06052584b87dbf11f04d637.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 85244,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_2381108fdb04fd8ee0d4e97104e963b1.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 61807,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_764245a32d885ca06f225d1fce83c1f8.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 70734,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_e7affb7c5f5f29592d462f93e3530a0e.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 74146,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_c29ece51a9d0732a33c5fc22ad58e057.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 41527,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_544c1dc6bf517bd4efd06fb01754642f.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 54753,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_0d1c53018b6ac04252ca002007e3ac84.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56482,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_66a7303bb2b0ac6dfa95e8183eef2380.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 53989,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_fe045205d8d4c9df00cf6d523f61d06e.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 39403,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_e2150f3c8e97196200484049d56e1aee.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 85628,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_2f49eebb59c8a3c577379e160de56eef.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 63785,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_ac70e1c458573e38c2ccba5b73c1c85e.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-02-04',
     'sanitized_make': 'dsautomobiles',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ds automobiles ds7 crossback 1.6 puretech performance line '
              'plus',
     'transmission': 'automatic',
     'trim': 'performance line plus',
     'year': 2019}
2026-01-29 06:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 723573d2-54ca-5b46-9891-b08194b3caf0 spider: auto1.fr
2026-01-29 06:01:58 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 723573d2-54ca-5b46-9891-b08194b3caf0 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'ds automobiles ds7 crossback 1.6 puretech performance line plus', 'price': 0, 'currency': 'eur', 'make': 'ds automobiles', 'model': 'ds7 crossback', 'transmission': 'automatic', 'odometer': 154682, 'odometer_reading_unit': 'km', 'registration_date': '2019-02-04', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gg31907', 'expiration_date': '2026-01-29t16:26:31z', 'origin_country_code': 'fr', 'trim': 'performance line plus', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 181, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.6l', 'location': 'fr, metz', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 132, 'id': '723573d2-54ca-5b46-9891-b08194b3caf0', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_cee6d230b28eef72d345247009acabd3.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76498}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_364195311ed170cac2f5c21584f128cb.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76474}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_6a9b48295fdf4945a92a87972b9afe0e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 77613}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_960bda8c0335650dd9a0565cc43411ee.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60630}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_28a1e3efc06052584b87dbf11f04d637.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70462}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_2381108fdb04fd8ee0d4e97104e963b1.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 85244}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_764245a32d885ca06f225d1fce83c1f8.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61807}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_e7affb7c5f5f29592d462f93e3530a0e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70734}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_c29ece51a9d0732a33c5fc22ad58e057.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 74146}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_544c1dc6bf517bd4efd06fb01754642f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 41527}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_0d1c53018b6ac04252ca002007e3ac84.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 54753}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_66a7303bb2b0ac6dfa95e8183eef2380.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 56482}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_fe045205d8d4c9df00cf6d523f61d06e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 53989}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_e2150f3c8e97196200484049d56e1aee.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 39403}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_2f49eebb59c8a3c577379e160de56eef.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 85628}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_ac70e1c458573e38c2ccba5b73c1c85e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63785}], 'current_year_diff': 7, 'age_in_months': 83, 'make_model': 'ds automobiles ds7 crossback', 'sanitized_make': 'dsautomobiles', 'odometer_in_km': 154682}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 83,
     'auction_title': '',
     'c_o_2_emission_value': 132,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.6l',
     'engine_horse_power': 181,
     'expiration_date': '2026-01-29t16:26:31z',
     'fuel_type': 'petrol',
     'id': '723573d2-54ca-5b46-9891-b08194b3caf0',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gg31907',
     'listing': 'auction',
     'location': 'fr, metz',
     'make': 'ds automobiles',
     'make_model': 'ds automobiles ds7 crossback',
     'model': 'ds7 crossback',
     'odometer': 154682,
     'odometer_in_km': 154682,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 16,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 76498,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_cee6d230b28eef72d345247009acabd3.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 76474,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_364195311ed170cac2f5c21584f128cb.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 77613,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_6a9b48295fdf4945a92a87972b9afe0e.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 60630,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_960bda8c0335650dd9a0565cc43411ee.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 70462,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_28a1e3efc06052584b87dbf11f04d637.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 85244,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_2381108fdb04fd8ee0d4e97104e963b1.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 61807,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_764245a32d885ca06f225d1fce83c1f8.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 70734,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_e7affb7c5f5f29592d462f93e3530a0e.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 74146,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_c29ece51a9d0732a33c5fc22ad58e057.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 41527,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_544c1dc6bf517bd4efd06fb01754642f.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 54753,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_0d1c53018b6ac04252ca002007e3ac84.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56482,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_66a7303bb2b0ac6dfa95e8183eef2380.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 53989,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_fe045205d8d4c9df00cf6d523f61d06e.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 39403,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_e2150f3c8e97196200484049d56e1aee.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 85628,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_2f49eebb59c8a3c577379e160de56eef.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 63785,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_ac70e1c458573e38c2ccba5b73c1c85e.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-02-04',
     'sanitized_make': 'dsautomobiles',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ds automobiles ds7 crossback 1.6 puretech performance line '
              'plus',
     'transmission': 'automatic',
     'trim': 'performance line plus',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 181,
 'expiration_date': '2026-01-29T16:26:31Z',
 'fuel_type': 'petrol',
 'id': '723573d2-54ca-5b46-9891-b08194b3caf0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG31907',
 'listing': 'auction',
 'location': 'FR, Metz',
 'make': 'DS Automobiles',
 'model': 'DS7 Crossback',
 'odometer': 154682,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_cee6d230b28eef72d345247009acabd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_364195311ed170cac2f5c21584f128cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_6a9b48295fdf4945a92a87972b9afe0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_960bda8c0335650dd9a0565cc43411ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_28a1e3efc06052584b87dbf11f04d637.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_2381108fdb04fd8ee0d4e97104e963b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_764245a32d885ca06f225d1fce83c1f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70734,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_e7affb7c5f5f29592d462f93e3530a0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_c29ece51a9d0732a33c5fc22ad58e057.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_544c1dc6bf517bd4efd06fb01754642f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_0d1c53018b6ac04252ca002007e3ac84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_66a7303bb2b0ac6dfa95e8183eef2380.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_fe045205d8d4c9df00cf6d523f61d06e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_e2150f3c8e97196200484049d56e1aee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_2f49eebb59c8a3c577379e160de56eef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723573d2-54ca-5b46-9891-b08194b3caf0/723573d2-54ca-5b46-9891-b08194b3caf0_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63785,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c3/a3c34fd558c85022b27578a89e14f350/pa/GG31907_ac70e1c458573e38c2ccba5b73c1c85e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS Automobiles DS7 Crossback 1.6 PureTech Performance Line Plus',
 'transmission': 'automatic',
 'trim': 'Performance Line Plus',
 'year': 2019}
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG31907%27 HTTP/1.1" 200 None
2026-01-29 06:01:58 [auto1.fr] INFO: Saving data for GG31907: {'created_time': 1769666518.432811, 'last_price_update_time': 1769666518.432821, 'auction_closing_time': 1769703991.0}
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GG31907') HTTP/1.1" 204 0
2026-01-29 06:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_d2b9723bed6d5da1e171386869893e50.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GZ75839/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EK56691> (referer: https://www.auto1.com/v1/car-details-view/EK56691/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_3eed1c454e9425286bfc29b455f5b1f5.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c2e7610>
2026-01-29 06:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c9707d0-c65d-56d5-9437-42b8754a3918/4c9707d0-c65d-56d5-9437-42b8754a3918_image_4.jpg HTTP/1.1" 201 0
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fd1%252Ff1d1a2e97d7c9518d5af363c281f6ee5%252Fpa%252FKW58357_756773cf9dc2b3f904b6cbb9fdb5a2d9.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_756773cf9dc2b3f904b6cbb9fdb5a2d9.jpg saved to cache
2026-01-29 06:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c9707d0-c65d-56d5-9437-42b8754a3918
2026-01-29 06:01:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c9707d0-c65d-56d5-9437-42b8754a3918, skipping ID generation
2026-01-29 06:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c9707d0-c65d-56d5-9437-42b8754a3918 with scrape type 1
2026-01-29 06:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4c9707d0-c65d-56d5-9437-42b8754a3918 from tracking dictionaries
2026-01-29 06:01:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c9707d0-c65d-56d5-9437-42b8754a3918 sending to next pipeline
2026-01-29 06:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4c9707d0-c65d-56d5-9437-42b8754a3918, identifier: KW58357
2026-01-29 06:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c335310>
2026-01-29 06:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_4.jpg HTTP/1.1" 201 0
2026-01-29 06:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F52%252F1a5219605f0ba0d9d1b8a2d791b1d90f%252Fpa%252FMJ86885_5f0375ad34dce18079603efa81c99fb4.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_5f0375ad34dce18079603efa81c99fb4.jpg saved to cache
2026-01-29 06:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2157061f-feee-5a6b-8ecd-1824baae5db4
2026-01-29 06:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4c9707d0-c65d-56d5-9437-42b8754a3918 with identifier: KW58357
2026-01-29 06:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4c9707d0-c65d-56d5-9437-42b8754a3918 with identifier: KW58357
2026-01-29 06:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'toyota' containing 'toyota' and model 'hilux' containing 'hilux'
2026-01-29 06:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 4c9707d0-c65d-56d5-9437-42b8754a3918 spider: auto1.fr
2026-01-29 06:01:59 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 4c9707d0-c65d-56d5-9437-42b8754a3918 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'toyota' containing 'toyota' and model 'hilux' containing 'hilux'
{'auction_title': '',
 'c_o_2_emission_value': 255,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:31:32Z',
 'fuel_type': 'diesel',
 'id': '4c9707d0-c65d-56d5-9437-42b8754a3918',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW58357',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Toyota',
 'model': 'Hilux',
 'odometer': 70955,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c9707d0-c65d-56d5-9437-42b8754a3918/4c9707d0-c65d-56d5-9437-42b8754a3918_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_e39a75c32f59498fdd11adfeaa2c3d82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c9707d0-c65d-56d5-9437-42b8754a3918/4c9707d0-c65d-56d5-9437-42b8754a3918_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_f8aed69519ab8bb10c84c5484d49588c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c9707d0-c65d-56d5-9437-42b8754a3918/4c9707d0-c65d-56d5-9437-42b8754a3918_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50572,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_2148422579898ec217e0d0bbf7895fdc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c9707d0-c65d-56d5-9437-42b8754a3918/4c9707d0-c65d-56d5-9437-42b8754a3918_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_8431e4f322c7aa9f6d21ac67f7262dc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c9707d0-c65d-56d5-9437-42b8754a3918/4c9707d0-c65d-56d5-9437-42b8754a3918_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48232,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_756773cf9dc2b3f904b6cbb9fdb5a2d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c9707d0-c65d-56d5-9437-42b8754a3918/4c9707d0-c65d-56d5-9437-42b8754a3918_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_d63cab32dfe4bccb6f6fe4ab81d87749.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c9707d0-c65d-56d5-9437-42b8754a3918/4c9707d0-c65d-56d5-9437-42b8754a3918_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_56662fe4bde51420fd332ea507e6deb8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c9707d0-c65d-56d5-9437-42b8754a3918/4c9707d0-c65d-56d5-9437-42b8754a3918_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_3691dce4658b1cf8221bbe1f07199a9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c9707d0-c65d-56d5-9437-42b8754a3918/4c9707d0-c65d-56d5-9437-42b8754a3918_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55647,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_95f1cbc3de318fee35870f30e29bca21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c9707d0-c65d-56d5-9437-42b8754a3918/4c9707d0-c65d-56d5-9437-42b8754a3918_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55836,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_c979430227bd1924df0c7f4a4ea01481.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c9707d0-c65d-56d5-9437-42b8754a3918/4c9707d0-c65d-56d5-9437-42b8754a3918_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_f7a1ca41e832503660c5e97169763351.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c9707d0-c65d-56d5-9437-42b8754a3918/4c9707d0-c65d-56d5-9437-42b8754a3918_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_a22b05333f0d837f46d3763abf100703.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c9707d0-c65d-56d5-9437-42b8754a3918/4c9707d0-c65d-56d5-9437-42b8754a3918_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_f393c6a24ab0044101c6df08aef2cef9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c9707d0-c65d-56d5-9437-42b8754a3918/4c9707d0-c65d-56d5-9437-42b8754a3918_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29592,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_4a2375543582080b497c6e77cb2e5598.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c9707d0-c65d-56d5-9437-42b8754a3918/4c9707d0-c65d-56d5-9437-42b8754a3918_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_9de109f10872988b94bcf14c583dbf66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c9707d0-c65d-56d5-9437-42b8754a3918/4c9707d0-c65d-56d5-9437-42b8754a3918_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/d1/f1d1a2e97d7c9518d5af363c281f6ee5/pa/KW58357_fce9cd399b993b5e0c70a90e5c84fa51.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-24',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Toyota Hilux 2.4 D-4D Extra Cab Comfort 4x4',
 'transmission': 'manual',
 'trim': 'Extra Cab Comfort 4x4',
 'year': 2020}
2026-01-29 06:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KW58357%27 HTTP/1.1" 200 None
2026-01-29 06:01:59 [auto1.fr] INFO: Saving data for KW58357: {'created_time': 1769666519.552977, 'last_price_update_time': 1769666519.552988, 'auction_closing_time': 1769704292.0}
2026-01-29 06:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KW58357') HTTP/1.1" 204 0
2026-01-29 06:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_6d8353bb12de2355be985ad1e8ac4327.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GN17831/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SV32349> (referer: https://www.auto1.com/v1/car-details-view/SV32349/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BM36001/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:01:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c062010>
2026-01-29 06:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_2.jpg HTTP/1.1" 201 0
2026-01-29 06:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F52%252F1a5219605f0ba0d9d1b8a2d791b1d90f%252Fpa%252FMJ86885_d2b9723bed6d5da1e171386869893e50.jpg') HTTP/1.1" 204 0
2026-01-29 06:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_d2b9723bed6d5da1e171386869893e50.jpg saved to cache
2026-01-29 06:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2157061f-feee-5a6b-8ecd-1824baae5db4
2026-01-29 06:01:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13bcd89a-e809-593e-9e17-60586737691f with identifier: EK56691
2026-01-29 06:01:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13bcd89a-e809-593e-9e17-60586737691f with scrape type 1
2026-01-29 06:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 13bcd89a-e809-593e-9e17-60586737691f
2026-01-29 06:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F67%252Fb46748a574ee174fd9b6e7cba83304f5%252Fpa%252FEK56691_3fe258c07e5dc0ae429c7b044ea6abe4.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_3fe258c07e5dc0ae429c7b044ea6abe4.jpg not downloaded yet
2026-01-29 06:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c0620d0>
2026-01-29 06:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_1.jpg HTTP/1.1" 201 0
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F52%252F1a5219605f0ba0d9d1b8a2d791b1d90f%252Fpa%252FMJ86885_3eed1c454e9425286bfc29b455f5b1f5.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_3eed1c454e9425286bfc29b455f5b1f5.jpg saved to cache
2026-01-29 06:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2157061f-feee-5a6b-8ecd-1824baae5db4
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F67%252Fb46748a574ee174fd9b6e7cba83304f5%252Fpa%252FEK56691_4910f6dfc479103863b02b84be4c1564.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_4910f6dfc479103863b02b84be4c1564.jpg not downloaded yet
2026-01-29 06:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YH47366> (referer: https://www.auto1.com/v1/car-details-view/YH47366/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RZ93074/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F67%252Fb46748a574ee174fd9b6e7cba83304f5%252Fpa%252FEK56691_0674dce35e9cfe37d688af3f9a42dc26.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_0674dce35e9cfe37d688af3f9a42dc26.jpg not downloaded yet
2026-01-29 06:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c283b50>
2026-01-29 06:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_0.jpg HTTP/1.1" 201 0
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F52%252F1a5219605f0ba0d9d1b8a2d791b1d90f%252Fpa%252FMJ86885_6d8353bb12de2355be985ad1e8ac4327.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_6d8353bb12de2355be985ad1e8ac4327.jpg saved to cache
2026-01-29 06:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2157061f-feee-5a6b-8ecd-1824baae5db4
2026-01-29 06:02:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2157061f-feee-5a6b-8ecd-1824baae5db4, skipping ID generation
2026-01-29 06:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2157061f-feee-5a6b-8ecd-1824baae5db4 with scrape type 1
2026-01-29 06:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2157061f-feee-5a6b-8ecd-1824baae5db4 from tracking dictionaries
2026-01-29 06:02:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2157061f-feee-5a6b-8ecd-1824baae5db4 sending to next pipeline
2026-01-29 06:02:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2157061f-feee-5a6b-8ecd-1824baae5db4, identifier: MJ86885
2026-01-29 06:02:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad00d6c0-100d-5991-81cd-3e20b8761556 with identifier: SV32349
2026-01-29 06:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad00d6c0-100d-5991-81cd-3e20b8761556 with scrape type 2
2026-01-29 06:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad00d6c0-100d-5991-81cd-3e20b8761556 with scrape type 2
2026-01-29 06:02:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ad00d6c0-100d-5991-81cd-3e20b8761556, identifier: SV32349
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F67%252Fb46748a574ee174fd9b6e7cba83304f5%252Fpa%252FEK56691_008b0cb9351cfa812d8b9e647c37106c.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_008b0cb9351cfa812d8b9e647c37106c.jpg not downloaded yet
2026-01-29 06:02:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2157061f-feee-5a6b-8ecd-1824baae5db4 with identifier: MJ86885
2026-01-29 06:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2157061f-feee-5a6b-8ecd-1824baae5db4 with identifier: MJ86885
2026-01-29 06:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'automatic', 'odometer': 64026, 'odometer_reading_unit': 'km', 'registration_date': '2018-01-18', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mj86885', 'expiration_date': '2026-01-29t16:04:43z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, valence', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 126, 'id': '2157061f-feee-5a6b-8ecd-1824baae5db4', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_6d8353bb12de2355be985ad1e8ac4327.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 71341}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_3eed1c454e9425286bfc29b455f5b1f5.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70027}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_d2b9723bed6d5da1e171386869893e50.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 74495}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_9629db44f0d417888b097e8edb8ea66c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60997}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_5f0375ad34dce18079603efa81c99fb4.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65134}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_4177dc60a2a2e2621280730c6bb6616e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 72240}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_3c36ea22b86aa26a2cbbdc6db5e39a98.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 55597}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_c1571d950cbe70b3ecedb234d9e8ae02.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66914}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_2b615445e80f61a6a007d1f0d443059d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 64278}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_c393c8d6b05ec3391ee2042774cc2d2c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62961}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_eb3ae2cca46f5441980df1d674301286.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58496}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_a017f58076b8680971a3e3b44a1574f6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 51858}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_689d4ac093c78a54f7a37e99cab2e6ef.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62857}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_59c717bb3e73e2c881b9c097b5670a67.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 45685}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_4ac30f6dc26360cad0e18132b04b2244.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 83988}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_b359c5bfe962a5b3dee6c7485a4711ab.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 106009}], 'current_year_diff': 8, 'age_in_months': 96, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 64026}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 96,
     'auction_title': '',
     'c_o_2_emission_value': 126,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:04:43z',
     'fuel_type': 'petrol',
     'id': '2157061f-feee-5a6b-8ecd-1824baae5db4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mj86885',
     'listing': 'auction',
     'location': 'fr, valence',
     'make': 'citroen',
     'make_model': 'citroen c3 aircross',
     'model': 'c3 aircross',
     'odometer': 64026,
     'odometer_in_km': 64026,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 16,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 71341,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_6d8353bb12de2355be985ad1e8ac4327.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 70027,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_3eed1c454e9425286bfc29b455f5b1f5.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 74495,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_d2b9723bed6d5da1e171386869893e50.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 60997,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_9629db44f0d417888b097e8edb8ea66c.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 65134,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_5f0375ad34dce18079603efa81c99fb4.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 72240,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_4177dc60a2a2e2621280730c6bb6616e.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 55597,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_3c36ea22b86aa26a2cbbdc6db5e39a98.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 66914,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_c1571d950cbe70b3ecedb234d9e8ae02.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 64278,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_2b615445e80f61a6a007d1f0d443059d.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 62961,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_c393c8d6b05ec3391ee2042774cc2d2c.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 58496,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_eb3ae2cca46f5441980df1d674301286.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51858,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_a017f58076b8680971a3e3b44a1574f6.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 62857,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_689d4ac093c78a54f7a37e99cab2e6ef.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45685,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_59c717bb3e73e2c881b9c097b5670a67.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 83988,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_4ac30f6dc26360cad0e18132b04b2244.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_15.png',
                 'Extension': 'png',
                 'FileSizeInBytes': 106009,
                 'Height': 525,
                 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_b359c5bfe962a5b3dee6c7485a4711ab.png',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-01-18',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 aircross 1.2 puretech shine',
     'transmission': 'automatic',
     'trim': 'shine',
     'year': 2018}
2026-01-29 06:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 2157061f-feee-5a6b-8ecd-1824baae5db4 spider: auto1.fr
2026-01-29 06:02:01 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 2157061f-feee-5a6b-8ecd-1824baae5db4 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'automatic', 'odometer': 64026, 'odometer_reading_unit': 'km', 'registration_date': '2018-01-18', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mj86885', 'expiration_date': '2026-01-29t16:04:43z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, valence', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 126, 'id': '2157061f-feee-5a6b-8ecd-1824baae5db4', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_6d8353bb12de2355be985ad1e8ac4327.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 71341}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_3eed1c454e9425286bfc29b455f5b1f5.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70027}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_d2b9723bed6d5da1e171386869893e50.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 74495}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_9629db44f0d417888b097e8edb8ea66c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60997}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_5f0375ad34dce18079603efa81c99fb4.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65134}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_4177dc60a2a2e2621280730c6bb6616e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 72240}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_3c36ea22b86aa26a2cbbdc6db5e39a98.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 55597}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_c1571d950cbe70b3ecedb234d9e8ae02.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66914}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_2b615445e80f61a6a007d1f0d443059d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 64278}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_c393c8d6b05ec3391ee2042774cc2d2c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62961}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_eb3ae2cca46f5441980df1d674301286.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58496}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_a017f58076b8680971a3e3b44a1574f6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 51858}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_689d4ac093c78a54f7a37e99cab2e6ef.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62857}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_59c717bb3e73e2c881b9c097b5670a67.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 45685}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_4ac30f6dc26360cad0e18132b04b2244.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 83988}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_b359c5bfe962a5b3dee6c7485a4711ab.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 106009}], 'current_year_diff': 8, 'age_in_months': 96, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 64026}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 96,
     'auction_title': '',
     'c_o_2_emission_value': 126,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:04:43z',
     'fuel_type': 'petrol',
     'id': '2157061f-feee-5a6b-8ecd-1824baae5db4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mj86885',
     'listing': 'auction',
     'location': 'fr, valence',
     'make': 'citroen',
     'make_model': 'citroen c3 aircross',
     'model': 'c3 aircross',
     'odometer': 64026,
     'odometer_in_km': 64026,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 16,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 71341,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_6d8353bb12de2355be985ad1e8ac4327.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 70027,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_3eed1c454e9425286bfc29b455f5b1f5.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 74495,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_d2b9723bed6d5da1e171386869893e50.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 60997,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_9629db44f0d417888b097e8edb8ea66c.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 65134,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_5f0375ad34dce18079603efa81c99fb4.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 72240,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_4177dc60a2a2e2621280730c6bb6616e.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 55597,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_3c36ea22b86aa26a2cbbdc6db5e39a98.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 66914,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_c1571d950cbe70b3ecedb234d9e8ae02.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 64278,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_2b615445e80f61a6a007d1f0d443059d.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 62961,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_c393c8d6b05ec3391ee2042774cc2d2c.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 58496,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_eb3ae2cca46f5441980df1d674301286.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51858,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_a017f58076b8680971a3e3b44a1574f6.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 62857,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_689d4ac093c78a54f7a37e99cab2e6ef.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45685,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_59c717bb3e73e2c881b9c097b5670a67.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 83988,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_4ac30f6dc26360cad0e18132b04b2244.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_15.png',
                 'Extension': 'png',
                 'FileSizeInBytes': 106009,
                 'Height': 525,
                 'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_b359c5bfe962a5b3dee6c7485a4711ab.png',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-01-18',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 aircross 1.2 puretech shine',
     'transmission': 'automatic',
     'trim': 'shine',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:04:43Z',
 'fuel_type': 'petrol',
 'id': '2157061f-feee-5a6b-8ecd-1824baae5db4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ86885',
 'listing': 'auction',
 'location': 'FR, Valence',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 64026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_6d8353bb12de2355be985ad1e8ac4327.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_3eed1c454e9425286bfc29b455f5b1f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_d2b9723bed6d5da1e171386869893e50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60997,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_9629db44f0d417888b097e8edb8ea66c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_5f0375ad34dce18079603efa81c99fb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_4177dc60a2a2e2621280730c6bb6616e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55597,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_3c36ea22b86aa26a2cbbdc6db5e39a98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66914,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_c1571d950cbe70b3ecedb234d9e8ae02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_2b615445e80f61a6a007d1f0d443059d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62961,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_c393c8d6b05ec3391ee2042774cc2d2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_eb3ae2cca46f5441980df1d674301286.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_a017f58076b8680971a3e3b44a1574f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_689d4ac093c78a54f7a37e99cab2e6ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45685,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_59c717bb3e73e2c881b9c097b5670a67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83988,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_4ac30f6dc26360cad0e18132b04b2244.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2157061f-feee-5a6b-8ecd-1824baae5db4/2157061f-feee-5a6b-8ecd-1824baae5db4_image_15.png',
             'Extension': 'png',
             'FileSizeInBytes': 106009,
             'Height': 525,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/52/1a5219605f0ba0d9d1b8a2d791b1d90f/pa/MJ86885_b359c5bfe962a5b3dee6c7485a4711ab.png',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2018}
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MJ86885%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.fr] INFO: Saving data for MJ86885: {'created_time': 1769666521.527438, 'last_price_update_time': 1769666521.527449, 'auction_closing_time': 1769702683.0}
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MJ86885') HTTP/1.1" 204 0
2026-01-29 06:02:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ad00d6c0-100d-5991-81cd-3e20b8761556 with identifier: SV32349
2026-01-29 06:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ad00d6c0-100d-5991-81cd-3e20b8761556 with identifier: SV32349
2026-01-29 06:02:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ad00d6c0-100d-5991-81cd-3e20b8761556 with identifier: SV32349 to the API
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SV32349>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:26:07Z',
 'fuel_type': 'diesel',
 'id': 'ad00d6c0-100d-5991-81cd-3e20b8761556',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV32349',
 'listing': 'auction',
 'location': 'FR, Quincieux',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 116711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2018}
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV32349%27 HTTP/1.1" 200 None
2026-01-29 06:02:01 [auto1.fr] INFO: Saving data for SV32349: {'auction_closing_time': 1769703967.0, 'created_time': 1768326090.21165, 'last_price_update_time': 1769666521.997471}
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SV32349') HTTP/1.1" 204 0
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F67%252Fb46748a574ee174fd9b6e7cba83304f5%252Fpa%252FEK56691_4b1432f0ca45402435dc49eb6d49070f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_4b1432f0ca45402435dc49eb6d49070f.jpg not downloaded yet
2026-01-29 06:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NJ96560/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MP03922/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZF28512/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c00b751-7816-56cb-ba76-52a4c01c1d79 with identifier: YH47366
2026-01-29 06:02:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c00b751-7816-56cb-ba76-52a4c01c1d79 with scrape type 1
2026-01-29 06:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 4c00b751-7816-56cb-ba76-52a4c01c1d79
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F2b%252Fe12b206cfa1533c3ecf5552525f80d6b%252Fpa%252FYH47366_f04568a87485228ddfb6bbbe5bd23c5e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_f04568a87485228ddfb6bbbe5bd23c5e.jpg not downloaded yet
2026-01-29 06:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_cb03e9e36e2e94aa04aef2ad4c7c7154.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_3fe258c07e5dc0ae429c7b044ea6abe4.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F67%252Fb46748a574ee174fd9b6e7cba83304f5%252Fpa%252FEK56691_a25bf8debe19f45ed908db371d8beb21.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_a25bf8debe19f45ed908db371d8beb21.jpg not downloaded yet
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F2b%252Fe12b206cfa1533c3ecf5552525f80d6b%252Fpa%252FYH47366_de1dfd0ca53d06674f6e999feff372d8.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_de1dfd0ca53d06674f6e999feff372d8.jpg not downloaded yet
2026-01-29 06:02:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_fb492343f743942191f3ea02db2c5d53.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F67%252Fb46748a574ee174fd9b6e7cba83304f5%252Fpa%252FEK56691_f890cdede714ab0fe010aececb456bef.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_f890cdede714ab0fe010aececb456bef.jpg not downloaded yet
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F2b%252Fe12b206cfa1533c3ecf5552525f80d6b%252Fpa%252FYH47366_e706d8456cf74eb4ba4e6330f493a596.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_e706d8456cf74eb4ba4e6330f493a596.jpg not downloaded yet
2026-01-29 06:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_4910f6dfc479103863b02b84be4c1564.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_008b0cb9351cfa812d8b9e647c37106c.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F67%252Fb46748a574ee174fd9b6e7cba83304f5%252Fpa%252FEK56691_3fe4d0f3821063237b5ab7c2fef83eb5.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_3fe4d0f3821063237b5ab7c2fef83eb5.jpg not downloaded yet
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F2b%252Fe12b206cfa1533c3ecf5552525f80d6b%252Fpa%252FYH47366_369351e4a43c5f6a1348674d9a26e87b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_369351e4a43c5f6a1348674d9a26e87b.jpg not downloaded yet
2026-01-29 06:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_dac49c1e24e65753db844d37ce93add8.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F67%252Fb46748a574ee174fd9b6e7cba83304f5%252Fpa%252FEK56691_527501bb2cbaf6ea5e17c8b974c0749b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_527501bb2cbaf6ea5e17c8b974c0749b.jpg not downloaded yet
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F2b%252Fe12b206cfa1533c3ecf5552525f80d6b%252Fpa%252FYH47366_b1174aa405d523b0c5c63b7d8fb469d5.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_b1174aa405d523b0c5c63b7d8fb469d5.jpg not downloaded yet
2026-01-29 06:02:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-29 06:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f42e450>
2026-01-29 06:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_8.jpg HTTP/1.1" 201 0
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fa3%252F69a3ca5264c91412308607fa14a59748%252Fpa%252FFK20372_cb03e9e36e2e94aa04aef2ad4c7c7154.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_cb03e9e36e2e94aa04aef2ad4c7c7154.jpg saved to cache
2026-01-29 06:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 003b4ab1-45b7-5fd6-804c-b72bc20afc24
2026-01-29 06:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f411cd0>
2026-01-29 06:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13bcd89a-e809-593e-9e17-60586737691f/13bcd89a-e809-593e-9e17-60586737691f_image_0.jpg HTTP/1.1" 201 0
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F67%252Fb46748a574ee174fd9b6e7cba83304f5%252Fpa%252FEK56691_3fe258c07e5dc0ae429c7b044ea6abe4.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_3fe258c07e5dc0ae429c7b044ea6abe4.jpg saved to cache
2026-01-29 06:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13bcd89a-e809-593e-9e17-60586737691f
2026-01-29 06:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_0674dce35e9cfe37d688af3f9a42dc26.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F67%252Fb46748a574ee174fd9b6e7cba83304f5%252Fpa%252FEK56691_b2192179bbc3d11d840737ad56b9cc23.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_b2192179bbc3d11d840737ad56b9cc23.jpg not downloaded yet
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F2b%252Fe12b206cfa1533c3ecf5552525f80d6b%252Fpa%252FYH47366_79b47820910fa86340988461c7147e5a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_79b47820910fa86340988461c7147e5a.jpg not downloaded yet
2026-01-29 06:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ML57809/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NP09597/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AC35213/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PX46861/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JY05541/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-29 06:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff18ed0>
2026-01-29 06:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_7.jpg HTTP/1.1" 201 0
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fa3%252F69a3ca5264c91412308607fa14a59748%252Fpa%252FFK20372_fb492343f743942191f3ea02db2c5d53.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_fb492343f743942191f3ea02db2c5d53.jpg saved to cache
2026-01-29 06:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 003b4ab1-45b7-5fd6-804c-b72bc20afc24
2026-01-29 06:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c128410>
2026-01-29 06:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13bcd89a-e809-593e-9e17-60586737691f/13bcd89a-e809-593e-9e17-60586737691f_image_1.jpg HTTP/1.1" 201 0
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F67%252Fb46748a574ee174fd9b6e7cba83304f5%252Fpa%252FEK56691_4910f6dfc479103863b02b84be4c1564.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_4910f6dfc479103863b02b84be4c1564.jpg saved to cache
2026-01-29 06:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 13bcd89a-e809-593e-9e17-60586737691f
2026-01-29 06:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff64dd0>
2026-01-29 06:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13bcd89a-e809-593e-9e17-60586737691f/13bcd89a-e809-593e-9e17-60586737691f_image_3.jpg HTTP/1.1" 201 0
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F67%252Fb46748a574ee174fd9b6e7cba83304f5%252Fpa%252FEK56691_008b0cb9351cfa812d8b9e647c37106c.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_008b0cb9351cfa812d8b9e647c37106c.jpg saved to cache
2026-01-29 06:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 13bcd89a-e809-593e-9e17-60586737691f
2026-01-29 06:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-29 06:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c31c5d0>
2026-01-29 06:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_6.jpg HTTP/1.1" 201 0
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fa3%252F69a3ca5264c91412308607fa14a59748%252Fpa%252FFK20372_dac49c1e24e65753db844d37ce93add8.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_dac49c1e24e65753db844d37ce93add8.jpg saved to cache
2026-01-29 06:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 003b4ab1-45b7-5fd6-804c-b72bc20afc24
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F67%252Fb46748a574ee174fd9b6e7cba83304f5%252Fpa%252FEK56691_b128379f704a2ba660fd065a1b36267f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_b128379f704a2ba660fd065a1b36267f.jpg not downloaded yet
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F2b%252Fe12b206cfa1533c3ecf5552525f80d6b%252Fpa%252FYH47366_51bd32dd5abe0b62104b69030bf6f0ad.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_51bd32dd5abe0b62104b69030bf6f0ad.jpg not downloaded yet
2026-01-29 06:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_e9cda09f92ac169372c962eb9cec6a19.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F67%252Fb46748a574ee174fd9b6e7cba83304f5%252Fpa%252FEK56691_ae63adfd0edd2c16045d0a7a16366dfc.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_ae63adfd0edd2c16045d0a7a16366dfc.jpg not downloaded yet
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F2b%252Fe12b206cfa1533c3ecf5552525f80d6b%252Fpa%252FYH47366_bcbafa5abbe76e5f0abe6c95b0e706aa.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_bcbafa5abbe76e5f0abe6c95b0e706aa.jpg not downloaded yet
2026-01-29 06:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c259f50>
2026-01-29 06:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13bcd89a-e809-593e-9e17-60586737691f/13bcd89a-e809-593e-9e17-60586737691f_image_2.jpg HTTP/1.1" 201 0
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F67%252Fb46748a574ee174fd9b6e7cba83304f5%252Fpa%252FEK56691_0674dce35e9cfe37d688af3f9a42dc26.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_0674dce35e9cfe37d688af3f9a42dc26.jpg saved to cache
2026-01-29 06:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 13bcd89a-e809-593e-9e17-60586737691f
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F67%252Fb46748a574ee174fd9b6e7cba83304f5%252Fpa%252FEK56691_f373492c665127344828ba8a55bf9c2a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_f373492c665127344828ba8a55bf9c2a.jpg not downloaded yet
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F2b%252Fe12b206cfa1533c3ecf5552525f80d6b%252Fpa%252FYH47366_796ea56647ad213834d5dc32d624a051.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_796ea56647ad213834d5dc32d624a051.jpg not downloaded yet
2026-01-29 06:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_2d8c239d5300fb8ce73a22f68ac01d4d.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-29 06:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c0c32d0>
2026-01-29 06:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_5.jpg HTTP/1.1" 201 0
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fa3%252F69a3ca5264c91412308607fa14a59748%252Fpa%252FFK20372_e9cda09f92ac169372c962eb9cec6a19.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_e9cda09f92ac169372c962eb9cec6a19.jpg saved to cache
2026-01-29 06:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 003b4ab1-45b7-5fd6-804c-b72bc20afc24
2026-01-29 06:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_bbf5ef85f9c3feb0f461975f833db6c8.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_b128379f704a2ba660fd065a1b36267f.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_b2192179bbc3d11d840737ad56b9cc23.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_51bd32dd5abe0b62104b69030bf6f0ad.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F67%252Fb46748a574ee174fd9b6e7cba83304f5%252Fpa%252FEK56691_015f9a230ae6e2af32acac052dcac77a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_015f9a230ae6e2af32acac052dcac77a.jpg not downloaded yet
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F2b%252Fe12b206cfa1533c3ecf5552525f80d6b%252Fpa%252FYH47366_477e574bf0b311a9934f9113fecaf234.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_477e574bf0b311a9934f9113fecaf234.jpg not downloaded yet
2026-01-29 06:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_79b47820910fa86340988461c7147e5a.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_b1174aa405d523b0c5c63b7d8fb469d5.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_527501bb2cbaf6ea5e17c8b974c0749b.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F67%252Fb46748a574ee174fd9b6e7cba83304f5%252Fpa%252FEK56691_8970d2032b3708ed81fe6eb74d52ffea.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_8970d2032b3708ed81fe6eb74d52ffea.jpg not downloaded yet
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F2b%252Fe12b206cfa1533c3ecf5552525f80d6b%252Fpa%252FYH47366_26582d27b1caa52c87395f62a1aa772f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_26582d27b1caa52c87395f62a1aa772f.jpg not downloaded yet
2026-01-29 06:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GN17831> (referer: https://www.auto1.com/v1/car-details-view/GN17831/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RZ93074> (referer: https://www.auto1.com/v1/car-details-view/RZ93074/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BM36001> (referer: https://www.auto1.com/v1/car-details-view/BM36001/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-29 06:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6feddb50>
2026-01-29 06:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_4.jpg HTTP/1.1" 201 0
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fa3%252F69a3ca5264c91412308607fa14a59748%252Fpa%252FFK20372_2d8c239d5300fb8ce73a22f68ac01d4d.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_2d8c239d5300fb8ce73a22f68ac01d4d.jpg saved to cache
2026-01-29 06:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 003b4ab1-45b7-5fd6-804c-b72bc20afc24
2026-01-29 06:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_3fe4d0f3821063237b5ab7c2fef83eb5.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_369351e4a43c5f6a1348674d9a26e87b.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F67%252Fb46748a574ee174fd9b6e7cba83304f5%252Fpa%252FEK56691_624a5562668e7ba5c3947e5b98176fff.png%27 HTTP/1.1" 200 None
2026-01-29 06:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_624a5562668e7ba5c3947e5b98176fff.png not downloaded yet
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F2b%252Fe12b206cfa1533c3ecf5552525f80d6b%252Fpa%252FYH47366_c8973121d871f6ab503710dfcf1d00b7.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_c8973121d871f6ab503710dfcf1d00b7.jpg not downloaded yet
2026-01-29 06:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F2b%252Fe12b206cfa1533c3ecf5552525f80d6b%252Fpa%252FYH47366_36118053c1005009ce724ffb72da4507.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_36118053c1005009ce724ffb72da4507.jpg not downloaded yet
2026-01-29 06:02:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-29 06:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f32dd10>
2026-01-29 06:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_3.jpg HTTP/1.1" 201 0
2026-01-29 06:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fa3%252F69a3ca5264c91412308607fa14a59748%252Fpa%252FFK20372_bbf5ef85f9c3feb0f461975f833db6c8.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_bbf5ef85f9c3feb0f461975f833db6c8.jpg saved to cache
2026-01-29 06:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 003b4ab1-45b7-5fd6-804c-b72bc20afc24
2026-01-29 06:02:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 003b4ab1-45b7-5fd6-804c-b72bc20afc24, skipping ID generation
2026-01-29 06:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 003b4ab1-45b7-5fd6-804c-b72bc20afc24 with scrape type 1
2026-01-29 06:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 003b4ab1-45b7-5fd6-804c-b72bc20afc24 from tracking dictionaries
2026-01-29 06:02:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 003b4ab1-45b7-5fd6-804c-b72bc20afc24 sending to next pipeline
2026-01-29 06:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 003b4ab1-45b7-5fd6-804c-b72bc20afc24, identifier: FK20372
2026-01-29 06:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f568510>
2026-01-29 06:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13bcd89a-e809-593e-9e17-60586737691f/13bcd89a-e809-593e-9e17-60586737691f_image_10.jpg HTTP/1.1" 201 0
2026-01-29 06:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F67%252Fb46748a574ee174fd9b6e7cba83304f5%252Fpa%252FEK56691_b128379f704a2ba660fd065a1b36267f.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_b128379f704a2ba660fd065a1b36267f.jpg saved to cache
2026-01-29 06:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 13bcd89a-e809-593e-9e17-60586737691f
2026-01-29 06:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6fe5dc50>
2026-01-29 06:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13bcd89a-e809-593e-9e17-60586737691f/13bcd89a-e809-593e-9e17-60586737691f_image_9.jpg HTTP/1.1" 201 0
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F67%252Fb46748a574ee174fd9b6e7cba83304f5%252Fpa%252FEK56691_b2192179bbc3d11d840737ad56b9cc23.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_b2192179bbc3d11d840737ad56b9cc23.jpg saved to cache
2026-01-29 06:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 13bcd89a-e809-593e-9e17-60586737691f
2026-01-29 06:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ffd2290>
2026-01-29 06:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c00b751-7816-56cb-ba76-52a4c01c1d79/4c00b751-7816-56cb-ba76-52a4c01c1d79_image_6.jpg HTTP/1.1" 201 0
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F2b%252Fe12b206cfa1533c3ecf5552525f80d6b%252Fpa%252FYH47366_51bd32dd5abe0b62104b69030bf6f0ad.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_51bd32dd5abe0b62104b69030bf6f0ad.jpg saved to cache
2026-01-29 06:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4c00b751-7816-56cb-ba76-52a4c01c1d79
2026-01-29 06:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6fffe3d0>
2026-01-29 06:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c00b751-7816-56cb-ba76-52a4c01c1d79/4c00b751-7816-56cb-ba76-52a4c01c1d79_image_5.jpg HTTP/1.1" 201 0
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F2b%252Fe12b206cfa1533c3ecf5552525f80d6b%252Fpa%252FYH47366_79b47820910fa86340988461c7147e5a.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_79b47820910fa86340988461c7147e5a.jpg saved to cache
2026-01-29 06:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4c00b751-7816-56cb-ba76-52a4c01c1d79
2026-01-29 06:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c043e90>
2026-01-29 06:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c00b751-7816-56cb-ba76-52a4c01c1d79/4c00b751-7816-56cb-ba76-52a4c01c1d79_image_4.jpg HTTP/1.1" 201 0
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F2b%252Fe12b206cfa1533c3ecf5552525f80d6b%252Fpa%252FYH47366_b1174aa405d523b0c5c63b7d8fb469d5.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_b1174aa405d523b0c5c63b7d8fb469d5.jpg saved to cache
2026-01-29 06:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c00b751-7816-56cb-ba76-52a4c01c1d79
2026-01-29 06:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6feef610>
2026-01-29 06:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13bcd89a-e809-593e-9e17-60586737691f/13bcd89a-e809-593e-9e17-60586737691f_image_8.jpg HTTP/1.1" 201 0
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F67%252Fb46748a574ee174fd9b6e7cba83304f5%252Fpa%252FEK56691_527501bb2cbaf6ea5e17c8b974c0749b.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_527501bb2cbaf6ea5e17c8b974c0749b.jpg saved to cache
2026-01-29 06:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 13bcd89a-e809-593e-9e17-60586737691f
2026-01-29 06:02:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3bf6fe6-9cf7-59fc-845b-bceea0be8888 with identifier: GN17831
2026-01-29 06:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3bf6fe6-9cf7-59fc-845b-bceea0be8888 with scrape type 2
2026-01-29 06:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3bf6fe6-9cf7-59fc-845b-bceea0be8888 with scrape type 2
2026-01-29 06:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e3bf6fe6-9cf7-59fc-845b-bceea0be8888, identifier: GN17831
2026-01-29 06:02:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcc8084e-789c-5115-97f0-5d9b8902d0da with identifier: RZ93074
2026-01-29 06:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcc8084e-789c-5115-97f0-5d9b8902d0da with scrape type 2
2026-01-29 06:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcc8084e-789c-5115-97f0-5d9b8902d0da with scrape type 2
2026-01-29 06:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: dcc8084e-789c-5115-97f0-5d9b8902d0da, identifier: RZ93074
2026-01-29 06:02:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c07f14c0-e576-59f4-994c-0b52a281c16d with identifier: BM36001
2026-01-29 06:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c07f14c0-e576-59f4-994c-0b52a281c16d with scrape type 2
2026-01-29 06:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c07f14c0-e576-59f4-994c-0b52a281c16d with scrape type 2
2026-01-29 06:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c07f14c0-e576-59f4-994c-0b52a281c16d, identifier: BM36001
2026-01-29 06:02:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 003b4ab1-45b7-5fd6-804c-b72bc20afc24 with identifier: FK20372
2026-01-29 06:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 003b4ab1-45b7-5fd6-804c-b72bc20afc24 with identifier: FK20372
2026-01-29 06:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech gt pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 68879, 'odometer_reading_unit': 'km', 'registration_date': '2022-01-10', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fk20372', 'expiration_date': '2026-01-29t16:11:28z', 'origin_country_code': 'fr', 'trim': 'gt pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, metz', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 146, 'id': '003b4ab1-45b7-5fd6-804c-b72bc20afc24', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_859ade7e831a82007eebbe0e21ff38d0.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2848020}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_5af40c442df484a387ed1e6d22aa3815.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2756830}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_998ac03a5d7a79ca65c121f90416488e.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2949068}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_bbf5ef85f9c3feb0f461975f833db6c8.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2855855}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_2d8c239d5300fb8ce73a22f68ac01d4d.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2860085}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_e9cda09f92ac169372c962eb9cec6a19.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2867396}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_dac49c1e24e65753db844d37ce93add8.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2694853}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_fb492343f743942191f3ea02db2c5d53.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2647163}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_cb03e9e36e2e94aa04aef2ad4c7c7154.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2679778}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_542f2cad218469584871c937b14e637d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57982}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_f78ee62924f3893acb248be4ce5694a7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61295}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_770c96fb128e8b8f14847124a2f64cfc.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63737}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_45b00d78a373d6e3df63f2e1ff883481.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66759}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_72b8de5875079e3d2a0de339ed58e8e2.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 56523}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_017e04db67e0a1e68b72c53e253cb933.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61450}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_f4e876b77280bd99f27e62db347d957d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66695}], 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 68879}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': 146,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:11:28z',
     'fuel_type': 'petrol',
     'id': '003b4ab1-45b7-5fd6-804c-b72bc20afc24',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fk20372',
     'listing': 'auction',
     'location': 'fr, metz',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 68879,
     'odometer_in_km': 68879,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 16,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 2848020,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_859ade7e831a82007eebbe0e21ff38d0.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 2756830,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_5af40c442df484a387ed1e6d22aa3815.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 2949068,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_998ac03a5d7a79ca65c121f90416488e.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 2855855,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_bbf5ef85f9c3feb0f461975f833db6c8.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 2860085,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_2d8c239d5300fb8ce73a22f68ac01d4d.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 2867396,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_e9cda09f92ac169372c962eb9cec6a19.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 2694853,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_dac49c1e24e65753db844d37ce93add8.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 2647163,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_fb492343f743942191f3ea02db2c5d53.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 2679778,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_cb03e9e36e2e94aa04aef2ad4c7c7154.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57982,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_542f2cad218469584871c937b14e637d.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 61295,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_f78ee62924f3893acb248be4ce5694a7.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 63737,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_770c96fb128e8b8f14847124a2f64cfc.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 66759,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_45b00d78a373d6e3df63f2e1ff883481.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56523,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_72b8de5875079e3d2a0de339ed58e8e2.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 61450,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_017e04db67e0a1e68b72c53e253cb933.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 66695,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_f4e876b77280bd99f27e62db347d957d.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-01-10',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 puretech gt pack',
     'transmission': 'automatic',
     'trim': 'gt pack',
     'year': 2022}
2026-01-29 06:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 003b4ab1-45b7-5fd6-804c-b72bc20afc24 spider: auto1.fr
2026-01-29 06:02:10 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 003b4ab1-45b7-5fd6-804c-b72bc20afc24 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech gt pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 68879, 'odometer_reading_unit': 'km', 'registration_date': '2022-01-10', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fk20372', 'expiration_date': '2026-01-29t16:11:28z', 'origin_country_code': 'fr', 'trim': 'gt pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, metz', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 146, 'id': '003b4ab1-45b7-5fd6-804c-b72bc20afc24', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_859ade7e831a82007eebbe0e21ff38d0.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2848020}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_5af40c442df484a387ed1e6d22aa3815.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2756830}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_998ac03a5d7a79ca65c121f90416488e.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2949068}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_bbf5ef85f9c3feb0f461975f833db6c8.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2855855}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_2d8c239d5300fb8ce73a22f68ac01d4d.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2860085}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_e9cda09f92ac169372c962eb9cec6a19.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2867396}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_dac49c1e24e65753db844d37ce93add8.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2694853}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_fb492343f743942191f3ea02db2c5d53.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2647163}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_cb03e9e36e2e94aa04aef2ad4c7c7154.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2679778}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_542f2cad218469584871c937b14e637d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57982}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_f78ee62924f3893acb248be4ce5694a7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61295}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_770c96fb128e8b8f14847124a2f64cfc.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63737}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_45b00d78a373d6e3df63f2e1ff883481.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66759}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_72b8de5875079e3d2a0de339ed58e8e2.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 56523}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_017e04db67e0a1e68b72c53e253cb933.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 61450}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_f4e876b77280bd99f27e62db347d957d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66695}], 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 68879}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': 146,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:11:28z',
     'fuel_type': 'petrol',
     'id': '003b4ab1-45b7-5fd6-804c-b72bc20afc24',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fk20372',
     'listing': 'auction',
     'location': 'fr, metz',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 68879,
     'odometer_in_km': 68879,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 16,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 2848020,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_859ade7e831a82007eebbe0e21ff38d0.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 2756830,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_5af40c442df484a387ed1e6d22aa3815.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 2949068,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_998ac03a5d7a79ca65c121f90416488e.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 2855855,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_bbf5ef85f9c3feb0f461975f833db6c8.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 2860085,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_2d8c239d5300fb8ce73a22f68ac01d4d.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 2867396,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_e9cda09f92ac169372c962eb9cec6a19.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 2694853,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_dac49c1e24e65753db844d37ce93add8.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 2647163,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_fb492343f743942191f3ea02db2c5d53.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 2679778,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_cb03e9e36e2e94aa04aef2ad4c7c7154.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57982,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_542f2cad218469584871c937b14e637d.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 61295,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_f78ee62924f3893acb248be4ce5694a7.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 63737,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_770c96fb128e8b8f14847124a2f64cfc.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 66759,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_45b00d78a373d6e3df63f2e1ff883481.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56523,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_72b8de5875079e3d2a0de339ed58e8e2.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 61450,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_017e04db67e0a1e68b72c53e253cb933.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 66695,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_f4e876b77280bd99f27e62db347d957d.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-01-10',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 puretech gt pack',
     'transmission': 'automatic',
     'trim': 'gt pack',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:11:28Z',
 'fuel_type': 'petrol',
 'id': '003b4ab1-45b7-5fd6-804c-b72bc20afc24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK20372',
 'listing': 'auction',
 'location': 'FR, Metz',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 68879,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2848020,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_859ade7e831a82007eebbe0e21ff38d0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2756830,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_5af40c442df484a387ed1e6d22aa3815.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2949068,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_998ac03a5d7a79ca65c121f90416488e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2855855,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_bbf5ef85f9c3feb0f461975f833db6c8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2860085,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_2d8c239d5300fb8ce73a22f68ac01d4d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2867396,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_e9cda09f92ac169372c962eb9cec6a19.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2694853,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_dac49c1e24e65753db844d37ce93add8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2647163,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_fb492343f743942191f3ea02db2c5d53.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2679778,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_cb03e9e36e2e94aa04aef2ad4c7c7154.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_542f2cad218469584871c937b14e637d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61295,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_f78ee62924f3893acb248be4ce5694a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63737,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_770c96fb128e8b8f14847124a2f64cfc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_45b00d78a373d6e3df63f2e1ff883481.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_72b8de5875079e3d2a0de339ed58e8e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_017e04db67e0a1e68b72c53e253cb933.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_003b4ab1-45b7-5fd6-804c-b72bc20afc24/003b4ab1-45b7-5fd6-804c-b72bc20afc24_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/a3/69a3ca5264c91412308607fa14a59748/pa/FK20372_f4e876b77280bd99f27e62db347d957d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-01-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech GT Pack',
 'transmission': 'automatic',
 'trim': 'GT Pack',
 'year': 2022}
2026-01-29 06:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FK20372%27 HTTP/1.1" 200 None
2026-01-29 06:02:10 [auto1.fr] INFO: Saving data for FK20372: {'created_time': 1769666530.246382, 'last_price_update_time': 1769666530.246392, 'auction_closing_time': 1769703088.0}
2026-01-29 06:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FK20372') HTTP/1.1" 204 0
2026-01-29 06:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e3bf6fe6-9cf7-59fc-845b-bceea0be8888 with identifier: GN17831
2026-01-29 06:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e3bf6fe6-9cf7-59fc-845b-bceea0be8888 with identifier: GN17831
2026-01-29 06:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'sprinter' containing 'sprinter'
2026-01-29 06:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: e3bf6fe6-9cf7-59fc-845b-bceea0be8888 spider: auto1.fr
2026-01-29 06:02:10 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: e3bf6fe6-9cf7-59fc-845b-bceea0be8888 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'sprinter' containing 'sprinter'
{'auction_title': '',
 'c_o_2_emission_value': 237,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:15:44Z',
 'fuel_type': 'diesel',
 'id': 'e3bf6fe6-9cf7-59fc-845b-bceea0be8888',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN17831',
 'listing': 'auction',
 'location': 'FR',
 'make': 'Mercedes-Benz',
 'model': 'Sprinter',
 'odometer': 95120,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-13',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Mercedes-Benz Sprinter 315 CDI RWD PRO L2',
 'transmission': 'manual',
 'trim': 'RWD PRO L2',
 'year': 2022}
2026-01-29 06:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN17831%27 HTTP/1.1" 200 None
2026-01-29 06:02:10 [auto1.fr] INFO: Saving data for GN17831: {'auction_closing_time': 1769703344.0, 'created_time': 1769533859.671777, 'last_price_update_time': 1769666530.542068}
2026-01-29 06:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GN17831') HTTP/1.1" 204 0
2026-01-29 06:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dcc8084e-789c-5115-97f0-5d9b8902d0da with identifier: RZ93074
2026-01-29 06:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:02:10 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-01-29 06:02:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dcc8084e-789c-5115-97f0-5d9b8902d0da with identifier: RZ93074
2026-01-29 06:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 154312 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    154312
2026-01-29 06:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: dcc8084e-789c-5115-97f0-5d9b8902d0da spider: auto1.fr
2026-01-29 06:02:10 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: dcc8084e-789c-5115-97f0-5d9b8902d0da due to rule: high_mileage_for_country.json, error: 154312 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    154312
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:58:19Z',
 'fuel_type': 'diesel',
 'id': 'dcc8084e-789c-5115-97f0-5d9b8902d0da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ93074',
 'listing': 'auction',
 'location': 'FR, Le Boulou',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 154312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2017}
2026-01-29 06:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RZ93074%27 HTTP/1.1" 200 None
2026-01-29 06:02:10 [auto1.fr] INFO: Saving data for RZ93074: {'auction_closing_time': 1769705899.0, 'created_time': 1768585177.132022, 'last_price_update_time': 1769666530.959559}
2026-01-29 06:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RZ93074') HTTP/1.1" 204 0
2026-01-29 06:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c07f14c0-e576-59f4-994c-0b52a281c16d with identifier: BM36001
2026-01-29 06:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c07f14c0-e576-59f4-994c-0b52a281c16d with identifier: BM36001
2026-01-29 06:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c07f14c0-e576-59f4-994c-0b52a281c16d with identifier: BM36001 to the API
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BM36001>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:20:56Z',
 'fuel_type': 'petrol',
 'id': 'c07f14c0-e576-59f4-994c-0b52a281c16d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM36001',
 'listing': 'auction',
 'location': 'FR',
 'make': 'BMW',
 'model': '2er',
 'odometer': 75807,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2er 218i Active Tourer M Sport',
 'transmission': 'manual',
 'trim': 'M Sport',
 'year': 2019}
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BM36001%27 HTTP/1.1" 200 None
2026-01-29 06:02:11 [auto1.fr] INFO: Saving data for BM36001: {'auction_closing_time': 1769703656.0, 'created_time': 1769533944.3018, 'last_price_update_time': 1769666531.420132}
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BM36001') HTTP/1.1" 204 0
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F2b%252Fe12b206cfa1533c3ecf5552525f80d6b%252Fpa%252FYH47366_04a848438021aa175c30d68e0b9f179d.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_04a848438021aa175c30d68e0b9f179d.jpg not downloaded yet
2026-01-29 06:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c154a50>
2026-01-29 06:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13bcd89a-e809-593e-9e17-60586737691f/13bcd89a-e809-593e-9e17-60586737691f_image_7.jpg HTTP/1.1" 201 0
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F67%252Fb46748a574ee174fd9b6e7cba83304f5%252Fpa%252FEK56691_3fe4d0f3821063237b5ab7c2fef83eb5.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_3fe4d0f3821063237b5ab7c2fef83eb5.jpg saved to cache
2026-01-29 06:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 13bcd89a-e809-593e-9e17-60586737691f
2026-01-29 06:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6fee1150>
2026-01-29 06:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c00b751-7816-56cb-ba76-52a4c01c1d79/4c00b751-7816-56cb-ba76-52a4c01c1d79_image_3.jpg HTTP/1.1" 201 0
2026-01-29 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F2b%252Fe12b206cfa1533c3ecf5552525f80d6b%252Fpa%252FYH47366_369351e4a43c5f6a1348674d9a26e87b.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_369351e4a43c5f6a1348674d9a26e87b.jpg saved to cache
2026-01-29 06:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c00b751-7816-56cb-ba76-52a4c01c1d79
2026-01-29 06:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_015f9a230ae6e2af32acac052dcac77a.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_ae63adfd0edd2c16045d0a7a16366dfc.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_477e574bf0b311a9934f9113fecaf234.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_8970d2032b3708ed81fe6eb74d52ffea.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_f373492c665127344828ba8a55bf9c2a.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_796ea56647ad213834d5dc32d624a051.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_26582d27b1caa52c87395f62a1aa772f.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_bcbafa5abbe76e5f0abe6c95b0e706aa.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F2b%252Fe12b206cfa1533c3ecf5552525f80d6b%252Fpa%252FYH47366_beeac77df8b554749a6dd7f17af620ed.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_beeac77df8b554749a6dd7f17af620ed.jpg not downloaded yet
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F2b%252Fe12b206cfa1533c3ecf5552525f80d6b%252Fpa%252FYH47366_4a062f75e622e1316046994fea1b2665.png%27 HTTP/1.1" 200 None
2026-01-29 06:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_4a062f75e622e1316046994fea1b2665.png not downloaded yet
2026-01-29 06:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f496150>
2026-01-29 06:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13bcd89a-e809-593e-9e17-60586737691f/13bcd89a-e809-593e-9e17-60586737691f_image_13.jpg HTTP/1.1" 201 0
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F67%252Fb46748a574ee174fd9b6e7cba83304f5%252Fpa%252FEK56691_015f9a230ae6e2af32acac052dcac77a.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_015f9a230ae6e2af32acac052dcac77a.jpg saved to cache
2026-01-29 06:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 13bcd89a-e809-593e-9e17-60586737691f
2026-01-29 06:02:12 [scrapy.extensions.logstats] INFO: Crawled 100 pages (at 20 pages/min), scraped 17 items (at 4 items/min)
2026-01-29 06:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_a25bf8debe19f45ed908db371d8beb21.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_04a848438021aa175c30d68e0b9f179d.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_36118053c1005009ce724ffb72da4507.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_f890cdede714ab0fe010aececb456bef.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c105b90>
2026-01-29 06:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13bcd89a-e809-593e-9e17-60586737691f/13bcd89a-e809-593e-9e17-60586737691f_image_11.jpg HTTP/1.1" 201 0
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F67%252Fb46748a574ee174fd9b6e7cba83304f5%252Fpa%252FEK56691_ae63adfd0edd2c16045d0a7a16366dfc.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_ae63adfd0edd2c16045d0a7a16366dfc.jpg saved to cache
2026-01-29 06:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 13bcd89a-e809-593e-9e17-60586737691f
2026-01-29 06:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_c8973121d871f6ab503710dfcf1d00b7.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_e706d8456cf74eb4ba4e6330f493a596.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_de1dfd0ca53d06674f6e999feff372d8.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_624a5562668e7ba5c3947e5b98176fff.png> (referer: https://www.auto1.com/)
2026-01-29 06:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c1c0950>
2026-01-29 06:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c00b751-7816-56cb-ba76-52a4c01c1d79/4c00b751-7816-56cb-ba76-52a4c01c1d79_image_9.jpg HTTP/1.1" 201 0
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F2b%252Fe12b206cfa1533c3ecf5552525f80d6b%252Fpa%252FYH47366_477e574bf0b311a9934f9113fecaf234.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_477e574bf0b311a9934f9113fecaf234.jpg saved to cache
2026-01-29 06:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4c00b751-7816-56cb-ba76-52a4c01c1d79
2026-01-29 06:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f42e190>
2026-01-29 06:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13bcd89a-e809-593e-9e17-60586737691f/13bcd89a-e809-593e-9e17-60586737691f_image_14.jpg HTTP/1.1" 201 0
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F67%252Fb46748a574ee174fd9b6e7cba83304f5%252Fpa%252FEK56691_8970d2032b3708ed81fe6eb74d52ffea.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_8970d2032b3708ed81fe6eb74d52ffea.jpg saved to cache
2026-01-29 06:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 13bcd89a-e809-593e-9e17-60586737691f
2026-01-29 06:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c2fda10>
2026-01-29 06:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13bcd89a-e809-593e-9e17-60586737691f/13bcd89a-e809-593e-9e17-60586737691f_image_12.jpg HTTP/1.1" 201 0
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F67%252Fb46748a574ee174fd9b6e7cba83304f5%252Fpa%252FEK56691_f373492c665127344828ba8a55bf9c2a.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_f373492c665127344828ba8a55bf9c2a.jpg saved to cache
2026-01-29 06:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 13bcd89a-e809-593e-9e17-60586737691f
2026-01-29 06:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c09e9d0>
2026-01-29 06:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c00b751-7816-56cb-ba76-52a4c01c1d79/4c00b751-7816-56cb-ba76-52a4c01c1d79_image_8.jpg HTTP/1.1" 201 0
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F2b%252Fe12b206cfa1533c3ecf5552525f80d6b%252Fpa%252FYH47366_796ea56647ad213834d5dc32d624a051.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_796ea56647ad213834d5dc32d624a051.jpg saved to cache
2026-01-29 06:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4c00b751-7816-56cb-ba76-52a4c01c1d79
2026-01-29 06:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c2fe4d0>
2026-01-29 06:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c00b751-7816-56cb-ba76-52a4c01c1d79/4c00b751-7816-56cb-ba76-52a4c01c1d79_image_10.jpg HTTP/1.1" 201 0
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F2b%252Fe12b206cfa1533c3ecf5552525f80d6b%252Fpa%252FYH47366_26582d27b1caa52c87395f62a1aa772f.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_26582d27b1caa52c87395f62a1aa772f.jpg saved to cache
2026-01-29 06:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 4c00b751-7816-56cb-ba76-52a4c01c1d79
2026-01-29 06:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f518cd0>
2026-01-29 06:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c00b751-7816-56cb-ba76-52a4c01c1d79/4c00b751-7816-56cb-ba76-52a4c01c1d79_image_7.jpg HTTP/1.1" 201 0
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F2b%252Fe12b206cfa1533c3ecf5552525f80d6b%252Fpa%252FYH47366_bcbafa5abbe76e5f0abe6c95b0e706aa.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_bcbafa5abbe76e5f0abe6c95b0e706aa.jpg saved to cache
2026-01-29 06:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4c00b751-7816-56cb-ba76-52a4c01c1d79
2026-01-29 06:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PX46861> (referer: https://www.auto1.com/v1/car-details-view/PX46861/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JY05541> (referer: https://www.auto1.com/v1/car-details-view/JY05541/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AC35213> (referer: https://www.auto1.com/v1/car-details-view/AC35213/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ML57809> (referer: https://www.auto1.com/v1/car-details-view/ML57809/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NP09597> (referer: https://www.auto1.com/v1/car-details-view/NP09597/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NJ96560> (referer: https://www.auto1.com/v1/car-details-view/NJ96560/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MP03922> (referer: https://www.auto1.com/v1/car-details-view/MP03922/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZF28512> (referer: https://www.auto1.com/v1/car-details-view/ZF28512/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f587690>
2026-01-29 06:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13bcd89a-e809-593e-9e17-60586737691f/13bcd89a-e809-593e-9e17-60586737691f_image_5.jpg HTTP/1.1" 201 0
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F67%252Fb46748a574ee174fd9b6e7cba83304f5%252Fpa%252FEK56691_a25bf8debe19f45ed908db371d8beb21.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_a25bf8debe19f45ed908db371d8beb21.jpg saved to cache
2026-01-29 06:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 13bcd89a-e809-593e-9e17-60586737691f
2026-01-29 06:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6fe055d0>
2026-01-29 06:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c00b751-7816-56cb-ba76-52a4c01c1d79/4c00b751-7816-56cb-ba76-52a4c01c1d79_image_13.jpg HTTP/1.1" 201 0
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F2b%252Fe12b206cfa1533c3ecf5552525f80d6b%252Fpa%252FYH47366_04a848438021aa175c30d68e0b9f179d.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_04a848438021aa175c30d68e0b9f179d.jpg saved to cache
2026-01-29 06:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 4c00b751-7816-56cb-ba76-52a4c01c1d79
2026-01-29 06:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff67490>
2026-01-29 06:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c00b751-7816-56cb-ba76-52a4c01c1d79/4c00b751-7816-56cb-ba76-52a4c01c1d79_image_12.jpg HTTP/1.1" 201 0
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F2b%252Fe12b206cfa1533c3ecf5552525f80d6b%252Fpa%252FYH47366_36118053c1005009ce724ffb72da4507.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_36118053c1005009ce724ffb72da4507.jpg saved to cache
2026-01-29 06:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 4c00b751-7816-56cb-ba76-52a4c01c1d79
2026-01-29 06:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c08a1d0>
2026-01-29 06:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13bcd89a-e809-593e-9e17-60586737691f/13bcd89a-e809-593e-9e17-60586737691f_image_6.jpg HTTP/1.1" 201 0
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F67%252Fb46748a574ee174fd9b6e7cba83304f5%252Fpa%252FEK56691_f890cdede714ab0fe010aececb456bef.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_f890cdede714ab0fe010aececb456bef.jpg saved to cache
2026-01-29 06:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 13bcd89a-e809-593e-9e17-60586737691f
2026-01-29 06:02:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_4b1432f0ca45402435dc49eb6d49070f.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_f04568a87485228ddfb6bbbe5bd23c5e.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_4a062f75e622e1316046994fea1b2665.png> (referer: https://www.auto1.com/)
2026-01-29 06:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_beeac77df8b554749a6dd7f17af620ed.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c2a2210>
2026-01-29 06:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c00b751-7816-56cb-ba76-52a4c01c1d79/4c00b751-7816-56cb-ba76-52a4c01c1d79_image_11.jpg HTTP/1.1" 201 0
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F2b%252Fe12b206cfa1533c3ecf5552525f80d6b%252Fpa%252FYH47366_c8973121d871f6ab503710dfcf1d00b7.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_c8973121d871f6ab503710dfcf1d00b7.jpg saved to cache
2026-01-29 06:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 4c00b751-7816-56cb-ba76-52a4c01c1d79
2026-01-29 06:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f3c3ed0>
2026-01-29 06:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c00b751-7816-56cb-ba76-52a4c01c1d79/4c00b751-7816-56cb-ba76-52a4c01c1d79_image_2.jpg HTTP/1.1" 201 0
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F2b%252Fe12b206cfa1533c3ecf5552525f80d6b%252Fpa%252FYH47366_e706d8456cf74eb4ba4e6330f493a596.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_e706d8456cf74eb4ba4e6330f493a596.jpg saved to cache
2026-01-29 06:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c00b751-7816-56cb-ba76-52a4c01c1d79
2026-01-29 06:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c0f36d0>
2026-01-29 06:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c00b751-7816-56cb-ba76-52a4c01c1d79/4c00b751-7816-56cb-ba76-52a4c01c1d79_image_1.jpg HTTP/1.1" 201 0
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F2b%252Fe12b206cfa1533c3ecf5552525f80d6b%252Fpa%252FYH47366_de1dfd0ca53d06674f6e999feff372d8.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_de1dfd0ca53d06674f6e999feff372d8.jpg saved to cache
2026-01-29 06:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c00b751-7816-56cb-ba76-52a4c01c1d79
2026-01-29 06:02:17 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-01-29 06:02:17 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2026-01-29 06:02:17 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2026-01-29 06:02:17 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2026-01-29 06:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c0ea350>
2026-01-29 06:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13bcd89a-e809-593e-9e17-60586737691f/13bcd89a-e809-593e-9e17-60586737691f_image_15.png HTTP/1.1" 201 0
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F67%252Fb46748a574ee174fd9b6e7cba83304f5%252Fpa%252FEK56691_624a5562668e7ba5c3947e5b98176fff.png') HTTP/1.1" 204 0
2026-01-29 06:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_624a5562668e7ba5c3947e5b98176fff.png saved to cache
2026-01-29 06:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 13bcd89a-e809-593e-9e17-60586737691f
2026-01-29 06:02:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40cb6e01-a592-53cb-99f9-45ba887d40dc with identifier: PX46861
2026-01-29 06:02:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40cb6e01-a592-53cb-99f9-45ba887d40dc with scrape type 1
2026-01-29 06:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 40cb6e01-a592-53cb-99f9-45ba887d40dc
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F9d%252Fb19dfed96bd0bfa59c5a5f234267dd38%252Fpa%252FPX46861_587aa1e141daf4bbb9cc0280910a7c12.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_587aa1e141daf4bbb9cc0280910a7c12.jpg already downloaded
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F9d%252Fb19dfed96bd0bfa59c5a5f234267dd38%252Fpa%252FPX46861_214d11061325eae9ee9744bfdc6cae87.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_214d11061325eae9ee9744bfdc6cae87.jpg already downloaded
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F9d%252Fb19dfed96bd0bfa59c5a5f234267dd38%252Fpa%252FPX46861_e9c823bc5ded30a1450fa44c1f30fbc7.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_e9c823bc5ded30a1450fa44c1f30fbc7.jpg already downloaded
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F9d%252Fb19dfed96bd0bfa59c5a5f234267dd38%252Fpa%252FPX46861_4ca8a62a12584ce9b7096d327a14ea1d.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_4ca8a62a12584ce9b7096d327a14ea1d.jpg already downloaded
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F9d%252Fb19dfed96bd0bfa59c5a5f234267dd38%252Fpa%252FPX46861_290d9d1817df7ac91941691e4c515bf7.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_290d9d1817df7ac91941691e4c515bf7.jpg already downloaded
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F9d%252Fb19dfed96bd0bfa59c5a5f234267dd38%252Fpa%252FPX46861_13d7bd00d0e61b19be7897c072f7e7c4.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_13d7bd00d0e61b19be7897c072f7e7c4.jpg already downloaded
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F9d%252Fb19dfed96bd0bfa59c5a5f234267dd38%252Fpa%252FPX46861_186304ff3b4f846c5285296f542674fe.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_186304ff3b4f846c5285296f542674fe.jpg already downloaded
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F9d%252Fb19dfed96bd0bfa59c5a5f234267dd38%252Fpa%252FPX46861_8458e920cfb36b45b2978e6c963fa07c.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_8458e920cfb36b45b2978e6c963fa07c.jpg already downloaded
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F9d%252Fb19dfed96bd0bfa59c5a5f234267dd38%252Fpa%252FPX46861_23bd6a6e54c635a6223dd8099333090b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_23bd6a6e54c635a6223dd8099333090b.jpg already downloaded
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F9d%252Fb19dfed96bd0bfa59c5a5f234267dd38%252Fpa%252FPX46861_5a2c1bb448e3e79a66c9ed7fbd4bb337.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_5a2c1bb448e3e79a66c9ed7fbd4bb337.jpg already downloaded
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F9d%252Fb19dfed96bd0bfa59c5a5f234267dd38%252Fpa%252FPX46861_f9a579432300e4dde82ba449729df1fe.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_f9a579432300e4dde82ba449729df1fe.jpg already downloaded
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F9d%252Fb19dfed96bd0bfa59c5a5f234267dd38%252Fpa%252FPX46861_d96d57da1ab216fb1b312c0eed4557f9.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_d96d57da1ab216fb1b312c0eed4557f9.jpg already downloaded
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F9d%252Fb19dfed96bd0bfa59c5a5f234267dd38%252Fpa%252FPX46861_ee4475cfbf271c4d641908e637e20894.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_ee4475cfbf271c4d641908e637e20894.jpg already downloaded
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F9d%252Fb19dfed96bd0bfa59c5a5f234267dd38%252Fpa%252FPX46861_8a23d5f9b1547c0f14d0fe8ad0727050.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_8a23d5f9b1547c0f14d0fe8ad0727050.jpg already downloaded
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F9d%252Fb19dfed96bd0bfa59c5a5f234267dd38%252Fpa%252FPX46861_51c7d9b710a1c84ccdae08f0d8303175.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_51c7d9b710a1c84ccdae08f0d8303175.jpg already downloaded
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F9d%252Fb19dfed96bd0bfa59c5a5f234267dd38%252Fpa%252FPX46861_8f3c18794fbbbeff0723fb4d93bc0870.png%27 HTTP/1.1" 200 None
2026-01-29 06:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_8f3c18794fbbbeff0723fb4d93bc0870.png already downloaded
2026-01-29 06:02:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 40cb6e01-a592-53cb-99f9-45ba887d40dc, identifier: PX46861
2026-01-29 06:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a1bb073-c47d-5215-af82-0e906e91a8ed with identifier: JY05541
2026-01-29 06:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a1bb073-c47d-5215-af82-0e906e91a8ed with scrape type 1
2026-01-29 06:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 0a1bb073-c47d-5215-af82-0e906e91a8ed
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd0%252F74d0394e381f3da387c41961cc3fdbef%252Fpa%252FJY05541_500ff4619467f69f9677e6433dd6157a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_500ff4619467f69f9677e6433dd6157a.jpg already downloaded
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd0%252F74d0394e381f3da387c41961cc3fdbef%252Fpa%252FJY05541_c5e1f91e105e43215fe8f5f012371868.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_c5e1f91e105e43215fe8f5f012371868.jpg already downloaded
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd0%252F74d0394e381f3da387c41961cc3fdbef%252Fpa%252FJY05541_9dc18da0e702728f43a628ebe531939d.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_9dc18da0e702728f43a628ebe531939d.jpg already downloaded
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd0%252F74d0394e381f3da387c41961cc3fdbef%252Fpa%252FJY05541_be0214f75acfa71cc0c41d2c3faa5912.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_be0214f75acfa71cc0c41d2c3faa5912.jpg already downloaded
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd0%252F74d0394e381f3da387c41961cc3fdbef%252Fpa%252FJY05541_c89f91c307b3da31d5750778079646d6.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_c89f91c307b3da31d5750778079646d6.jpg already downloaded
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd0%252F74d0394e381f3da387c41961cc3fdbef%252Fpa%252FJY05541_6e247c4b1a51aeff385980a292b0fd85.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_6e247c4b1a51aeff385980a292b0fd85.jpg already downloaded
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd0%252F74d0394e381f3da387c41961cc3fdbef%252Fpa%252FJY05541_2dfe314715dd203b8cb0e534aca584ca.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_2dfe314715dd203b8cb0e534aca584ca.jpg already downloaded
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd0%252F74d0394e381f3da387c41961cc3fdbef%252Fpa%252FJY05541_b80d2bd0d9f7dffc4eef7a174b4c34e0.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_b80d2bd0d9f7dffc4eef7a174b4c34e0.jpg already downloaded
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd0%252F74d0394e381f3da387c41961cc3fdbef%252Fpa%252FJY05541_9c951e58b977fe029f9cb3743dd876e0.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_9c951e58b977fe029f9cb3743dd876e0.jpg already downloaded
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd0%252F74d0394e381f3da387c41961cc3fdbef%252Fpa%252FJY05541_43688a9eab059f6daeb03903c372eaf9.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_43688a9eab059f6daeb03903c372eaf9.jpg already downloaded
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd0%252F74d0394e381f3da387c41961cc3fdbef%252Fpa%252FJY05541_29655930bc32049b399bbe8327519a71.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_29655930bc32049b399bbe8327519a71.jpg already downloaded
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd0%252F74d0394e381f3da387c41961cc3fdbef%252Fpa%252FJY05541_48ed949c9503783bab7817915b67a423.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_48ed949c9503783bab7817915b67a423.jpg already downloaded
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd0%252F74d0394e381f3da387c41961cc3fdbef%252Fpa%252FJY05541_d770c7ee9beaf020285a1c107ef3072f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_d770c7ee9beaf020285a1c107ef3072f.jpg already downloaded
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd0%252F74d0394e381f3da387c41961cc3fdbef%252Fpa%252FJY05541_7007b7ebd28aa417fa58d5a19ff04357.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_7007b7ebd28aa417fa58d5a19ff04357.jpg already downloaded
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd0%252F74d0394e381f3da387c41961cc3fdbef%252Fpa%252FJY05541_ac9a587142f134125bf851845b20f054.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_ac9a587142f134125bf851845b20f054.jpg already downloaded
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd0%252F74d0394e381f3da387c41961cc3fdbef%252Fpa%252FJY05541_5ab181db9b789fd6b240649b80f3b2d3.png%27 HTTP/1.1" 200 None
2026-01-29 06:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_5ab181db9b789fd6b240649b80f3b2d3.png already downloaded
2026-01-29 06:02:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0a1bb073-c47d-5215-af82-0e906e91a8ed, identifier: JY05541
2026-01-29 06:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ea48c2f-b56b-5e2d-8232-3de54c5653f7 with identifier: AC35213
2026-01-29 06:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ea48c2f-b56b-5e2d-8232-3de54c5653f7 with scrape type 2
2026-01-29 06:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ea48c2f-b56b-5e2d-8232-3de54c5653f7 with scrape type 2
2026-01-29 06:02:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7ea48c2f-b56b-5e2d-8232-3de54c5653f7, identifier: AC35213
2026-01-29 06:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e5dcd6d-21bb-582a-83b9-55f9c4cfe053 with identifier: ML57809
2026-01-29 06:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e5dcd6d-21bb-582a-83b9-55f9c4cfe053 with scrape type 2
2026-01-29 06:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e5dcd6d-21bb-582a-83b9-55f9c4cfe053 with scrape type 2
2026-01-29 06:02:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6e5dcd6d-21bb-582a-83b9-55f9c4cfe053, identifier: ML57809
2026-01-29 06:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c36a47c-6896-5a28-95f9-dc4cb8be23ed with identifier: NP09597
2026-01-29 06:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c36a47c-6896-5a28-95f9-dc4cb8be23ed with scrape type 2
2026-01-29 06:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c36a47c-6896-5a28-95f9-dc4cb8be23ed with scrape type 2
2026-01-29 06:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5c36a47c-6896-5a28-95f9-dc4cb8be23ed, identifier: NP09597
2026-01-29 06:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d602d54c-1c3a-5281-8f20-d82143d6487b with identifier: NJ96560
2026-01-29 06:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d602d54c-1c3a-5281-8f20-d82143d6487b with scrape type 2
2026-01-29 06:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d602d54c-1c3a-5281-8f20-d82143d6487b with scrape type 2
2026-01-29 06:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d602d54c-1c3a-5281-8f20-d82143d6487b, identifier: NJ96560
2026-01-29 06:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fd07872-ba68-5f38-98c8-be6b04f843df with identifier: MP03922
2026-01-29 06:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fd07872-ba68-5f38-98c8-be6b04f843df with scrape type 1
2026-01-29 06:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 8fd07872-ba68-5f38-98c8-be6b04f843df
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fbb%252Fc1bb4f1561d8f98dd91d20e59b2eb87e%252Fpa%252FMP03922_0c0889fb29aa782c9e4d5683fe742a44.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_0c0889fb29aa782c9e4d5683fe742a44.jpg already downloaded
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fbb%252Fc1bb4f1561d8f98dd91d20e59b2eb87e%252Fpa%252FMP03922_e416de2eaed3b42d97b07517020a2b94.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_e416de2eaed3b42d97b07517020a2b94.jpg already downloaded
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fbb%252Fc1bb4f1561d8f98dd91d20e59b2eb87e%252Fpa%252FMP03922_aeff929033265ab5656d59443ecd7a4d.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_aeff929033265ab5656d59443ecd7a4d.jpg already downloaded
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fbb%252Fc1bb4f1561d8f98dd91d20e59b2eb87e%252Fpa%252FMP03922_5a99aa530b6161a8207829a76e2f9c5a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_5a99aa530b6161a8207829a76e2f9c5a.jpg already downloaded
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fbb%252Fc1bb4f1561d8f98dd91d20e59b2eb87e%252Fpa%252FMP03922_abfb747c1251e3520d17de111705884e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_abfb747c1251e3520d17de111705884e.jpg already downloaded
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fbb%252Fc1bb4f1561d8f98dd91d20e59b2eb87e%252Fpa%252FMP03922_9703f358b41d17f307f772b57d303b31.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_9703f358b41d17f307f772b57d303b31.jpg already downloaded
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fbb%252Fc1bb4f1561d8f98dd91d20e59b2eb87e%252Fpa%252FMP03922_1589733044e98cf535ef187cea57a0c8.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_1589733044e98cf535ef187cea57a0c8.jpg already downloaded
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fbb%252Fc1bb4f1561d8f98dd91d20e59b2eb87e%252Fpa%252FMP03922_7ba11870944808394a9c4886b55c8e31.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_7ba11870944808394a9c4886b55c8e31.jpg already downloaded
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fbb%252Fc1bb4f1561d8f98dd91d20e59b2eb87e%252Fpa%252FMP03922_17778875c0e07f6fb4f98ef1a1bf49ff.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_17778875c0e07f6fb4f98ef1a1bf49ff.jpg already downloaded
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fbb%252Fc1bb4f1561d8f98dd91d20e59b2eb87e%252Fpa%252FMP03922_1d951d41b1ffb3c1ca5c032b3db2aa4a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_1d951d41b1ffb3c1ca5c032b3db2aa4a.jpg already downloaded
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fbb%252Fc1bb4f1561d8f98dd91d20e59b2eb87e%252Fpa%252FMP03922_6b9180f187265fc811889830334ac10e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_6b9180f187265fc811889830334ac10e.jpg already downloaded
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fbb%252Fc1bb4f1561d8f98dd91d20e59b2eb87e%252Fpa%252FMP03922_867f088c4675fe58bd037e340c96f888.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_867f088c4675fe58bd037e340c96f888.jpg already downloaded
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fbb%252Fc1bb4f1561d8f98dd91d20e59b2eb87e%252Fpa%252FMP03922_f9b1f0ce4e5523ce891efdab7135f223.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_f9b1f0ce4e5523ce891efdab7135f223.jpg already downloaded
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fbb%252Fc1bb4f1561d8f98dd91d20e59b2eb87e%252Fpa%252FMP03922_8ccfcfb7d0fddfae9c848879541d1017.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_8ccfcfb7d0fddfae9c848879541d1017.jpg already downloaded
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fbb%252Fc1bb4f1561d8f98dd91d20e59b2eb87e%252Fpa%252FMP03922_29d13143cf8c17476413bbca044bcb9a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_29d13143cf8c17476413bbca044bcb9a.jpg already downloaded
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fbb%252Fc1bb4f1561d8f98dd91d20e59b2eb87e%252Fpa%252FMP03922_a65fcd8cb959a1dec033149f2d021dcd.png%27 HTTP/1.1" 200 None
2026-01-29 06:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_a65fcd8cb959a1dec033149f2d021dcd.png already downloaded
2026-01-29 06:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8fd07872-ba68-5f38-98c8-be6b04f843df, identifier: MP03922
2026-01-29 06:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d287475-ad0d-5b48-b416-542a51fb4e4d with identifier: ZF28512
2026-01-29 06:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d287475-ad0d-5b48-b416-542a51fb4e4d with scrape type 2
2026-01-29 06:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d287475-ad0d-5b48-b416-542a51fb4e4d with scrape type 2
2026-01-29 06:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5d287475-ad0d-5b48-b416-542a51fb4e4d, identifier: ZF28512
2026-01-29 06:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 40cb6e01-a592-53cb-99f9-45ba887d40dc with identifier: PX46861
2026-01-29 06:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 40cb6e01-a592-53cb-99f9-45ba887d40dc with identifier: PX46861
2026-01-29 06:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'manual', 'odometer': 114272, 'odometer_reading_unit': 'km', 'registration_date': '2018-08-01', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/px46861', 'expiration_date': '2026-01-29t16:13:05z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_587aa1e141daf4bbb9cc0280910a7c12.jpg', 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_214d11061325eae9ee9744bfdc6cae87.jpg', 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_e9c823bc5ded30a1450fa44c1f30fbc7.jpg', 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_4ca8a62a12584ce9b7096d327a14ea1d.jpg', 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_290d9d1817df7ac91941691e4c515bf7.jpg', 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_13d7bd00d0e61b19be7897c072f7e7c4.jpg', 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_186304ff3b4f846c5285296f542674fe.jpg', 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_8458e920cfb36b45b2978e6c963fa07c.jpg', 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_23bd6a6e54c635a6223dd8099333090b.jpg', 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_5a2c1bb448e3e79a66c9ed7fbd4bb337.jpg', 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_f9a579432300e4dde82ba449729df1fe.jpg', 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_d96d57da1ab216fb1b312c0eed4557f9.jpg', 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_ee4475cfbf271c4d641908e637e20894.jpg', 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_8a23d5f9b1547c0f14d0fe8ad0727050.jpg', 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_51c7d9b710a1c84ccdae08f0d8303175.jpg', 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_8f3c18794fbbbeff0723fb4d93bc0870.png'], 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ingrandes sur vienne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 115, 'id': '40cb6e01-a592-53cb-99f9-45ba887d40dc', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_587aa1e141daf4bbb9cc0280910a7c12.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 80883}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_214d11061325eae9ee9744bfdc6cae87.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 64004}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_e9c823bc5ded30a1450fa44c1f30fbc7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 69566}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_4ca8a62a12584ce9b7096d327a14ea1d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60067}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_290d9d1817df7ac91941691e4c515bf7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68444}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_13d7bd00d0e61b19be7897c072f7e7c4.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 75001}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_186304ff3b4f846c5285296f542674fe.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 64491}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_8458e920cfb36b45b2978e6c963fa07c.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3214985}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_23bd6a6e54c635a6223dd8099333090b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 79961}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_5a2c1bb448e3e79a66c9ed7fbd4bb337.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63008}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_f9a579432300e4dde82ba449729df1fe.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62386}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_d96d57da1ab216fb1b312c0eed4557f9.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58190}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_ee4475cfbf271c4d641908e637e20894.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68214}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_8a23d5f9b1547c0f14d0fe8ad0727050.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 51590}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_51c7d9b710a1c84ccdae08f0d8303175.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 122923}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_8f3c18794fbbbeff0723fb4d93bc0870.png', 'Width': 800, 'Height': 503, 'Extension': 'png', 'FileSizeInBytes': 103270}], 'current_year_diff': 8, 'age_in_months': 89, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 114272}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 89,
     'auction_title': '',
     'c_o_2_emission_value': 115,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:13:05z',
     'fuel_type': 'petrol',
     'id': '40cb6e01-a592-53cb-99f9-45ba887d40dc',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/px46861',
     'listing': 'auction',
     'location': 'fr, ingrandes sur vienne',
     'make': 'citroen',
     'make_model': 'citroen c3 aircross',
     'model': 'c3 aircross',
     'odometer': 114272,
     'odometer_in_km': 114272,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 16,
     'photo_urls': ['https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_587aa1e141daf4bbb9cc0280910a7c12.jpg',
                    'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_214d11061325eae9ee9744bfdc6cae87.jpg',
                    'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_e9c823bc5ded30a1450fa44c1f30fbc7.jpg',
                    'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_4ca8a62a12584ce9b7096d327a14ea1d.jpg',
                    'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_290d9d1817df7ac91941691e4c515bf7.jpg',
                    'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_13d7bd00d0e61b19be7897c072f7e7c4.jpg',
                    'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_186304ff3b4f846c5285296f542674fe.jpg',
                    'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_8458e920cfb36b45b2978e6c963fa07c.jpg',
                    'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_23bd6a6e54c635a6223dd8099333090b.jpg',
                    'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_5a2c1bb448e3e79a66c9ed7fbd4bb337.jpg',
                    'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_f9a579432300e4dde82ba449729df1fe.jpg',
                    'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_d96d57da1ab216fb1b312c0eed4557f9.jpg',
                    'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_ee4475cfbf271c4d641908e637e20894.jpg',
                    'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_8a23d5f9b1547c0f14d0fe8ad0727050.jpg',
                    'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_51c7d9b710a1c84ccdae08f0d8303175.jpg',
                    'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_8f3c18794fbbbeff0723fb4d93bc0870.png'],
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 80883,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_587aa1e141daf4bbb9cc0280910a7c12.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 64004,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_214d11061325eae9ee9744bfdc6cae87.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 69566,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_e9c823bc5ded30a1450fa44c1f30fbc7.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 60067,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_4ca8a62a12584ce9b7096d327a14ea1d.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 68444,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_290d9d1817df7ac91941691e4c515bf7.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 75001,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_13d7bd00d0e61b19be7897c072f7e7c4.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 64491,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_186304ff3b4f846c5285296f542674fe.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 3214985,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_8458e920cfb36b45b2978e6c963fa07c.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 79961,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_23bd6a6e54c635a6223dd8099333090b.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 63008,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_5a2c1bb448e3e79a66c9ed7fbd4bb337.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 62386,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_f9a579432300e4dde82ba449729df1fe.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 58190,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_d96d57da1ab216fb1b312c0eed4557f9.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 68214,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_ee4475cfbf271c4d641908e637e20894.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51590,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_8a23d5f9b1547c0f14d0fe8ad0727050.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 122923,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_51c7d9b710a1c84ccdae08f0d8303175.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_15.png',
                 'Extension': 'png',
                 'FileSizeInBytes': 103270,
                 'Height': 503,
                 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_8f3c18794fbbbeff0723fb4d93bc0870.png',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-08-01',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 aircross 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2018}
2026-01-29 06:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 40cb6e01-a592-53cb-99f9-45ba887d40dc spider: auto1.fr
2026-01-29 06:02:20 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 40cb6e01-a592-53cb-99f9-45ba887d40dc due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'manual', 'odometer': 114272, 'odometer_reading_unit': 'km', 'registration_date': '2018-08-01', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/px46861', 'expiration_date': '2026-01-29t16:13:05z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_587aa1e141daf4bbb9cc0280910a7c12.jpg', 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_214d11061325eae9ee9744bfdc6cae87.jpg', 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_e9c823bc5ded30a1450fa44c1f30fbc7.jpg', 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_4ca8a62a12584ce9b7096d327a14ea1d.jpg', 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_290d9d1817df7ac91941691e4c515bf7.jpg', 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_13d7bd00d0e61b19be7897c072f7e7c4.jpg', 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_186304ff3b4f846c5285296f542674fe.jpg', 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_8458e920cfb36b45b2978e6c963fa07c.jpg', 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_23bd6a6e54c635a6223dd8099333090b.jpg', 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_5a2c1bb448e3e79a66c9ed7fbd4bb337.jpg', 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_f9a579432300e4dde82ba449729df1fe.jpg', 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_d96d57da1ab216fb1b312c0eed4557f9.jpg', 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_ee4475cfbf271c4d641908e637e20894.jpg', 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_8a23d5f9b1547c0f14d0fe8ad0727050.jpg', 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_51c7d9b710a1c84ccdae08f0d8303175.jpg', 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_8f3c18794fbbbeff0723fb4d93bc0870.png'], 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ingrandes sur vienne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 115, 'id': '40cb6e01-a592-53cb-99f9-45ba887d40dc', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_587aa1e141daf4bbb9cc0280910a7c12.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 80883}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_214d11061325eae9ee9744bfdc6cae87.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 64004}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_e9c823bc5ded30a1450fa44c1f30fbc7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 69566}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_4ca8a62a12584ce9b7096d327a14ea1d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60067}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_290d9d1817df7ac91941691e4c515bf7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68444}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_13d7bd00d0e61b19be7897c072f7e7c4.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 75001}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_186304ff3b4f846c5285296f542674fe.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 64491}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_8458e920cfb36b45b2978e6c963fa07c.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 3214985}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_23bd6a6e54c635a6223dd8099333090b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 79961}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_5a2c1bb448e3e79a66c9ed7fbd4bb337.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63008}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_f9a579432300e4dde82ba449729df1fe.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62386}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_d96d57da1ab216fb1b312c0eed4557f9.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58190}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_ee4475cfbf271c4d641908e637e20894.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68214}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_8a23d5f9b1547c0f14d0fe8ad0727050.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 51590}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_51c7d9b710a1c84ccdae08f0d8303175.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 122923}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_8f3c18794fbbbeff0723fb4d93bc0870.png', 'Width': 800, 'Height': 503, 'Extension': 'png', 'FileSizeInBytes': 103270}], 'current_year_diff': 8, 'age_in_months': 89, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 114272}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 89,
     'auction_title': '',
     'c_o_2_emission_value': 115,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:13:05z',
     'fuel_type': 'petrol',
     'id': '40cb6e01-a592-53cb-99f9-45ba887d40dc',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/px46861',
     'listing': 'auction',
     'location': 'fr, ingrandes sur vienne',
     'make': 'citroen',
     'make_model': 'citroen c3 aircross',
     'model': 'c3 aircross',
     'odometer': 114272,
     'odometer_in_km': 114272,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 16,
     'photo_urls': ['https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_587aa1e141daf4bbb9cc0280910a7c12.jpg',
                    'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_214d11061325eae9ee9744bfdc6cae87.jpg',
                    'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_e9c823bc5ded30a1450fa44c1f30fbc7.jpg',
                    'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_4ca8a62a12584ce9b7096d327a14ea1d.jpg',
                    'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_290d9d1817df7ac91941691e4c515bf7.jpg',
                    'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_13d7bd00d0e61b19be7897c072f7e7c4.jpg',
                    'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_186304ff3b4f846c5285296f542674fe.jpg',
                    'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_8458e920cfb36b45b2978e6c963fa07c.jpg',
                    'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_23bd6a6e54c635a6223dd8099333090b.jpg',
                    'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_5a2c1bb448e3e79a66c9ed7fbd4bb337.jpg',
                    'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_f9a579432300e4dde82ba449729df1fe.jpg',
                    'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_d96d57da1ab216fb1b312c0eed4557f9.jpg',
                    'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_ee4475cfbf271c4d641908e637e20894.jpg',
                    'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_8a23d5f9b1547c0f14d0fe8ad0727050.jpg',
                    'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_51c7d9b710a1c84ccdae08f0d8303175.jpg',
                    'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_8f3c18794fbbbeff0723fb4d93bc0870.png'],
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 80883,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_587aa1e141daf4bbb9cc0280910a7c12.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 64004,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_214d11061325eae9ee9744bfdc6cae87.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 69566,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_e9c823bc5ded30a1450fa44c1f30fbc7.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 60067,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_4ca8a62a12584ce9b7096d327a14ea1d.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 68444,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_290d9d1817df7ac91941691e4c515bf7.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 75001,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_13d7bd00d0e61b19be7897c072f7e7c4.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 64491,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_186304ff3b4f846c5285296f542674fe.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 3214985,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_8458e920cfb36b45b2978e6c963fa07c.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 79961,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_23bd6a6e54c635a6223dd8099333090b.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 63008,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_5a2c1bb448e3e79a66c9ed7fbd4bb337.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 62386,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_f9a579432300e4dde82ba449729df1fe.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 58190,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_d96d57da1ab216fb1b312c0eed4557f9.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 68214,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_ee4475cfbf271c4d641908e637e20894.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51590,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_8a23d5f9b1547c0f14d0fe8ad0727050.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 122923,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_51c7d9b710a1c84ccdae08f0d8303175.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_15.png',
                 'Extension': 'png',
                 'FileSizeInBytes': 103270,
                 'Height': 503,
                 'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_8f3c18794fbbbeff0723fb4d93bc0870.png',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-08-01',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 aircross 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:13:05Z',
 'fuel_type': 'petrol',
 'id': '40cb6e01-a592-53cb-99f9-45ba887d40dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX46861',
 'listing': 'auction',
 'location': 'FR, Ingrandes sur Vienne',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 114272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_587aa1e141daf4bbb9cc0280910a7c12.jpg',
                'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_214d11061325eae9ee9744bfdc6cae87.jpg',
                'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_e9c823bc5ded30a1450fa44c1f30fbc7.jpg',
                'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_4ca8a62a12584ce9b7096d327a14ea1d.jpg',
                'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_290d9d1817df7ac91941691e4c515bf7.jpg',
                'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_13d7bd00d0e61b19be7897c072f7e7c4.jpg',
                'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_186304ff3b4f846c5285296f542674fe.jpg',
                'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_8458e920cfb36b45b2978e6c963fa07c.jpg',
                'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_23bd6a6e54c635a6223dd8099333090b.jpg',
                'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_5a2c1bb448e3e79a66c9ed7fbd4bb337.jpg',
                'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_f9a579432300e4dde82ba449729df1fe.jpg',
                'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_d96d57da1ab216fb1b312c0eed4557f9.jpg',
                'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_ee4475cfbf271c4d641908e637e20894.jpg',
                'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_8a23d5f9b1547c0f14d0fe8ad0727050.jpg',
                'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_51c7d9b710a1c84ccdae08f0d8303175.jpg',
                'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_8f3c18794fbbbeff0723fb4d93bc0870.png'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_587aa1e141daf4bbb9cc0280910a7c12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_214d11061325eae9ee9744bfdc6cae87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_e9c823bc5ded30a1450fa44c1f30fbc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_4ca8a62a12584ce9b7096d327a14ea1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_290d9d1817df7ac91941691e4c515bf7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_13d7bd00d0e61b19be7897c072f7e7c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_186304ff3b4f846c5285296f542674fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3214985,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_8458e920cfb36b45b2978e6c963fa07c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79961,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_23bd6a6e54c635a6223dd8099333090b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_5a2c1bb448e3e79a66c9ed7fbd4bb337.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62386,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_f9a579432300e4dde82ba449729df1fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_d96d57da1ab216fb1b312c0eed4557f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_ee4475cfbf271c4d641908e637e20894.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_8a23d5f9b1547c0f14d0fe8ad0727050.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_51c7d9b710a1c84ccdae08f0d8303175.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cb6e01-a592-53cb-99f9-45ba887d40dc/40cb6e01-a592-53cb-99f9-45ba887d40dc_image_15.png',
             'Extension': 'png',
             'FileSizeInBytes': 103270,
             'Height': 503,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/9d/b19dfed96bd0bfa59c5a5f234267dd38/pa/PX46861_8f3c18794fbbbeff0723fb4d93bc0870.png',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2018}
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX46861%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.fr] INFO: Saving data for PX46861: {'created_time': 1769666540.171127, 'last_price_update_time': 1769666540.171137, 'auction_closing_time': 1769703185.0}
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PX46861') HTTP/1.1" 204 0
2026-01-29 06:02:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0a1bb073-c47d-5215-af82-0e906e91a8ed with identifier: JY05541
2026-01-29 06:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0a1bb073-c47d-5215-af82-0e906e91a8ed with identifier: JY05541
2026-01-29 06:02:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0a1bb073-c47d-5215-af82-0e906e91a8ed with identifier: JY05541 to the API
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JY05541>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 200,
 'expiration_date': '2026-01-29T16:22:17Z',
 'fuel_type': 'petrol',
 'id': '0a1bb073-c47d-5215-af82-0e906e91a8ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY05541',
 'listing': 'auction',
 'location': 'FR, Quincieux',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 112818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_500ff4619467f69f9677e6433dd6157a.jpg',
                'https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_c5e1f91e105e43215fe8f5f012371868.jpg',
                'https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_9dc18da0e702728f43a628ebe531939d.jpg',
                'https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_be0214f75acfa71cc0c41d2c3faa5912.jpg',
                'https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_c89f91c307b3da31d5750778079646d6.jpg',
                'https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_6e247c4b1a51aeff385980a292b0fd85.jpg',
                'https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_2dfe314715dd203b8cb0e534aca584ca.jpg',
                'https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_b80d2bd0d9f7dffc4eef7a174b4c34e0.jpg',
                'https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_9c951e58b977fe029f9cb3743dd876e0.jpg',
                'https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_43688a9eab059f6daeb03903c372eaf9.jpg',
                'https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_29655930bc32049b399bbe8327519a71.jpg',
                'https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_48ed949c9503783bab7817915b67a423.jpg',
                'https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_d770c7ee9beaf020285a1c107ef3072f.jpg',
                'https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_7007b7ebd28aa417fa58d5a19ff04357.jpg',
                'https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_ac9a587142f134125bf851845b20f054.jpg',
                'https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_5ab181db9b789fd6b240649b80f3b2d3.png'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a1bb073-c47d-5215-af82-0e906e91a8ed/0a1bb073-c47d-5215-af82-0e906e91a8ed_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_500ff4619467f69f9677e6433dd6157a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a1bb073-c47d-5215-af82-0e906e91a8ed/0a1bb073-c47d-5215-af82-0e906e91a8ed_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3052714,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_c5e1f91e105e43215fe8f5f012371868.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a1bb073-c47d-5215-af82-0e906e91a8ed/0a1bb073-c47d-5215-af82-0e906e91a8ed_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_9dc18da0e702728f43a628ebe531939d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a1bb073-c47d-5215-af82-0e906e91a8ed/0a1bb073-c47d-5215-af82-0e906e91a8ed_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_be0214f75acfa71cc0c41d2c3faa5912.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a1bb073-c47d-5215-af82-0e906e91a8ed/0a1bb073-c47d-5215-af82-0e906e91a8ed_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_c89f91c307b3da31d5750778079646d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a1bb073-c47d-5215-af82-0e906e91a8ed/0a1bb073-c47d-5215-af82-0e906e91a8ed_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_6e247c4b1a51aeff385980a292b0fd85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a1bb073-c47d-5215-af82-0e906e91a8ed/0a1bb073-c47d-5215-af82-0e906e91a8ed_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_2dfe314715dd203b8cb0e534aca584ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a1bb073-c47d-5215-af82-0e906e91a8ed/0a1bb073-c47d-5215-af82-0e906e91a8ed_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79999,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_b80d2bd0d9f7dffc4eef7a174b4c34e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a1bb073-c47d-5215-af82-0e906e91a8ed/0a1bb073-c47d-5215-af82-0e906e91a8ed_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_9c951e58b977fe029f9cb3743dd876e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a1bb073-c47d-5215-af82-0e906e91a8ed/0a1bb073-c47d-5215-af82-0e906e91a8ed_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_43688a9eab059f6daeb03903c372eaf9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a1bb073-c47d-5215-af82-0e906e91a8ed/0a1bb073-c47d-5215-af82-0e906e91a8ed_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_29655930bc32049b399bbe8327519a71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a1bb073-c47d-5215-af82-0e906e91a8ed/0a1bb073-c47d-5215-af82-0e906e91a8ed_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_48ed949c9503783bab7817915b67a423.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a1bb073-c47d-5215-af82-0e906e91a8ed/0a1bb073-c47d-5215-af82-0e906e91a8ed_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72423,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_d770c7ee9beaf020285a1c107ef3072f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a1bb073-c47d-5215-af82-0e906e91a8ed/0a1bb073-c47d-5215-af82-0e906e91a8ed_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_7007b7ebd28aa417fa58d5a19ff04357.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a1bb073-c47d-5215-af82-0e906e91a8ed/0a1bb073-c47d-5215-af82-0e906e91a8ed_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89448,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_ac9a587142f134125bf851845b20f054.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a1bb073-c47d-5215-af82-0e906e91a8ed/0a1bb073-c47d-5215-af82-0e906e91a8ed_image_15.png',
             'Extension': 'png',
             'FileSizeInBytes': 125401,
             'Height': 525,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d0/74d0394e381f3da387c41961cc3fdbef/pa/JY05541_5ab181db9b789fd6b240649b80f3b2d3.png',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2020}
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JY05541%27 HTTP/1.1" 200 None
2026-01-29 06:02:20 [auto1.fr] INFO: Saving data for JY05541: {'created_time': 1769666540.591072, 'last_price_update_time': 1769666540.591081, 'auction_closing_time': 1769703737.0}
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JY05541') HTTP/1.1" 204 0
2026-01-29 06:02:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7ea48c2f-b56b-5e2d-8232-3de54c5653f7 with identifier: AC35213
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-01-29 06:02:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7ea48c2f-b56b-5e2d-8232-3de54c5653f7 with identifier: AC35213
2026-01-29 06:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'violet', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'ds automobiles ds3 crossback 1.2 puretech so chic', 'price': 0, 'currency': 'eur', 'make': 'ds automobiles', 'model': 'ds3 crossback', 'transmission': 'automatic', 'odometer': 65611, 'odometer_reading_unit': 'km', 'registration_date': '2019-06-18', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ac35213', 'expiration_date': '2026-01-29t16:06:18z', 'origin_country_code': 'fr', 'trim': 'so chic', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, nanteuil-le-haudouin', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': '7ea48c2f-b56b-5e2d-8232-3de54c5653f7', 'current_year_diff': 7, 'age_in_months': 79, 'make_model': 'ds automobiles ds3 crossback', 'sanitized_make': 'dsautomobiles', 'odometer_in_km': 65611}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 79,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'violet',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:06:18z',
     'fuel_type': 'petrol',
     'id': '7ea48c2f-b56b-5e2d-8232-3de54c5653f7',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ac35213',
     'listing': 'auction',
     'location': 'fr, nanteuil-le-haudouin',
     'make': 'ds automobiles',
     'make_model': 'ds automobiles ds3 crossback',
     'model': 'ds3 crossback',
     'odometer': 65611,
     'odometer_in_km': 65611,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-06-18',
     'sanitized_make': 'dsautomobiles',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ds automobiles ds3 crossback 1.2 puretech so chic',
     'transmission': 'automatic',
     'trim': 'so chic',
     'year': 2019}
2026-01-29 06:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 7ea48c2f-b56b-5e2d-8232-3de54c5653f7 spider: auto1.fr
2026-01-29 06:02:21 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 7ea48c2f-b56b-5e2d-8232-3de54c5653f7 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'violet', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'ds automobiles ds3 crossback 1.2 puretech so chic', 'price': 0, 'currency': 'eur', 'make': 'ds automobiles', 'model': 'ds3 crossback', 'transmission': 'automatic', 'odometer': 65611, 'odometer_reading_unit': 'km', 'registration_date': '2019-06-18', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ac35213', 'expiration_date': '2026-01-29t16:06:18z', 'origin_country_code': 'fr', 'trim': 'so chic', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, nanteuil-le-haudouin', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': '7ea48c2f-b56b-5e2d-8232-3de54c5653f7', 'current_year_diff': 7, 'age_in_months': 79, 'make_model': 'ds automobiles ds3 crossback', 'sanitized_make': 'dsautomobiles', 'odometer_in_km': 65611}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 79,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'violet',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:06:18z',
     'fuel_type': 'petrol',
     'id': '7ea48c2f-b56b-5e2d-8232-3de54c5653f7',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ac35213',
     'listing': 'auction',
     'location': 'fr, nanteuil-le-haudouin',
     'make': 'ds automobiles',
     'make_model': 'ds automobiles ds3 crossback',
     'model': 'ds3 crossback',
     'odometer': 65611,
     'odometer_in_km': 65611,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-06-18',
     'sanitized_make': 'dsautomobiles',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ds automobiles ds3 crossback 1.2 puretech so chic',
     'transmission': 'automatic',
     'trim': 'so chic',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:06:18Z',
 'fuel_type': 'petrol',
 'id': '7ea48c2f-b56b-5e2d-8232-3de54c5653f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC35213',
 'listing': 'auction',
 'location': 'FR, Nanteuil-le-Haudouin',
 'make': 'DS Automobiles',
 'model': 'DS3 Crossback',
 'odometer': 65611,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS Automobiles DS3 Crossback 1.2 PureTech So Chic',
 'transmission': 'automatic',
 'trim': 'So Chic',
 'year': 2019}
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AC35213%27 HTTP/1.1" 200 None
2026-01-29 06:02:21 [auto1.fr] INFO: Saving data for AC35213: {'auction_closing_time': 1769702778.0, 'created_time': 1768474038.521039, 'last_price_update_time': 1769666541.05898}
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AC35213') HTTP/1.1" 204 0
2026-01-29 06:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6e5dcd6d-21bb-582a-83b9-55f9c4cfe053 with identifier: ML57809
2026-01-29 06:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6e5dcd6d-21bb-582a-83b9-55f9c4cfe053 with identifier: ML57809
2026-01-29 06:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'ducato' containing 'ducato'
2026-01-29 06:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 6e5dcd6d-21bb-582a-83b9-55f9c4cfe053 spider: auto1.fr
2026-01-29 06:02:21 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 6e5dcd6d-21bb-582a-83b9-55f9c4cfe053 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'ducato' containing 'ducato'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.3L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:27:04Z',
 'fuel_type': 'diesel',
 'id': '6e5dcd6d-21bb-582a-83b9-55f9c4cfe053',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML57809',
 'listing': 'auction',
 'location': 'FR',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 106781,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-22',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Fiat Ducato 2.3 JTD 130 L2H2',
 'transmission': 'manual',
 'trim': '130 L2H2',
 'year': 2021}
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ML57809%27 HTTP/1.1" 200 None
2026-01-29 06:02:21 [auto1.fr] INFO: Saving data for ML57809: {'auction_closing_time': 1769704024.0, 'created_time': 1769533762.571031, 'last_price_update_time': 1769666541.394546}
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ML57809') HTTP/1.1" 204 0
2026-01-29 06:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5c36a47c-6896-5a28-95f9-dc4cb8be23ed with identifier: NP09597
2026-01-29 06:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5c36a47c-6896-5a28-95f9-dc4cb8be23ed with identifier: NP09597
2026-01-29 06:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit connect' containing 'transit'
2026-01-29 06:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 5c36a47c-6896-5a28-95f9-dc4cb8be23ed spider: auto1.fr
2026-01-29 06:02:21 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 5c36a47c-6896-5a28-95f9-dc4cb8be23ed due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit connect' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:38:45Z',
 'fuel_type': 'diesel',
 'id': '5c36a47c-6896-5a28-95f9-dc4cb8be23ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP09597',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Ford',
 'model': 'Transit Connect',
 'odometer': 113014,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-01-19',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Ford Transit Connect 1.5 EcoBlue TDCi Kasten Trend',
 'transmission': 'manual',
 'trim': 'Kasten Trend',
 'year': 2021}
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NP09597%27 HTTP/1.1" 200 None
2026-01-29 06:02:21 [auto1.fr] INFO: Saving data for NP09597: {'auction_closing_time': 1769704725.0, 'created_time': 1764136915.288418, 'last_price_update_time': 1769666541.68527}
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NP09597') HTTP/1.1" 204 0
2026-01-29 06:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d602d54c-1c3a-5281-8f20-d82143d6487b with identifier: NJ96560
2026-01-29 06:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d602d54c-1c3a-5281-8f20-d82143d6487b with identifier: NJ96560
2026-01-29 06:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 118666, 'odometer_reading_unit': 'km', 'registration_date': '2018-03-13', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nj96560', 'expiration_date': '2026-01-29t16:25:19z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, warluis', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 103, 'id': 'd602d54c-1c3a-5281-8f20-d82143d6487b', 'current_year_diff': 8, 'age_in_months': 94, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 118666}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 94,
     'auction_title': '',
     'c_o_2_emission_value': 103,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:25:19z',
     'fuel_type': 'petrol',
     'id': 'd602d54c-1c3a-5281-8f20-d82143d6487b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nj96560',
     'listing': 'auction',
     'location': 'fr, warluis',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 118666,
     'odometer_in_km': 118666,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-03-13',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2018}
2026-01-29 06:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: d602d54c-1c3a-5281-8f20-d82143d6487b spider: auto1.fr
2026-01-29 06:02:21 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: d602d54c-1c3a-5281-8f20-d82143d6487b due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 118666, 'odometer_reading_unit': 'km', 'registration_date': '2018-03-13', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nj96560', 'expiration_date': '2026-01-29t16:25:19z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, warluis', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 103, 'id': 'd602d54c-1c3a-5281-8f20-d82143d6487b', 'current_year_diff': 8, 'age_in_months': 94, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 118666}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 94,
     'auction_title': '',
     'c_o_2_emission_value': 103,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:25:19z',
     'fuel_type': 'petrol',
     'id': 'd602d54c-1c3a-5281-8f20-d82143d6487b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nj96560',
     'listing': 'auction',
     'location': 'fr, warluis',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 118666,
     'odometer_in_km': 118666,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-03-13',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:25:19Z',
 'fuel_type': 'petrol',
 'id': 'd602d54c-1c3a-5281-8f20-d82143d6487b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ96560',
 'listing': 'auction',
 'location': 'FR, Warluis',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 118666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2018}
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NJ96560%27 HTTP/1.1" 200 None
2026-01-29 06:02:21 [auto1.fr] INFO: Saving data for NJ96560: {'auction_closing_time': 1769703919.0, 'created_time': 1767609961.050835, 'last_price_update_time': 1769666541.95853}
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NJ96560') HTTP/1.1" 204 0
2026-01-29 06:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8fd07872-ba68-5f38-98c8-be6b04f843df with identifier: MP03922
2026-01-29 06:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8fd07872-ba68-5f38-98c8-be6b04f843df with identifier: MP03922
2026-01-29 06:02:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8fd07872-ba68-5f38-98c8-be6b04f843df with identifier: MP03922 to the API
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MP03922>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.7L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:32:40Z',
 'fuel_type': 'diesel',
 'id': '8fd07872-ba68-5f38-98c8-be6b04f843df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP03922',
 'listing': 'auction',
 'location': 'FR, LA CHAPELLE LONGUEVILLE',
 'make': 'Renault',
 'model': 'Talisman',
 'odometer': 111266,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_0c0889fb29aa782c9e4d5683fe742a44.jpg',
                'https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_e416de2eaed3b42d97b07517020a2b94.jpg',
                'https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_aeff929033265ab5656d59443ecd7a4d.jpg',
                'https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_5a99aa530b6161a8207829a76e2f9c5a.jpg',
                'https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_abfb747c1251e3520d17de111705884e.jpg',
                'https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_9703f358b41d17f307f772b57d303b31.jpg',
                'https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_1589733044e98cf535ef187cea57a0c8.jpg',
                'https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_7ba11870944808394a9c4886b55c8e31.jpg',
                'https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_17778875c0e07f6fb4f98ef1a1bf49ff.jpg',
                'https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_1d951d41b1ffb3c1ca5c032b3db2aa4a.jpg',
                'https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_6b9180f187265fc811889830334ac10e.jpg',
                'https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_867f088c4675fe58bd037e340c96f888.jpg',
                'https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_f9b1f0ce4e5523ce891efdab7135f223.jpg',
                'https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_8ccfcfb7d0fddfae9c848879541d1017.jpg',
                'https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_29d13143cf8c17476413bbca044bcb9a.jpg',
                'https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_a65fcd8cb959a1dec033149f2d021dcd.png'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fd07872-ba68-5f38-98c8-be6b04f843df/8fd07872-ba68-5f38-98c8-be6b04f843df_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2836742,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_0c0889fb29aa782c9e4d5683fe742a44.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fd07872-ba68-5f38-98c8-be6b04f843df/8fd07872-ba68-5f38-98c8-be6b04f843df_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_e416de2eaed3b42d97b07517020a2b94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fd07872-ba68-5f38-98c8-be6b04f843df/8fd07872-ba68-5f38-98c8-be6b04f843df_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2790212,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_aeff929033265ab5656d59443ecd7a4d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fd07872-ba68-5f38-98c8-be6b04f843df/8fd07872-ba68-5f38-98c8-be6b04f843df_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2795793,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_5a99aa530b6161a8207829a76e2f9c5a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fd07872-ba68-5f38-98c8-be6b04f843df/8fd07872-ba68-5f38-98c8-be6b04f843df_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3008623,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_abfb747c1251e3520d17de111705884e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fd07872-ba68-5f38-98c8-be6b04f843df/8fd07872-ba68-5f38-98c8-be6b04f843df_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2913054,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_9703f358b41d17f307f772b57d303b31.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fd07872-ba68-5f38-98c8-be6b04f843df/8fd07872-ba68-5f38-98c8-be6b04f843df_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2922042,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_1589733044e98cf535ef187cea57a0c8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fd07872-ba68-5f38-98c8-be6b04f843df/8fd07872-ba68-5f38-98c8-be6b04f843df_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3025316,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_7ba11870944808394a9c4886b55c8e31.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fd07872-ba68-5f38-98c8-be6b04f843df/8fd07872-ba68-5f38-98c8-be6b04f843df_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73508,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_17778875c0e07f6fb4f98ef1a1bf49ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fd07872-ba68-5f38-98c8-be6b04f843df/8fd07872-ba68-5f38-98c8-be6b04f843df_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_1d951d41b1ffb3c1ca5c032b3db2aa4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fd07872-ba68-5f38-98c8-be6b04f843df/8fd07872-ba68-5f38-98c8-be6b04f843df_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78412,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_6b9180f187265fc811889830334ac10e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fd07872-ba68-5f38-98c8-be6b04f843df/8fd07872-ba68-5f38-98c8-be6b04f843df_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_867f088c4675fe58bd037e340c96f888.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fd07872-ba68-5f38-98c8-be6b04f843df/8fd07872-ba68-5f38-98c8-be6b04f843df_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_f9b1f0ce4e5523ce891efdab7135f223.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fd07872-ba68-5f38-98c8-be6b04f843df/8fd07872-ba68-5f38-98c8-be6b04f843df_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61824,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_8ccfcfb7d0fddfae9c848879541d1017.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fd07872-ba68-5f38-98c8-be6b04f843df/8fd07872-ba68-5f38-98c8-be6b04f843df_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_29d13143cf8c17476413bbca044bcb9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fd07872-ba68-5f38-98c8-be6b04f843df/8fd07872-ba68-5f38-98c8-be6b04f843df_image_15.png',
             'Extension': 'png',
             'FileSizeInBytes': 91674,
             'Height': 525,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/bb/c1bb4f1561d8f98dd91d20e59b2eb87e/pa/MP03922_a65fcd8cb959a1dec033149f2d021dcd.png',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Talisman 1.7 BLUE dCi Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2019}
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP03922%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.fr] INFO: Saving data for MP03922: {'created_time': 1769666542.344446, 'last_price_update_time': 1769666542.344459, 'auction_closing_time': 1769704360.0}
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MP03922') HTTP/1.1" 204 0
2026-01-29 06:02:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5d287475-ad0d-5b48-b416-542a51fb4e4d with identifier: ZF28512
2026-01-29 06:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5d287475-ad0d-5b48-b416-542a51fb4e4d with identifier: ZF28512
2026-01-29 06:02:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5d287475-ad0d-5b48-b416-542a51fb4e4d with identifier: ZF28512 to the API
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZF28512>
{'auction_title': '',
 'c_o_2_emission_value': 32,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 218,
 'expiration_date': '2026-01-29T16:03:57Z',
 'fuel_type': 'hybrid',
 'id': '5d287475-ad0d-5b48-b416-542a51fb4e4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF28512',
 'listing': 'auction',
 'location': 'FR',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 53073,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 250e Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2020}
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZF28512%27 HTTP/1.1" 200 None
2026-01-29 06:02:22 [auto1.fr] INFO: Saving data for ZF28512: {'auction_closing_time': 1769702637.0, 'created_time': 1769533997.115082, 'last_price_update_time': 1769666542.740731}
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZF28512') HTTP/1.1" 204 0
2026-01-29 06:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c0a5890>
2026-01-29 06:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13bcd89a-e809-593e-9e17-60586737691f/13bcd89a-e809-593e-9e17-60586737691f_image_4.jpg HTTP/1.1" 201 0
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F67%252Fb46748a574ee174fd9b6e7cba83304f5%252Fpa%252FEK56691_4b1432f0ca45402435dc49eb6d49070f.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_4b1432f0ca45402435dc49eb6d49070f.jpg saved to cache
2026-01-29 06:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 13bcd89a-e809-593e-9e17-60586737691f
2026-01-29 06:02:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13bcd89a-e809-593e-9e17-60586737691f, skipping ID generation
2026-01-29 06:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13bcd89a-e809-593e-9e17-60586737691f with scrape type 1
2026-01-29 06:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 13bcd89a-e809-593e-9e17-60586737691f from tracking dictionaries
2026-01-29 06:02:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13bcd89a-e809-593e-9e17-60586737691f sending to next pipeline
2026-01-29 06:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 13bcd89a-e809-593e-9e17-60586737691f, identifier: EK56691
2026-01-29 06:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6fe02e50>
2026-01-29 06:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c00b751-7816-56cb-ba76-52a4c01c1d79/4c00b751-7816-56cb-ba76-52a4c01c1d79_image_0.jpg HTTP/1.1" 201 0
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F2b%252Fe12b206cfa1533c3ecf5552525f80d6b%252Fpa%252FYH47366_f04568a87485228ddfb6bbbe5bd23c5e.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_f04568a87485228ddfb6bbbe5bd23c5e.jpg saved to cache
2026-01-29 06:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c00b751-7816-56cb-ba76-52a4c01c1d79
2026-01-29 06:02:23 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-01-29 06:02:23 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2026-01-29 06:02:23 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2026-01-29 06:02:23 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2026-01-29 06:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f52c4d0>
2026-01-29 06:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c00b751-7816-56cb-ba76-52a4c01c1d79/4c00b751-7816-56cb-ba76-52a4c01c1d79_image_15.png HTTP/1.1" 201 0
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F2b%252Fe12b206cfa1533c3ecf5552525f80d6b%252Fpa%252FYH47366_4a062f75e622e1316046994fea1b2665.png') HTTP/1.1" 204 0
2026-01-29 06:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_4a062f75e622e1316046994fea1b2665.png saved to cache
2026-01-29 06:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 4c00b751-7816-56cb-ba76-52a4c01c1d79
2026-01-29 06:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f53fd50>
2026-01-29 06:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c00b751-7816-56cb-ba76-52a4c01c1d79/4c00b751-7816-56cb-ba76-52a4c01c1d79_image_14.jpg HTTP/1.1" 201 0
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F2b%252Fe12b206cfa1533c3ecf5552525f80d6b%252Fpa%252FYH47366_beeac77df8b554749a6dd7f17af620ed.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_beeac77df8b554749a6dd7f17af620ed.jpg saved to cache
2026-01-29 06:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 4c00b751-7816-56cb-ba76-52a4c01c1d79
2026-01-29 06:02:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c00b751-7816-56cb-ba76-52a4c01c1d79, skipping ID generation
2026-01-29 06:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c00b751-7816-56cb-ba76-52a4c01c1d79 with scrape type 1
2026-01-29 06:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4c00b751-7816-56cb-ba76-52a4c01c1d79 from tracking dictionaries
2026-01-29 06:02:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c00b751-7816-56cb-ba76-52a4c01c1d79 sending to next pipeline
2026-01-29 06:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4c00b751-7816-56cb-ba76-52a4c01c1d79, identifier: YH47366
2026-01-29 06:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 13bcd89a-e809-593e-9e17-60586737691f with identifier: EK56691
2026-01-29 06:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 13bcd89a-e809-593e-9e17-60586737691f with identifier: EK56691
2026-01-29 06:02:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 13bcd89a-e809-593e-9e17-60586737691f with identifier: EK56691 to the API
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_4b1432f0ca45402435dc49eb6d49070f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:49:42Z',
 'fuel_type': 'diesel',
 'id': '13bcd89a-e809-593e-9e17-60586737691f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK56691',
 'listing': 'auction',
 'location': 'FR, Camon',
 'make': 'BMW',
 'model': '1er',
 'odometer': 109979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13bcd89a-e809-593e-9e17-60586737691f/13bcd89a-e809-593e-9e17-60586737691f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_3fe258c07e5dc0ae429c7b044ea6abe4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13bcd89a-e809-593e-9e17-60586737691f/13bcd89a-e809-593e-9e17-60586737691f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_4910f6dfc479103863b02b84be4c1564.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13bcd89a-e809-593e-9e17-60586737691f/13bcd89a-e809-593e-9e17-60586737691f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_0674dce35e9cfe37d688af3f9a42dc26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13bcd89a-e809-593e-9e17-60586737691f/13bcd89a-e809-593e-9e17-60586737691f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53069,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_008b0cb9351cfa812d8b9e647c37106c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13bcd89a-e809-593e-9e17-60586737691f/13bcd89a-e809-593e-9e17-60586737691f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_4b1432f0ca45402435dc49eb6d49070f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13bcd89a-e809-593e-9e17-60586737691f/13bcd89a-e809-593e-9e17-60586737691f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_a25bf8debe19f45ed908db371d8beb21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13bcd89a-e809-593e-9e17-60586737691f/13bcd89a-e809-593e-9e17-60586737691f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_f890cdede714ab0fe010aececb456bef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13bcd89a-e809-593e-9e17-60586737691f/13bcd89a-e809-593e-9e17-60586737691f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63000,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_3fe4d0f3821063237b5ab7c2fef83eb5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13bcd89a-e809-593e-9e17-60586737691f/13bcd89a-e809-593e-9e17-60586737691f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_527501bb2cbaf6ea5e17c8b974c0749b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13bcd89a-e809-593e-9e17-60586737691f/13bcd89a-e809-593e-9e17-60586737691f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_b2192179bbc3d11d840737ad56b9cc23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13bcd89a-e809-593e-9e17-60586737691f/13bcd89a-e809-593e-9e17-60586737691f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_b128379f704a2ba660fd065a1b36267f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13bcd89a-e809-593e-9e17-60586737691f/13bcd89a-e809-593e-9e17-60586737691f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45542,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_ae63adfd0edd2c16045d0a7a16366dfc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13bcd89a-e809-593e-9e17-60586737691f/13bcd89a-e809-593e-9e17-60586737691f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68433,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_f373492c665127344828ba8a55bf9c2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13bcd89a-e809-593e-9e17-60586737691f/13bcd89a-e809-593e-9e17-60586737691f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32003,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_015f9a230ae6e2af32acac052dcac77a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13bcd89a-e809-593e-9e17-60586737691f/13bcd89a-e809-593e-9e17-60586737691f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_8970d2032b3708ed81fe6eb74d52ffea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13bcd89a-e809-593e-9e17-60586737691f/13bcd89a-e809-593e-9e17-60586737691f_image_15.png',
             'Extension': 'png',
             'FileSizeInBytes': 108167,
             'Height': 525,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/67/b46748a574ee174fd9b6e7cba83304f5/pa/EK56691_624a5562668e7ba5c3947e5b98176fff.png',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EK56691%27 HTTP/1.1" 200 None
2026-01-29 06:02:24 [auto1.fr] INFO: Saving data for EK56691: {'created_time': 1769666544.686506, 'last_price_update_time': 1769666544.686519, 'auction_closing_time': 1769705382.0}
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EK56691') HTTP/1.1" 204 0
2026-01-29 06:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4c00b751-7816-56cb-ba76-52a4c01c1d79 with identifier: YH47366
2026-01-29 06:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4c00b751-7816-56cb-ba76-52a4c01c1d79 with identifier: YH47366
2026-01-29 06:02:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4c00b751-7816-56cb-ba76-52a4c01c1d79 with identifier: YH47366 to the API
2026-01-29 06:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_beeac77df8b554749a6dd7f17af620ed.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:34:23Z',
 'fuel_type': 'diesel',
 'id': '4c00b751-7816-56cb-ba76-52a4c01c1d79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH47366',
 'listing': 'auction',
 'location': 'FR, Haguenau',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 124760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c00b751-7816-56cb-ba76-52a4c01c1d79/4c00b751-7816-56cb-ba76-52a4c01c1d79_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66132,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_f04568a87485228ddfb6bbbe5bd23c5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c00b751-7816-56cb-ba76-52a4c01c1d79/4c00b751-7816-56cb-ba76-52a4c01c1d79_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_de1dfd0ca53d06674f6e999feff372d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c00b751-7816-56cb-ba76-52a4c01c1d79/4c00b751-7816-56cb-ba76-52a4c01c1d79_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_e706d8456cf74eb4ba4e6330f493a596.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c00b751-7816-56cb-ba76-52a4c01c1d79/4c00b751-7816-56cb-ba76-52a4c01c1d79_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_369351e4a43c5f6a1348674d9a26e87b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c00b751-7816-56cb-ba76-52a4c01c1d79/4c00b751-7816-56cb-ba76-52a4c01c1d79_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_b1174aa405d523b0c5c63b7d8fb469d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c00b751-7816-56cb-ba76-52a4c01c1d79/4c00b751-7816-56cb-ba76-52a4c01c1d79_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_79b47820910fa86340988461c7147e5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c00b751-7816-56cb-ba76-52a4c01c1d79/4c00b751-7816-56cb-ba76-52a4c01c1d79_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60546,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_51bd32dd5abe0b62104b69030bf6f0ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c00b751-7816-56cb-ba76-52a4c01c1d79/4c00b751-7816-56cb-ba76-52a4c01c1d79_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_bcbafa5abbe76e5f0abe6c95b0e706aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c00b751-7816-56cb-ba76-52a4c01c1d79/4c00b751-7816-56cb-ba76-52a4c01c1d79_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70163,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_796ea56647ad213834d5dc32d624a051.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c00b751-7816-56cb-ba76-52a4c01c1d79/4c00b751-7816-56cb-ba76-52a4c01c1d79_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48366,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_477e574bf0b311a9934f9113fecaf234.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c00b751-7816-56cb-ba76-52a4c01c1d79/4c00b751-7816-56cb-ba76-52a4c01c1d79_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_26582d27b1caa52c87395f62a1aa772f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c00b751-7816-56cb-ba76-52a4c01c1d79/4c00b751-7816-56cb-ba76-52a4c01c1d79_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_c8973121d871f6ab503710dfcf1d00b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c00b751-7816-56cb-ba76-52a4c01c1d79/4c00b751-7816-56cb-ba76-52a4c01c1d79_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70239,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_36118053c1005009ce724ffb72da4507.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c00b751-7816-56cb-ba76-52a4c01c1d79/4c00b751-7816-56cb-ba76-52a4c01c1d79_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_04a848438021aa175c30d68e0b9f179d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c00b751-7816-56cb-ba76-52a4c01c1d79/4c00b751-7816-56cb-ba76-52a4c01c1d79_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_beeac77df8b554749a6dd7f17af620ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c00b751-7816-56cb-ba76-52a4c01c1d79/4c00b751-7816-56cb-ba76-52a4c01c1d79_image_15.png',
             'Extension': 'png',
             'FileSizeInBytes': 108817,
             'Height': 525,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/2b/e12b206cfa1533c3ecf5552525f80d6b/pa/YH47366_4a062f75e622e1316046994fea1b2665.png',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-30',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 1.5 Blue-HDi Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2018}
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YH47366%27 HTTP/1.1" 200 None
2026-01-29 06:02:25 [auto1.fr] INFO: Saving data for YH47366: {'created_time': 1769666545.292958, 'last_price_update_time': 1769666545.292968, 'auction_closing_time': 1769704463.0}
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YH47366') HTTP/1.1" 204 0
2026-01-29 06:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EH94085/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NV25263/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SA16378> (referer: https://www.auto1.com/v1/car-details-view/SA16378/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23739264-4f6d-59e2-b61e-61310693cdd1 with identifier: SA16378
2026-01-29 06:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23739264-4f6d-59e2-b61e-61310693cdd1 with scrape type 1
2026-01-29 06:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 23739264-4f6d-59e2-b61e-61310693cdd1
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fa7%252Feda74badf47d0358e82583630100dd51%252Fpa%252FSA16378_e24f6d5689aec4e57cb7a4fa7938821d.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_e24f6d5689aec4e57cb7a4fa7938821d.jpg not downloaded yet
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fa7%252Feda74badf47d0358e82583630100dd51%252Fpa%252FSA16378_cbe3974f2c0f5193695e44693c9d4e75.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_cbe3974f2c0f5193695e44693c9d4e75.jpg not downloaded yet
2026-01-29 06:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GZ75839> (referer: https://www.auto1.com/v1/car-details-view/GZ75839/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fa7%252Feda74badf47d0358e82583630100dd51%252Fpa%252FSA16378_33fe3ac1771aa7ff2a9069ed4dd28d26.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_33fe3ac1771aa7ff2a9069ed4dd28d26.jpg not downloaded yet
2026-01-29 06:02:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:26 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fa7%252Feda74badf47d0358e82583630100dd51%252Fpa%252FSA16378_7b815ce09937b0d5a664476ba1c85108.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_7b815ce09937b0d5a664476ba1c85108.jpg not downloaded yet
2026-01-29 06:02:26 [auto1.fr] INFO: Found listing with ID: AM99512
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AM99512%27 HTTP/1.1" 200 None
2026-01-29 06:02:26 [auto1.fr] INFO: Scrape type for AM99512: 2
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fa7%252Feda74badf47d0358e82583630100dd51%252Fpa%252FSA16378_f81c83f7f4b142b178d69d48132d7abd.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_f81c83f7f4b142b178d69d48132d7abd.jpg not downloaded yet
2026-01-29 06:02:26 [auto1.fr] INFO: Found listing with ID: BP20652
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BP20652%27 HTTP/1.1" 200 None
2026-01-29 06:02:26 [auto1.fr] INFO: Scrape type for BP20652: 1
2026-01-29 06:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DG06084> (referer: https://www.auto1.com/v1/car-details-view/DG06084/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FV47029> (referer: https://www.auto1.com/v1/car-details-view/FV47029/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_cbe3974f2c0f5193695e44693c9d4e75.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fa7%252Feda74badf47d0358e82583630100dd51%252Fpa%252FSA16378_bcc5ec32581de62097c45d4f76c30164.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_bcc5ec32581de62097c45d4f76c30164.jpg not downloaded yet
2026-01-29 06:02:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:26 [auto1.fr] INFO: Found listing with ID: HV11648
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HV11648%27 HTTP/1.1" 200 None
2026-01-29 06:02:26 [auto1.fr] INFO: Scrape type for HV11648: 1
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fa7%252Feda74badf47d0358e82583630100dd51%252Fpa%252FSA16378_42f093a930c261a22addc324bd57d8c0.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_42f093a930c261a22addc324bd57d8c0.jpg not downloaded yet
2026-01-29 06:02:26 [auto1.fr] INFO: Found listing with ID: UY38099
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY38099%27 HTTP/1.1" 200 None
2026-01-29 06:02:26 [auto1.fr] INFO: Scrape type for UY38099: 1
2026-01-29 06:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ffeecaf-e5f5-527b-ad36-dd80ae8f8fe6 with identifier: GZ75839
2026-01-29 06:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ffeecaf-e5f5-527b-ad36-dd80ae8f8fe6 with scrape type 2
2026-01-29 06:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ffeecaf-e5f5-527b-ad36-dd80ae8f8fe6 with scrape type 2
2026-01-29 06:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2ffeecaf-e5f5-527b-ad36-dd80ae8f8fe6, identifier: GZ75839
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fa7%252Feda74badf47d0358e82583630100dd51%252Fpa%252FSA16378_ebf814a8b00d19df365bc2e9c29d9f40.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_ebf814a8b00d19df365bc2e9c29d9f40.jpg not downloaded yet
2026-01-29 06:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2ffeecaf-e5f5-527b-ad36-dd80ae8f8fe6 with identifier: GZ75839
2026-01-29 06:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2ffeecaf-e5f5-527b-ad36-dd80ae8f8fe6 with identifier: GZ75839
2026-01-29 06:02:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2ffeecaf-e5f5-527b-ad36-dd80ae8f8fe6 with identifier: GZ75839 to the API
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GZ75839>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 200,
 'expiration_date': '2026-01-29T16:57:09Z',
 'fuel_type': 'diesel',
 'id': '2ffeecaf-e5f5-527b-ad36-dd80ae8f8fe6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ75839',
 'listing': 'auction',
 'location': 'FR',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 110439,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-26',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Renault Espace 2.0 BLUE dCi Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2019}
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GZ75839%27 HTTP/1.1" 200 None
2026-01-29 06:02:26 [auto1.fr] INFO: Saving data for GZ75839: {'auction_closing_time': 1769705829.0, 'created_time': 1769533944.935022, 'last_price_update_time': 1769666546.93752}
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GZ75839') HTTP/1.1" 204 0
2026-01-29 06:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_7b815ce09937b0d5a664476ba1c85108.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_f81c83f7f4b142b178d69d48132d7abd.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:27 [auto1.fr] INFO: Found listing with ID: WH04137
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WH04137%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.fr] INFO: Scrape type for WH04137: 2
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fa7%252Feda74badf47d0358e82583630100dd51%252Fpa%252FSA16378_292f7b1f84c3386ffddff463f9847576.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_292f7b1f84c3386ffddff463f9847576.jpg not downloaded yet
2026-01-29 06:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RR80485> (referer: https://www.auto1.com/v1/car-details-view/RR80485/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PR67213/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:27 [auto1.fr] INFO: Found listing with ID: EX68791
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EX68791%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.fr] INFO: Scrape type for EX68791: 2
2026-01-29 06:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VG10471/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LG78632/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fa7%252Feda74badf47d0358e82583630100dd51%252Fpa%252FSA16378_cd7ecf7054331e6988ad779e3d6971e4.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_cd7ecf7054331e6988ad779e3d6971e4.jpg not downloaded yet
2026-01-29 06:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9810a95b-bf41-5b0a-a46e-a8f034c2aa8a with identifier: DG06084
2026-01-29 06:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9810a95b-bf41-5b0a-a46e-a8f034c2aa8a with scrape type 2
2026-01-29 06:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9810a95b-bf41-5b0a-a46e-a8f034c2aa8a with scrape type 2
2026-01-29 06:02:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9810a95b-bf41-5b0a-a46e-a8f034c2aa8a, identifier: DG06084
2026-01-29 06:02:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1d7377b-9af9-5c96-8031-2a907dc53a6a with identifier: FV47029
2026-01-29 06:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1d7377b-9af9-5c96-8031-2a907dc53a6a with scrape type 1
2026-01-29 06:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item c1d7377b-9af9-5c96-8031-2a907dc53a6a
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff0%252Fb1f07102e6b2523a36ff46d7b3fbd390%252Fpa%252FFV47029_68d2097e82d660cbfedc71bb9be8b4fa.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_68d2097e82d660cbfedc71bb9be8b4fa.jpg not downloaded yet
2026-01-29 06:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6fef5050>
2026-01-29 06:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23739264-4f6d-59e2-b61e-61310693cdd1/23739264-4f6d-59e2-b61e-61310693cdd1_image_1.jpg HTTP/1.1" 201 0
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fa7%252Feda74badf47d0358e82583630100dd51%252Fpa%252FSA16378_cbe3974f2c0f5193695e44693c9d4e75.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_cbe3974f2c0f5193695e44693c9d4e75.jpg saved to cache
2026-01-29 06:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 23739264-4f6d-59e2-b61e-61310693cdd1
2026-01-29 06:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_42f093a930c261a22addc324bd57d8c0.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:27 [auto1.fr] INFO: Found listing with ID: KS56768
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KS56768%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.fr] INFO: Scrape type for KS56768: 0
2026-01-29 06:02:27 [auto1.fr] INFO: Found listing with ID: JB37332
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JB37332%27 HTTP/1.1" 200 None
2026-01-29 06:02:27 [auto1.fr] INFO: Scrape type for JB37332: 1
2026-01-29 06:02:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9810a95b-bf41-5b0a-a46e-a8f034c2aa8a with identifier: DG06084
2026-01-29 06:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9810a95b-bf41-5b0a-a46e-a8f034c2aa8a with identifier: DG06084
2026-01-29 06:02:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9810a95b-bf41-5b0a-a46e-a8f034c2aa8a with identifier: DG06084 to the API
2026-01-29 06:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DG06084>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:03:02Z',
 'fuel_type': 'diesel',
 'id': '9810a95b-bf41-5b0a-a46e-a8f034c2aa8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG06084',
 'listing': 'auction',
 'location': 'FR, Ingrandes sur Vienne',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 62283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
 'transmission': 'manual',
 'trim': 'Limited FWD',
 'year': 2022}
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DG06084%27 HTTP/1.1" 200 None
2026-01-29 06:02:28 [auto1.fr] INFO: Saving data for DG06084: {'auction_closing_time': 1769702582.0, 'created_time': 1768819774.837887, 'last_price_update_time': 1769666548.299171}
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DG06084') HTTP/1.1" 204 0
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fa7%252Feda74badf47d0358e82583630100dd51%252Fpa%252FSA16378_c2ceda50e6e26e2fbda02f6e79f42340.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_c2ceda50e6e26e2fbda02f6e79f42340.jpg not downloaded yet
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff0%252Fb1f07102e6b2523a36ff46d7b3fbd390%252Fpa%252FFV47029_b9ff03276bcf9941b3dc0fb57df7d39a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_b9ff03276bcf9941b3dc0fb57df7d39a.jpg not downloaded yet
2026-01-29 06:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UF99896/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:28 [auto1.fr] INFO: Found listing with ID: PV20302
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PV20302%27 HTTP/1.1" 200 None
2026-01-29 06:02:28 [auto1.fr] INFO: Scrape type for PV20302: 2
2026-01-29 06:02:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c1a1010>
2026-01-29 06:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23739264-4f6d-59e2-b61e-61310693cdd1/23739264-4f6d-59e2-b61e-61310693cdd1_image_3.jpg HTTP/1.1" 201 0
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fa7%252Feda74badf47d0358e82583630100dd51%252Fpa%252FSA16378_7b815ce09937b0d5a664476ba1c85108.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_7b815ce09937b0d5a664476ba1c85108.jpg saved to cache
2026-01-29 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 23739264-4f6d-59e2-b61e-61310693cdd1
2026-01-29 06:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c1b2390>
2026-01-29 06:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23739264-4f6d-59e2-b61e-61310693cdd1/23739264-4f6d-59e2-b61e-61310693cdd1_image_4.jpg HTTP/1.1" 201 0
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fa7%252Feda74badf47d0358e82583630100dd51%252Fpa%252FSA16378_f81c83f7f4b142b178d69d48132d7abd.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_f81c83f7f4b142b178d69d48132d7abd.jpg saved to cache
2026-01-29 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 23739264-4f6d-59e2-b61e-61310693cdd1
2026-01-29 06:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d415643d-090f-575a-a4d3-8a688e9611f1 with identifier: RR80485
2026-01-29 06:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d415643d-090f-575a-a4d3-8a688e9611f1 with scrape type 2
2026-01-29 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d415643d-090f-575a-a4d3-8a688e9611f1 with scrape type 2
2026-01-29 06:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d415643d-090f-575a-a4d3-8a688e9611f1, identifier: RR80485
2026-01-29 06:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_292f7b1f84c3386ffddff463f9847576.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fa7%252Feda74badf47d0358e82583630100dd51%252Fpa%252FSA16378_b3c1322d65f3278c7f6c5611c4201daa.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_b3c1322d65f3278c7f6c5611c4201daa.jpg not downloaded yet
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff0%252Fb1f07102e6b2523a36ff46d7b3fbd390%252Fpa%252FFV47029_c9ae30db06576ecaa1805ffb727cf3fc.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_c9ae30db06576ecaa1805ffb727cf3fc.jpg not downloaded yet
2026-01-29 06:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ER42739/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d415643d-090f-575a-a4d3-8a688e9611f1 with identifier: RR80485
2026-01-29 06:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d415643d-090f-575a-a4d3-8a688e9611f1 with identifier: RR80485
2026-01-29 06:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit custom' containing 'transit'
2026-01-29 06:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: d415643d-090f-575a-a4d3-8a688e9611f1 spider: auto1.fr
2026-01-29 06:02:29 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: d415643d-090f-575a-a4d3-8a688e9611f1 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit custom' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': 186,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-01-29T16:50:08Z',
 'fuel_type': 'diesel',
 'id': 'd415643d-090f-575a-a4d3-8a688e9611f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR80485',
 'listing': 'auction',
 'location': 'FR',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 186753,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-06',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 310 L1 Sport',
 'transmission': 'automatic',
 'trim': '310 L1 Sport',
 'year': 2018}
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RR80485%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.fr] INFO: Saving data for RR80485: {'auction_closing_time': 1769705408.0, 'created_time': 1769534059.108371, 'last_price_update_time': 1769666549.419593}
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RR80485') HTTP/1.1" 204 0
2026-01-29 06:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_ebf814a8b00d19df365bc2e9c29d9f40.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:29 [auto1.fr] INFO: Found listing with ID: WT08030
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WT08030%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.fr] INFO: Scrape type for WT08030: 2
2026-01-29 06:02:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f45b810>
2026-01-29 06:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23739264-4f6d-59e2-b61e-61310693cdd1/23739264-4f6d-59e2-b61e-61310693cdd1_image_6.jpg HTTP/1.1" 201 0
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fa7%252Feda74badf47d0358e82583630100dd51%252Fpa%252FSA16378_42f093a930c261a22addc324bd57d8c0.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_42f093a930c261a22addc324bd57d8c0.jpg saved to cache
2026-01-29 06:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 23739264-4f6d-59e2-b61e-61310693cdd1
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fa7%252Feda74badf47d0358e82583630100dd51%252Fpa%252FSA16378_524a1d715a1a2ab86c51a17041d9e2ba.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_524a1d715a1a2ab86c51a17041d9e2ba.jpg not downloaded yet
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff0%252Fb1f07102e6b2523a36ff46d7b3fbd390%252Fpa%252FFV47029_a019acb068cb171700c7b12b5c32ee48.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_a019acb068cb171700c7b12b5c32ee48.jpg not downloaded yet
2026-01-29 06:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YY96568/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JR61080/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:29 [auto1.fr] INFO: Found listing with ID: WN92685
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WN92685%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [auto1.fr] INFO: Scrape type for WN92685: 2
2026-01-29 06:02:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fa7%252Feda74badf47d0358e82583630100dd51%252Fpa%252FSA16378_aa67fc451d0074f9068a0b5d83cbb2b6.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_aa67fc451d0074f9068a0b5d83cbb2b6.jpg not downloaded yet
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff0%252Fb1f07102e6b2523a36ff46d7b3fbd390%252Fpa%252FFV47029_92adab970f19b7966893fc35f6504674.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_92adab970f19b7966893fc35f6504674.jpg not downloaded yet
2026-01-29 06:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c27b410>
2026-01-29 06:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23739264-4f6d-59e2-b61e-61310693cdd1/23739264-4f6d-59e2-b61e-61310693cdd1_image_8.jpg HTTP/1.1" 201 0
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fa7%252Feda74badf47d0358e82583630100dd51%252Fpa%252FSA16378_292f7b1f84c3386ffddff463f9847576.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_292f7b1f84c3386ffddff463f9847576.jpg saved to cache
2026-01-29 06:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 23739264-4f6d-59e2-b61e-61310693cdd1
2026-01-29 06:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f3a0750>
2026-01-29 06:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23739264-4f6d-59e2-b61e-61310693cdd1/23739264-4f6d-59e2-b61e-61310693cdd1_image_7.jpg HTTP/1.1" 201 0
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fa7%252Feda74badf47d0358e82583630100dd51%252Fpa%252FSA16378_ebf814a8b00d19df365bc2e9c29d9f40.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_ebf814a8b00d19df365bc2e9c29d9f40.jpg saved to cache
2026-01-29 06:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 23739264-4f6d-59e2-b61e-61310693cdd1
2026-01-29 06:02:30 [auto1.fr] INFO: Found listing with ID: XA49145
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XA49145%27 HTTP/1.1" 200 None
2026-01-29 06:02:30 [auto1.fr] INFO: Scrape type for XA49145: 1
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fa7%252Feda74badf47d0358e82583630100dd51%252Fpa%252FSA16378_d5cc30b96d14d95f0530dd6d4f912aa5.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_d5cc30b96d14d95f0530dd6d4f912aa5.jpg not downloaded yet
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff0%252Fb1f07102e6b2523a36ff46d7b3fbd390%252Fpa%252FFV47029_e13338601d80d46d0c2097cb8aa45c67.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_e13338601d80d46d0c2097cb8aa45c67.jpg not downloaded yet
2026-01-29 06:02:30 [auto1.fr] INFO: Found listing with ID: MF46010
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MF46010%27 HTTP/1.1" 200 None
2026-01-29 06:02:30 [auto1.fr] INFO: Scrape type for MF46010: 1
2026-01-29 06:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_a019acb068cb171700c7b12b5c32ee48.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_524a1d715a1a2ab86c51a17041d9e2ba.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fa7%252Feda74badf47d0358e82583630100dd51%252Fpa%252FSA16378_b3c671b436a01660c9b7dd29a61aa35b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_b3c671b436a01660c9b7dd29a61aa35b.jpg not downloaded yet
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff0%252Fb1f07102e6b2523a36ff46d7b3fbd390%252Fpa%252FFV47029_25d22a409d85b1e3da9b2ea6c72c7a92.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_25d22a409d85b1e3da9b2ea6c72c7a92.jpg not downloaded yet
2026-01-29 06:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UD83687/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:30 [auto1.fr] INFO: Found listing with ID: UG35109
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG35109%27 HTTP/1.1" 200 None
2026-01-29 06:02:30 [auto1.fr] INFO: Scrape type for UG35109: 1
2026-01-29 06:02:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XU49551/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CL14274/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RU54394/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff0%252Fb1f07102e6b2523a36ff46d7b3fbd390%252Fpa%252FFV47029_7f20bbdab0302477421a48959af0a4a2.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_7f20bbdab0302477421a48959af0a4a2.jpg not downloaded yet
2026-01-29 06:02:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:30 [auto1.fr] INFO: Found listing with ID: PJ01244
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PJ01244%27 HTTP/1.1" 200 None
2026-01-29 06:02:30 [auto1.fr] INFO: Scrape type for PJ01244: 2
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff0%252Fb1f07102e6b2523a36ff46d7b3fbd390%252Fpa%252FFV47029_580fe17e316d0fc1e61a1f515ba9890c.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_580fe17e316d0fc1e61a1f515ba9890c.jpg not downloaded yet
2026-01-29 06:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_d5cc30b96d14d95f0530dd6d4f912aa5.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_e13338601d80d46d0c2097cb8aa45c67.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:30 [auto1.fr] INFO: Found listing with ID: YG08279
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG08279%27 HTTP/1.1" 200 None
2026-01-29 06:02:30 [auto1.fr] INFO: Scrape type for YG08279: 2
2026-01-29 06:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f39b290>
2026-01-29 06:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1d7377b-9af9-5c96-8031-2a907dc53a6a/c1d7377b-9af9-5c96-8031-2a907dc53a6a_image_3.jpg HTTP/1.1" 201 0
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff0%252Fb1f07102e6b2523a36ff46d7b3fbd390%252Fpa%252FFV47029_a019acb068cb171700c7b12b5c32ee48.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_a019acb068cb171700c7b12b5c32ee48.jpg saved to cache
2026-01-29 06:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c1d7377b-9af9-5c96-8031-2a907dc53a6a
2026-01-29 06:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f3a53d0>
2026-01-29 06:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23739264-4f6d-59e2-b61e-61310693cdd1/23739264-4f6d-59e2-b61e-61310693cdd1_image_12.jpg HTTP/1.1" 201 0
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fa7%252Feda74badf47d0358e82583630100dd51%252Fpa%252FSA16378_524a1d715a1a2ab86c51a17041d9e2ba.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_524a1d715a1a2ab86c51a17041d9e2ba.jpg saved to cache
2026-01-29 06:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 23739264-4f6d-59e2-b61e-61310693cdd1
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff0%252Fb1f07102e6b2523a36ff46d7b3fbd390%252Fpa%252FFV47029_28df8bfe9918753e6a85dbb9a57373a9.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_28df8bfe9918753e6a85dbb9a57373a9.jpg not downloaded yet
2026-01-29 06:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_25d22a409d85b1e3da9b2ea6c72c7a92.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_b3c671b436a01660c9b7dd29a61aa35b.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:31 [auto1.fr] INFO: Found listing with ID: ZH57094
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZH57094%27 HTTP/1.1" 200 None
2026-01-29 06:02:31 [auto1.fr] INFO: Scrape type for ZH57094: 1
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff0%252Fb1f07102e6b2523a36ff46d7b3fbd390%252Fpa%252FFV47029_5f5a4898992a6f405da9fd190565ebc2.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_5f5a4898992a6f405da9fd190565ebc2.jpg not downloaded yet
2026-01-29 06:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NK06116/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f5e17d0>
2026-01-29 06:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23739264-4f6d-59e2-b61e-61310693cdd1/23739264-4f6d-59e2-b61e-61310693cdd1_image_14.jpg HTTP/1.1" 201 0
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fa7%252Feda74badf47d0358e82583630100dd51%252Fpa%252FSA16378_d5cc30b96d14d95f0530dd6d4f912aa5.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_d5cc30b96d14d95f0530dd6d4f912aa5.jpg saved to cache
2026-01-29 06:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 23739264-4f6d-59e2-b61e-61310693cdd1
2026-01-29 06:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f50d9d0>
2026-01-29 06:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1d7377b-9af9-5c96-8031-2a907dc53a6a/c1d7377b-9af9-5c96-8031-2a907dc53a6a_image_5.jpg HTTP/1.1" 201 0
2026-01-29 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff0%252Fb1f07102e6b2523a36ff46d7b3fbd390%252Fpa%252FFV47029_e13338601d80d46d0c2097cb8aa45c67.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_e13338601d80d46d0c2097cb8aa45c67.jpg saved to cache
2026-01-29 06:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c1d7377b-9af9-5c96-8031-2a907dc53a6a
2026-01-29 06:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_7f20bbdab0302477421a48959af0a4a2.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:32 [auto1.fr] INFO: Found listing with ID: FP06893
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP06893%27 HTTP/1.1" 200 None
2026-01-29 06:02:32 [auto1.fr] INFO: Scrape type for FP06893: 1
2026-01-29 06:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AM99512/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff0%252Fb1f07102e6b2523a36ff46d7b3fbd390%252Fpa%252FFV47029_31b82a9448ec3994921106aa79f6fb0f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_31b82a9448ec3994921106aa79f6fb0f.jpg not downloaded yet
2026-01-29 06:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:32 [auto1.fr] INFO: Found listing with ID: WF45820
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WF45820%27 HTTP/1.1" 200 None
2026-01-29 06:02:32 [auto1.fr] INFO: Scrape type for WF45820: 2
2026-01-29 06:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UY38099/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WH04137/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f47b550>
2026-01-29 06:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1d7377b-9af9-5c96-8031-2a907dc53a6a/c1d7377b-9af9-5c96-8031-2a907dc53a6a_image_6.jpg HTTP/1.1" 201 0
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff0%252Fb1f07102e6b2523a36ff46d7b3fbd390%252Fpa%252FFV47029_25d22a409d85b1e3da9b2ea6c72c7a92.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_25d22a409d85b1e3da9b2ea6c72c7a92.jpg saved to cache
2026-01-29 06:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c1d7377b-9af9-5c96-8031-2a907dc53a6a
2026-01-29 06:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c140410>
2026-01-29 06:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23739264-4f6d-59e2-b61e-61310693cdd1/23739264-4f6d-59e2-b61e-61310693cdd1_image_15.jpg HTTP/1.1" 201 0
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fa7%252Feda74badf47d0358e82583630100dd51%252Fpa%252FSA16378_b3c671b436a01660c9b7dd29a61aa35b.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_b3c671b436a01660c9b7dd29a61aa35b.jpg saved to cache
2026-01-29 06:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 23739264-4f6d-59e2-b61e-61310693cdd1
2026-01-29 06:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_28df8bfe9918753e6a85dbb9a57373a9.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff0%252Fb1f07102e6b2523a36ff46d7b3fbd390%252Fpa%252FFV47029_75bb57af1e8fa160133625f406826ece.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_75bb57af1e8fa160133625f406826ece.jpg not downloaded yet
2026-01-29 06:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:32 [auto1.fr] INFO: Found listing with ID: CJ16783
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CJ16783%27 HTTP/1.1" 200 None
2026-01-29 06:02:32 [auto1.fr] INFO: Scrape type for CJ16783: 1
2026-01-29 06:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_580fe17e316d0fc1e61a1f515ba9890c.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff0%252Fb1f07102e6b2523a36ff46d7b3fbd390%252Fpa%252FFV47029_0e8571629b67742f701429b59d9adf95.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_0e8571629b67742f701429b59d9adf95.jpg not downloaded yet
2026-01-29 06:02:32 [auto1.fr] INFO: Found listing with ID: NS66111
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NS66111%27 HTTP/1.1" 200 None
2026-01-29 06:02:32 [auto1.fr] INFO: Scrape type for NS66111: 1
2026-01-29 06:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f47a1d0>
2026-01-29 06:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-29 06:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1d7377b-9af9-5c96-8031-2a907dc53a6a/c1d7377b-9af9-5c96-8031-2a907dc53a6a_image_7.jpg HTTP/1.1" 201 0
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff0%252Fb1f07102e6b2523a36ff46d7b3fbd390%252Fpa%252FFV47029_7f20bbdab0302477421a48959af0a4a2.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_7f20bbdab0302477421a48959af0a4a2.jpg saved to cache
2026-01-29 06:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c1d7377b-9af9-5c96-8031-2a907dc53a6a
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff0%252Fb1f07102e6b2523a36ff46d7b3fbd390%252Fpa%252FFV47029_05f8062a9da3b794be54ebb145f55ff1.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_05f8062a9da3b794be54ebb145f55ff1.jpg not downloaded yet
2026-01-29 06:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_31b82a9448ec3994921106aa79f6fb0f.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:33 [auto1.fr] INFO: Found listing with ID: WB61267
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB61267%27 HTTP/1.1" 200 None
2026-01-29 06:02:33 [auto1.fr] INFO: Scrape type for WB61267: 2
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff0%252Fb1f07102e6b2523a36ff46d7b3fbd390%252Fpa%252FFV47029_bc4f941be73b087fa295089e784af21a.png%27 HTTP/1.1" 200 None
2026-01-29 06:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_bc4f941be73b087fa295089e784af21a.png not downloaded yet
2026-01-29 06:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EX68791/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LG78632> (referer: https://www.auto1.com/v1/car-details-view/LG78632/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HV11648/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB37332/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f33d1d0>
2026-01-29 06:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1d7377b-9af9-5c96-8031-2a907dc53a6a/c1d7377b-9af9-5c96-8031-2a907dc53a6a_image_9.jpg HTTP/1.1" 201 0
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff0%252Fb1f07102e6b2523a36ff46d7b3fbd390%252Fpa%252FFV47029_28df8bfe9918753e6a85dbb9a57373a9.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_28df8bfe9918753e6a85dbb9a57373a9.jpg saved to cache
2026-01-29 06:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c1d7377b-9af9-5c96-8031-2a907dc53a6a
2026-01-29 06:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c2e6650>
2026-01-29 06:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1d7377b-9af9-5c96-8031-2a907dc53a6a/c1d7377b-9af9-5c96-8031-2a907dc53a6a_image_8.jpg HTTP/1.1" 201 0
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff0%252Fb1f07102e6b2523a36ff46d7b3fbd390%252Fpa%252FFV47029_580fe17e316d0fc1e61a1f515ba9890c.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_580fe17e316d0fc1e61a1f515ba9890c.jpg saved to cache
2026-01-29 06:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c1d7377b-9af9-5c96-8031-2a907dc53a6a
2026-01-29 06:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_75bb57af1e8fa160133625f406826ece.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:33 [auto1.fr] INFO: Found listing with ID: UA69739
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UA69739%27 HTTP/1.1" 200 None
2026-01-29 06:02:33 [auto1.fr] INFO: Scrape type for UA69739: 0
2026-01-29 06:02:33 [auto1.fr] INFO: Found listing with ID: JE59614
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JE59614%27 HTTP/1.1" 200 None
2026-01-29 06:02:33 [auto1.fr] INFO: Scrape type for JE59614: 2
2026-01-29 06:02:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:33 [auto1.fr] INFO: Found listing with ID: UE27789
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UE27789%27 HTTP/1.1" 200 None
2026-01-29 06:02:33 [auto1.fr] INFO: Scrape type for UE27789: 0
2026-01-29 06:02:33 [auto1.fr] INFO: Found listing with ID: LX40728
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LX40728%27 HTTP/1.1" 200 None
2026-01-29 06:02:33 [auto1.fr] INFO: Scrape type for LX40728: 2
2026-01-29 06:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f506750>
2026-01-29 06:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1d7377b-9af9-5c96-8031-2a907dc53a6a/c1d7377b-9af9-5c96-8031-2a907dc53a6a_image_11.jpg HTTP/1.1" 201 0
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff0%252Fb1f07102e6b2523a36ff46d7b3fbd390%252Fpa%252FFV47029_31b82a9448ec3994921106aa79f6fb0f.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_31b82a9448ec3994921106aa79f6fb0f.jpg saved to cache
2026-01-29 06:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item c1d7377b-9af9-5c96-8031-2a907dc53a6a
2026-01-29 06:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 710753ee-6cec-53b3-b79c-21455003cc9c with identifier: LG78632
2026-01-29 06:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 710753ee-6cec-53b3-b79c-21455003cc9c with scrape type 2
2026-01-29 06:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 710753ee-6cec-53b3-b79c-21455003cc9c with scrape type 2
2026-01-29 06:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 710753ee-6cec-53b3-b79c-21455003cc9c, identifier: LG78632
2026-01-29 06:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 710753ee-6cec-53b3-b79c-21455003cc9c with identifier: LG78632
2026-01-29 06:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 710753ee-6cec-53b3-b79c-21455003cc9c with identifier: LG78632
2026-01-29 06:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 27363, 'odometer_reading_unit': 'km', 'registration_date': '2021-04-14', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lg78632', 'expiration_date': '2026-01-29t16:54:08z', 'origin_country_code': 'fr', 'trim': 'allure pack', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, le havre', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 127, 'id': '710753ee-6cec-53b3-b79c-21455003cc9c', 'current_year_diff': 5, 'age_in_months': 57, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 27363}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 57,
     'auction_title': '',
     'c_o_2_emission_value': 127,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:54:08z',
     'fuel_type': 'petrol',
     'id': '710753ee-6cec-53b3-b79c-21455003cc9c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lg78632',
     'listing': 'auction',
     'location': 'fr, le havre',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 27363,
     'odometer_in_km': 27363,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-04-14',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure pack',
     'transmission': 'manual',
     'trim': 'allure pack',
     'year': 2021}
2026-01-29 06:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 710753ee-6cec-53b3-b79c-21455003cc9c spider: auto1.fr
2026-01-29 06:02:34 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 710753ee-6cec-53b3-b79c-21455003cc9c due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 27363, 'odometer_reading_unit': 'km', 'registration_date': '2021-04-14', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lg78632', 'expiration_date': '2026-01-29t16:54:08z', 'origin_country_code': 'fr', 'trim': 'allure pack', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, le havre', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 127, 'id': '710753ee-6cec-53b3-b79c-21455003cc9c', 'current_year_diff': 5, 'age_in_months': 57, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 27363}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 57,
     'auction_title': '',
     'c_o_2_emission_value': 127,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:54:08z',
     'fuel_type': 'petrol',
     'id': '710753ee-6cec-53b3-b79c-21455003cc9c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lg78632',
     'listing': 'auction',
     'location': 'fr, le havre',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 27363,
     'odometer_in_km': 27363,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-04-14',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure pack',
     'transmission': 'manual',
     'trim': 'allure pack',
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:54:08Z',
 'fuel_type': 'petrol',
 'id': '710753ee-6cec-53b3-b79c-21455003cc9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG78632',
 'listing': 'auction',
 'location': 'FR, LE HAVRE',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 27363,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure Pack',
 'transmission': 'manual',
 'trim': 'Allure Pack',
 'year': 2021}
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LG78632%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.fr] INFO: Saving data for LG78632: {'auction_closing_time': 1769705648.0, 'created_time': 1769448692.212643, 'last_price_update_time': 1769666554.69833}
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LG78632') HTTP/1.1" 204 0
2026-01-29 06:02:34 [auto1.fr] INFO: Found listing with ID: UK63573
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UK63573%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.fr] INFO: Scrape type for UK63573: 2
2026-01-29 06:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_05f8062a9da3b794be54ebb145f55ff1.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VG10471> (referer: https://www.auto1.com/v1/car-details-view/VG10471/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UG35109/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JR61080> (referer: https://www.auto1.com/v1/car-details-view/JR61080/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PR67213> (referer: https://www.auto1.com/v1/car-details-view/PR67213/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:34 [auto1.fr] INFO: Found listing with ID: XU29743
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XU29743%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.fr] INFO: Scrape type for XU29743: 0
2026-01-29 06:02:34 [auto1.fr] INFO: Found listing with ID: FJ44298
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ44298%27 HTTP/1.1" 200 None
2026-01-29 06:02:34 [auto1.fr] INFO: Scrape type for FJ44298: 2
2026-01-29 06:02:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c1d5850>
2026-01-29 06:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1d7377b-9af9-5c96-8031-2a907dc53a6a/c1d7377b-9af9-5c96-8031-2a907dc53a6a_image_12.jpg HTTP/1.1" 201 0
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff0%252Fb1f07102e6b2523a36ff46d7b3fbd390%252Fpa%252FFV47029_75bb57af1e8fa160133625f406826ece.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_75bb57af1e8fa160133625f406826ece.jpg saved to cache
2026-01-29 06:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item c1d7377b-9af9-5c96-8031-2a907dc53a6a
2026-01-29 06:02:35 [auto1.fr] INFO: Found listing with ID: SW76367
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SW76367%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.fr] INFO: Scrape type for SW76367: 0
2026-01-29 06:02:35 [auto1.fr] INFO: Found listing with ID: VB58136
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VB58136%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.fr] INFO: Scrape type for VB58136: 0
2026-01-29 06:02:35 [auto1.fr] INFO: Found listing with ID: JJ41609
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ41609%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.fr] INFO: Scrape type for JJ41609: 0
2026-01-29 06:02:35 [auto1.fr] INFO: Found listing with ID: JV78003
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JV78003%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.fr] INFO: Scrape type for JV78003: 0
2026-01-29 06:02:35 [auto1.fr] INFO: Found listing with ID: SM39203
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SM39203%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.fr] INFO: Scrape type for SM39203: 0
2026-01-29 06:02:35 [auto1.fr] INFO: Found listing with ID: HS67820
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HS67820%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.fr] INFO: Scrape type for HS67820: 0
2026-01-29 06:02:35 [auto1.fr] INFO: Found listing with ID: TT48941
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TT48941%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.fr] INFO: Scrape type for TT48941: 0
2026-01-29 06:02:35 [auto1.fr] INFO: Found listing with ID: CC73759
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CC73759%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.fr] INFO: Scrape type for CC73759: 2
2026-01-29 06:02:35 [auto1.fr] INFO: Found listing with ID: KL98727
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KL98727%27 HTTP/1.1" 200 None
2026-01-29 06:02:35 [auto1.fr] INFO: Scrape type for KL98727: 2
2026-01-29 06:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c09ba50>
2026-01-29 06:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1d7377b-9af9-5c96-8031-2a907dc53a6a/c1d7377b-9af9-5c96-8031-2a907dc53a6a_image_14.jpg HTTP/1.1" 201 0
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff0%252Fb1f07102e6b2523a36ff46d7b3fbd390%252Fpa%252FFV47029_05f8062a9da3b794be54ebb145f55ff1.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_05f8062a9da3b794be54ebb145f55ff1.jpg saved to cache
2026-01-29 06:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item c1d7377b-9af9-5c96-8031-2a907dc53a6a
2026-01-29 06:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28230789-aabc-5333-a7c7-f9b5b4cb22e9 with identifier: VG10471
2026-01-29 06:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28230789-aabc-5333-a7c7-f9b5b4cb22e9 with scrape type 2
2026-01-29 06:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28230789-aabc-5333-a7c7-f9b5b4cb22e9 with scrape type 2
2026-01-29 06:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 28230789-aabc-5333-a7c7-f9b5b4cb22e9, identifier: VG10471
2026-01-29 06:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ccabc7b-6d5d-5c26-951d-c4581801c563 with identifier: JR61080
2026-01-29 06:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ccabc7b-6d5d-5c26-951d-c4581801c563 with scrape type 2
2026-01-29 06:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ccabc7b-6d5d-5c26-951d-c4581801c563 with scrape type 2
2026-01-29 06:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8ccabc7b-6d5d-5c26-951d-c4581801c563, identifier: JR61080
2026-01-29 06:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f427326-286e-5cda-a9bf-33ad3f9c33d4 with identifier: PR67213
2026-01-29 06:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f427326-286e-5cda-a9bf-33ad3f9c33d4 with scrape type 2
2026-01-29 06:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f427326-286e-5cda-a9bf-33ad3f9c33d4 with scrape type 2
2026-01-29 06:02:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6f427326-286e-5cda-a9bf-33ad3f9c33d4, identifier: PR67213
2026-01-29 06:02:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 28230789-aabc-5333-a7c7-f9b5b4cb22e9 with identifier: VG10471
2026-01-29 06:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 28230789-aabc-5333-a7c7-f9b5b4cb22e9 with identifier: VG10471
2026-01-29 06:02:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 28230789-aabc-5333-a7c7-f9b5b4cb22e9 with identifier: VG10471 to the API
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VG10471>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:25:47Z',
 'fuel_type': 'diesel',
 'id': '28230789-aabc-5333-a7c7-f9b5b4cb22e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG10471',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 75047,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.5 BLUE dCi Edition One',
 'transmission': 'automatic',
 'trim': 'Edition One',
 'year': 2020}
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG10471%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.fr] INFO: Saving data for VG10471: {'auction_closing_time': 1769703947.0, 'created_time': 1769447722.58509, 'last_price_update_time': 1769666556.416734}
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VG10471') HTTP/1.1" 204 0
2026-01-29 06:02:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8ccabc7b-6d5d-5c26-951d-c4581801c563 with identifier: JR61080
2026-01-29 06:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8ccabc7b-6d5d-5c26-951d-c4581801c563 with identifier: JR61080
2026-01-29 06:02:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8ccabc7b-6d5d-5c26-951d-c4581801c563 with identifier: JR61080 to the API
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JR61080>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 158,
 'expiration_date': '2026-01-29T16:22:08Z',
 'fuel_type': 'petrol',
 'id': '8ccabc7b-6d5d-5c26-951d-c4581801c563',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR61080',
 'listing': 'auction',
 'location': 'FR, Nanteuil-le-Haudouin',
 'make': 'Renault',
 'model': 'Koleos',
 'odometer': 70429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Koleos 1.3 TCe Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2021}
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JR61080%27 HTTP/1.1" 200 None
2026-01-29 06:02:36 [auto1.fr] INFO: Saving data for JR61080: {'auction_closing_time': 1769703728.0, 'created_time': 1767373941.521642, 'last_price_update_time': 1769666556.913532}
2026-01-29 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JR61080') HTTP/1.1" 204 0
2026-01-29 06:02:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6f427326-286e-5cda-a9bf-33ad3f9c33d4 with identifier: PR67213
2026-01-29 06:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6f427326-286e-5cda-a9bf-33ad3f9c33d4 with identifier: PR67213
2026-01-29 06:02:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6f427326-286e-5cda-a9bf-33ad3f9c33d4 with identifier: PR67213 to the API
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PR67213>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:23:28Z',
 'fuel_type': 'petrol',
 'id': '6f427326-286e-5cda-a9bf-33ad3f9c33d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR67213',
 'listing': 'auction',
 'location': 'FR, Marly-la-ville',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 70154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2019}
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR67213%27 HTTP/1.1" 200 None
2026-01-29 06:02:37 [auto1.fr] INFO: Saving data for PR67213: {'auction_closing_time': 1769703808.0, 'created_time': 1768326078.709447, 'last_price_update_time': 1769666557.584878}
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PR67213') HTTP/1.1" 204 0
2026-01-29 06:02:37 [auto1.fr] INFO: Found listing with ID: PJ58327
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PJ58327%27 HTTP/1.1" 200 None
2026-01-29 06:02:37 [auto1.fr] INFO: Scrape type for PJ58327: 0
2026-01-29 06:02:37 [auto1.fr] INFO: Found listing with ID: VH65912
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VH65912%27 HTTP/1.1" 200 None
2026-01-29 06:02:37 [auto1.fr] INFO: Scrape type for VH65912: 0
2026-01-29 06:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WB61267/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WF45820/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PJ01244/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZH57094/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WH04137> (referer: https://www.auto1.com/v1/car-details-view/WH04137/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RU54394> (referer: https://www.auto1.com/v1/car-details-view/RU54394/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2644de3b-45f3-5dec-9e20-fb6bf3e2dc14 with identifier: WH04137
2026-01-29 06:02:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2644de3b-45f3-5dec-9e20-fb6bf3e2dc14 with scrape type 2
2026-01-29 06:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2644de3b-45f3-5dec-9e20-fb6bf3e2dc14 with scrape type 2
2026-01-29 06:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2644de3b-45f3-5dec-9e20-fb6bf3e2dc14, identifier: WH04137
2026-01-29 06:02:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2644de3b-45f3-5dec-9e20-fb6bf3e2dc14 with identifier: WH04137
2026-01-29 06:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2644de3b-45f3-5dec-9e20-fb6bf3e2dc14 with identifier: WH04137
2026-01-29 06:02:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2644de3b-45f3-5dec-9e20-fb6bf3e2dc14 with identifier: WH04137 to the API
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WH04137>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:35:29Z',
 'fuel_type': 'diesel',
 'id': '2644de3b-45f3-5dec-9e20-fb6bf3e2dc14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH04137',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 122036,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-01-29 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WH04137%27 HTTP/1.1" 200 None
2026-01-29 06:02:39 [auto1.fr] INFO: Saving data for WH04137: {'auction_closing_time': 1769704529.0, 'created_time': 1769447587.948535, 'last_price_update_time': 1769666559.001521}
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WH04137') HTTP/1.1" 204 0
2026-01-29 06:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YG08279/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e92ed8c-04c8-5c90-8894-4bdd095a640e with identifier: RU54394
2026-01-29 06:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e92ed8c-04c8-5c90-8894-4bdd095a640e with scrape type 1
2026-01-29 06:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 8e92ed8c-04c8-5c90-8894-4bdd095a640e
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F5c%252F255c9344c6874e41cddc7a542e6ab16e%252Fpa%252FRU54394_22d6f996a9e81e43f6296a89f1ad07ce.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_22d6f996a9e81e43f6296a89f1ad07ce.jpg already downloaded
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F5c%252F255c9344c6874e41cddc7a542e6ab16e%252Fpa%252FRU54394_5ca297490eed974e9fd42e88063e12cd.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_5ca297490eed974e9fd42e88063e12cd.jpg already downloaded
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F5c%252F255c9344c6874e41cddc7a542e6ab16e%252Fpa%252FRU54394_ff1ea07bdc00a881ddde7ac7e1355ffa.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_ff1ea07bdc00a881ddde7ac7e1355ffa.jpg already downloaded
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F5c%252F255c9344c6874e41cddc7a542e6ab16e%252Fpa%252FRU54394_8641c0fd060b52c20f913d0baed8086e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_8641c0fd060b52c20f913d0baed8086e.jpg already downloaded
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F5c%252F255c9344c6874e41cddc7a542e6ab16e%252Fpa%252FRU54394_f66f5b462e4d7d0257cc64d7eccf520b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_f66f5b462e4d7d0257cc64d7eccf520b.jpg already downloaded
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F5c%252F255c9344c6874e41cddc7a542e6ab16e%252Fpa%252FRU54394_425bec7412a02542bb99bbf1f494a81d.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_425bec7412a02542bb99bbf1f494a81d.jpg already downloaded
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F5c%252F255c9344c6874e41cddc7a542e6ab16e%252Fpa%252FRU54394_14072127e0a46487d63a378c9fffb12f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_14072127e0a46487d63a378c9fffb12f.jpg already downloaded
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F5c%252F255c9344c6874e41cddc7a542e6ab16e%252Fpa%252FRU54394_47c9784636862439670ca6875d81492b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_47c9784636862439670ca6875d81492b.jpg already downloaded
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F5c%252F255c9344c6874e41cddc7a542e6ab16e%252Fpa%252FRU54394_964a0a6b20f475bc315725f5b2bed463.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_964a0a6b20f475bc315725f5b2bed463.jpg already downloaded
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F5c%252F255c9344c6874e41cddc7a542e6ab16e%252Fpa%252FRU54394_f0cf9556ab24e4eb83c062793526cb85.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_f0cf9556ab24e4eb83c062793526cb85.jpg already downloaded
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F5c%252F255c9344c6874e41cddc7a542e6ab16e%252Fpa%252FRU54394_a443aff198793d69e8d5b6c5a7f3d728.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_a443aff198793d69e8d5b6c5a7f3d728.jpg already downloaded
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F5c%252F255c9344c6874e41cddc7a542e6ab16e%252Fpa%252FRU54394_9b5ff3b82e55dbd5349e5e574a0f9b49.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_9b5ff3b82e55dbd5349e5e574a0f9b49.jpg already downloaded
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F5c%252F255c9344c6874e41cddc7a542e6ab16e%252Fpa%252FRU54394_8dc201a6afdf1359abcbb79a6c23ccf0.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_8dc201a6afdf1359abcbb79a6c23ccf0.jpg already downloaded
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F5c%252F255c9344c6874e41cddc7a542e6ab16e%252Fpa%252FRU54394_38b92560a55d796986d1efae402b6ce2.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_38b92560a55d796986d1efae402b6ce2.jpg already downloaded
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F5c%252F255c9344c6874e41cddc7a542e6ab16e%252Fpa%252FRU54394_4bb237d1834ef6fecd3496401a2c3359.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_4bb237d1834ef6fecd3496401a2c3359.jpg already downloaded
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F5c%252F255c9344c6874e41cddc7a542e6ab16e%252Fpa%252FRU54394_390986a2170f44429af31c2657a07029.png%27 HTTP/1.1" 200 None
2026-01-29 06:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_390986a2170f44429af31c2657a07029.png already downloaded
2026-01-29 06:02:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8e92ed8c-04c8-5c90-8894-4bdd095a640e, identifier: RU54394
2026-01-29 06:02:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8e92ed8c-04c8-5c90-8894-4bdd095a640e with identifier: RU54394
2026-01-29 06:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8e92ed8c-04c8-5c90-8894-4bdd095a640e with identifier: RU54394
2026-01-29 06:02:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8e92ed8c-04c8-5c90-8894-4bdd095a640e with identifier: RU54394 to the API
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RU54394>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:39:15Z',
 'fuel_type': 'diesel',
 'id': '8e92ed8c-04c8-5c90-8894-4bdd095a640e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU54394',
 'listing': 'auction',
 'location': 'FR, TARNOS',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 138860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_22d6f996a9e81e43f6296a89f1ad07ce.jpg',
                'https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_5ca297490eed974e9fd42e88063e12cd.jpg',
                'https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_ff1ea07bdc00a881ddde7ac7e1355ffa.jpg',
                'https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_8641c0fd060b52c20f913d0baed8086e.jpg',
                'https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_f66f5b462e4d7d0257cc64d7eccf520b.jpg',
                'https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_425bec7412a02542bb99bbf1f494a81d.jpg',
                'https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_14072127e0a46487d63a378c9fffb12f.jpg',
                'https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_47c9784636862439670ca6875d81492b.jpg',
                'https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_964a0a6b20f475bc315725f5b2bed463.jpg',
                'https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_f0cf9556ab24e4eb83c062793526cb85.jpg',
                'https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_a443aff198793d69e8d5b6c5a7f3d728.jpg',
                'https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_9b5ff3b82e55dbd5349e5e574a0f9b49.jpg',
                'https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_8dc201a6afdf1359abcbb79a6c23ccf0.jpg',
                'https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_38b92560a55d796986d1efae402b6ce2.jpg',
                'https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_4bb237d1834ef6fecd3496401a2c3359.jpg',
                'https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_390986a2170f44429af31c2657a07029.png'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e92ed8c-04c8-5c90-8894-4bdd095a640e/8e92ed8c-04c8-5c90-8894-4bdd095a640e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2703518,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_22d6f996a9e81e43f6296a89f1ad07ce.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e92ed8c-04c8-5c90-8894-4bdd095a640e/8e92ed8c-04c8-5c90-8894-4bdd095a640e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_5ca297490eed974e9fd42e88063e12cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e92ed8c-04c8-5c90-8894-4bdd095a640e/8e92ed8c-04c8-5c90-8894-4bdd095a640e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_ff1ea07bdc00a881ddde7ac7e1355ffa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e92ed8c-04c8-5c90-8894-4bdd095a640e/8e92ed8c-04c8-5c90-8894-4bdd095a640e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2371331,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_8641c0fd060b52c20f913d0baed8086e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e92ed8c-04c8-5c90-8894-4bdd095a640e/8e92ed8c-04c8-5c90-8894-4bdd095a640e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2622771,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_f66f5b462e4d7d0257cc64d7eccf520b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e92ed8c-04c8-5c90-8894-4bdd095a640e/8e92ed8c-04c8-5c90-8894-4bdd095a640e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_425bec7412a02542bb99bbf1f494a81d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e92ed8c-04c8-5c90-8894-4bdd095a640e/8e92ed8c-04c8-5c90-8894-4bdd095a640e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68835,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_14072127e0a46487d63a378c9fffb12f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e92ed8c-04c8-5c90-8894-4bdd095a640e/8e92ed8c-04c8-5c90-8894-4bdd095a640e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_47c9784636862439670ca6875d81492b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e92ed8c-04c8-5c90-8894-4bdd095a640e/8e92ed8c-04c8-5c90-8894-4bdd095a640e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_964a0a6b20f475bc315725f5b2bed463.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e92ed8c-04c8-5c90-8894-4bdd095a640e/8e92ed8c-04c8-5c90-8894-4bdd095a640e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70384,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_f0cf9556ab24e4eb83c062793526cb85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e92ed8c-04c8-5c90-8894-4bdd095a640e/8e92ed8c-04c8-5c90-8894-4bdd095a640e_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2593021,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_a443aff198793d69e8d5b6c5a7f3d728.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e92ed8c-04c8-5c90-8894-4bdd095a640e/8e92ed8c-04c8-5c90-8894-4bdd095a640e_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2973487,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_9b5ff3b82e55dbd5349e5e574a0f9b49.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e92ed8c-04c8-5c90-8894-4bdd095a640e/8e92ed8c-04c8-5c90-8894-4bdd095a640e_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_8dc201a6afdf1359abcbb79a6c23ccf0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e92ed8c-04c8-5c90-8894-4bdd095a640e/8e92ed8c-04c8-5c90-8894-4bdd095a640e_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_38b92560a55d796986d1efae402b6ce2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e92ed8c-04c8-5c90-8894-4bdd095a640e/8e92ed8c-04c8-5c90-8894-4bdd095a640e_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 130615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_4bb237d1834ef6fecd3496401a2c3359.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e92ed8c-04c8-5c90-8894-4bdd095a640e/8e92ed8c-04c8-5c90-8894-4bdd095a640e_image_15.png',
             'Extension': 'png',
             'FileSizeInBytes': 80423,
             'Height': 525,
             'OriginUrl': 'https://img-pa.auto1.com/img25/5c/255c9344c6874e41cddc7a542e6ab16e/pa/RU54394_390986a2170f44429af31c2657a07029.png',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.5 Blue-HDi Feel Pack Business',
 'transmission': 'manual',
 'trim': 'Feel Pack Business',
 'year': 2021}
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RU54394%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [auto1.fr] INFO: Saving data for RU54394: {'created_time': 1769666560.087574, 'last_price_update_time': 1769666560.087585, 'auction_closing_time': 1769704755.0}
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RU54394') HTTP/1.1" 204 0
2026-01-29 06:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NS66111/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB37332> (referer: https://www.auto1.com/v1/car-details-view/JB37332/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UY38099> (referer: https://www.auto1.com/v1/car-details-view/UY38099/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AM99512> (referer: https://www.auto1.com/v1/car-details-view/AM99512/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NK06116> (referer: https://www.auto1.com/v1/car-details-view/NK06116/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_0e8571629b67742f701429b59d9adf95.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_bc4f941be73b087fa295089e784af21a.png> (referer: https://www.auto1.com/)
2026-01-29 06:02:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b542ba20-2534-578d-8af4-2d58076300b4 with identifier: JB37332
2026-01-29 06:02:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b542ba20-2534-578d-8af4-2d58076300b4 with scrape type 1
2026-01-29 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item b542ba20-2534-578d-8af4-2d58076300b4
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F10%252F961033bf702c435bcfdc3e7406463a6c%252Fpa%252FJB37332_9f7ea191c39ce73bf483edeb6a84affa.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_9f7ea191c39ce73bf483edeb6a84affa.jpg not downloaded yet
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F10%252F961033bf702c435bcfdc3e7406463a6c%252Fpa%252FJB37332_6f4235205989b01362c8773d0f0c8065.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_6f4235205989b01362c8773d0f0c8065.jpg not downloaded yet
2026-01-29 06:02:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04a5249f-ab6b-5856-8c3d-0a4021da83e9 with identifier: UY38099
2026-01-29 06:02:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04a5249f-ab6b-5856-8c3d-0a4021da83e9 with scrape type 1
2026-01-29 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 04a5249f-ab6b-5856-8c3d-0a4021da83e9
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F34%252F52341f51be77abfc5b004cbb5a7bd1ff%252Fpa%252FUY38099_b1c99798f4cecc8be07770e48573f10b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_b1c99798f4cecc8be07770e48573f10b.jpg not downloaded yet
2026-01-29 06:02:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93ee1cc8-beec-5df4-9034-a39c0e084254 with identifier: AM99512
2026-01-29 06:02:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93ee1cc8-beec-5df4-9034-a39c0e084254 with scrape type 2
2026-01-29 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93ee1cc8-beec-5df4-9034-a39c0e084254 with scrape type 2
2026-01-29 06:02:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 93ee1cc8-beec-5df4-9034-a39c0e084254, identifier: AM99512
2026-01-29 06:02:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9970e851-b75e-51dc-a10b-1ff4091e437e with identifier: NK06116
2026-01-29 06:02:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9970e851-b75e-51dc-a10b-1ff4091e437e with scrape type 1
2026-01-29 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 9970e851-b75e-51dc-a10b-1ff4091e437e
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F04%252Fe604b37d05bef408be43fa942e8fbedf%252Fpa%252FNK06116_40a4384cbf1ead9b843806cdc2e88c4d.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_40a4384cbf1ead9b843806cdc2e88c4d.jpg already downloaded
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F04%252Fe604b37d05bef408be43fa942e8fbedf%252Fpa%252FNK06116_ecf67ede7512a45dc222b92c4492f1ed.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_ecf67ede7512a45dc222b92c4492f1ed.jpg already downloaded
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F04%252Fe604b37d05bef408be43fa942e8fbedf%252Fpa%252FNK06116_c2df4aefcc16dc784979e8ed567c3e49.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_c2df4aefcc16dc784979e8ed567c3e49.jpg already downloaded
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F04%252Fe604b37d05bef408be43fa942e8fbedf%252Fpa%252FNK06116_68b7aa543976cca53820f4eca5fa3872.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_68b7aa543976cca53820f4eca5fa3872.jpg already downloaded
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F04%252Fe604b37d05bef408be43fa942e8fbedf%252Fpa%252FNK06116_4b52f0065651567375b0c46b824b2088.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_4b52f0065651567375b0c46b824b2088.jpg already downloaded
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F04%252Fe604b37d05bef408be43fa942e8fbedf%252Fpa%252FNK06116_37325fb7909578a65d863c953182051c.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_37325fb7909578a65d863c953182051c.jpg already downloaded
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F04%252Fe604b37d05bef408be43fa942e8fbedf%252Fpa%252FNK06116_5c3d18e1679964d0e45b07d2ada9e320.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_5c3d18e1679964d0e45b07d2ada9e320.jpg already downloaded
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F04%252Fe604b37d05bef408be43fa942e8fbedf%252Fpa%252FNK06116_c9129301c35d235079062a2c2a31250d.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_c9129301c35d235079062a2c2a31250d.jpg already downloaded
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F04%252Fe604b37d05bef408be43fa942e8fbedf%252Fpa%252FNK06116_a840d0b9bf9b1cdb37edc581389dae79.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_a840d0b9bf9b1cdb37edc581389dae79.jpg already downloaded
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F04%252Fe604b37d05bef408be43fa942e8fbedf%252Fpa%252FNK06116_988f5d804d467af54dd25fc27846b1e8.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_988f5d804d467af54dd25fc27846b1e8.jpg already downloaded
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F04%252Fe604b37d05bef408be43fa942e8fbedf%252Fpa%252FNK06116_6683cafa3ce674f867e1dff16234853a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_6683cafa3ce674f867e1dff16234853a.jpg already downloaded
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F04%252Fe604b37d05bef408be43fa942e8fbedf%252Fpa%252FNK06116_67f972249a479382b46b7c4bfcd420f1.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_67f972249a479382b46b7c4bfcd420f1.jpg already downloaded
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F04%252Fe604b37d05bef408be43fa942e8fbedf%252Fpa%252FNK06116_222b234ec845a0b35e6447dc47f5e31e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_222b234ec845a0b35e6447dc47f5e31e.jpg already downloaded
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F04%252Fe604b37d05bef408be43fa942e8fbedf%252Fpa%252FNK06116_5d824e957be6c509f7ec48aae408d505.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_5d824e957be6c509f7ec48aae408d505.jpg already downloaded
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F04%252Fe604b37d05bef408be43fa942e8fbedf%252Fpa%252FNK06116_f71de0810bcf9f10bfd35e2e17ac7343.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_f71de0810bcf9f10bfd35e2e17ac7343.jpg already downloaded
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F04%252Fe604b37d05bef408be43fa942e8fbedf%252Fpa%252FNK06116_e515bab3cc0c707939ae99b69950d055.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_e515bab3cc0c707939ae99b69950d055.jpg already downloaded
2026-01-29 06:02:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9970e851-b75e-51dc-a10b-1ff4091e437e, identifier: NK06116
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F10%252F961033bf702c435bcfdc3e7406463a6c%252Fpa%252FJB37332_b6746800fc35b8093d5918dfc8dd4319.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_b6746800fc35b8093d5918dfc8dd4319.jpg not downloaded yet
2026-01-29 06:02:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 93ee1cc8-beec-5df4-9034-a39c0e084254 with identifier: AM99512
2026-01-29 06:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 93ee1cc8-beec-5df4-9034-a39c0e084254 with identifier: AM99512
2026-01-29 06:02:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 93ee1cc8-beec-5df4-9034-a39c0e084254 with identifier: AM99512 to the API
2026-01-29 06:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AM99512>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 160,
 'expiration_date': '2026-01-29T16:26:29Z',
 'fuel_type': 'diesel',
 'id': '93ee1cc8-beec-5df4-9034-a39c0e084254',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM99512',
 'listing': 'auction',
 'location': 'FR, Warluis',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 100909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-13',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Renault Espace 1.6 dCi Energy Zen',
 'transmission': 'automatic',
 'trim': 'Zen',
 'year': 2018}
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AM99512%27 HTTP/1.1" 200 None
2026-01-29 06:02:41 [auto1.fr] INFO: Saving data for AM99512: {'auction_closing_time': 1769703989.0, 'created_time': 1769190267.497557, 'last_price_update_time': 1769666561.224642}
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AM99512') HTTP/1.1" 204 0
2026-01-29 06:02:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9970e851-b75e-51dc-a10b-1ff4091e437e with identifier: NK06116
2026-01-29 06:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9970e851-b75e-51dc-a10b-1ff4091e437e with identifier: NK06116
2026-01-29 06:02:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9970e851-b75e-51dc-a10b-1ff4091e437e with identifier: NK06116 to the API
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NK06116>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-01-29T16:09:07Z',
 'fuel_type': 'petrol',
 'id': '9970e851-b75e-51dc-a10b-1ff4091e437e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK06116',
 'listing': 'auction',
 'location': 'FR, Marly-la-ville',
 'make': 'Ford',
 'model': 'B-Max',
 'odometer': 93473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_40a4384cbf1ead9b843806cdc2e88c4d.jpg',
                'https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_ecf67ede7512a45dc222b92c4492f1ed.jpg',
                'https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_c2df4aefcc16dc784979e8ed567c3e49.jpg',
                'https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_68b7aa543976cca53820f4eca5fa3872.jpg',
                'https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_4b52f0065651567375b0c46b824b2088.jpg',
                'https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_37325fb7909578a65d863c953182051c.jpg',
                'https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_5c3d18e1679964d0e45b07d2ada9e320.jpg',
                'https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_c9129301c35d235079062a2c2a31250d.jpg',
                'https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_a840d0b9bf9b1cdb37edc581389dae79.jpg',
                'https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_988f5d804d467af54dd25fc27846b1e8.jpg',
                'https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_6683cafa3ce674f867e1dff16234853a.jpg',
                'https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_67f972249a479382b46b7c4bfcd420f1.jpg',
                'https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_222b234ec845a0b35e6447dc47f5e31e.jpg',
                'https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_5d824e957be6c509f7ec48aae408d505.jpg',
                'https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_f71de0810bcf9f10bfd35e2e17ac7343.jpg',
                'https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_e515bab3cc0c707939ae99b69950d055.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9970e851-b75e-51dc-a10b-1ff4091e437e/9970e851-b75e-51dc-a10b-1ff4091e437e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_40a4384cbf1ead9b843806cdc2e88c4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9970e851-b75e-51dc-a10b-1ff4091e437e/9970e851-b75e-51dc-a10b-1ff4091e437e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2815507,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_ecf67ede7512a45dc222b92c4492f1ed.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9970e851-b75e-51dc-a10b-1ff4091e437e/9970e851-b75e-51dc-a10b-1ff4091e437e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_c2df4aefcc16dc784979e8ed567c3e49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9970e851-b75e-51dc-a10b-1ff4091e437e/9970e851-b75e-51dc-a10b-1ff4091e437e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_68b7aa543976cca53820f4eca5fa3872.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9970e851-b75e-51dc-a10b-1ff4091e437e/9970e851-b75e-51dc-a10b-1ff4091e437e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71453,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_4b52f0065651567375b0c46b824b2088.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9970e851-b75e-51dc-a10b-1ff4091e437e/9970e851-b75e-51dc-a10b-1ff4091e437e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_37325fb7909578a65d863c953182051c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9970e851-b75e-51dc-a10b-1ff4091e437e/9970e851-b75e-51dc-a10b-1ff4091e437e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60275,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_5c3d18e1679964d0e45b07d2ada9e320.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9970e851-b75e-51dc-a10b-1ff4091e437e/9970e851-b75e-51dc-a10b-1ff4091e437e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_c9129301c35d235079062a2c2a31250d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9970e851-b75e-51dc-a10b-1ff4091e437e/9970e851-b75e-51dc-a10b-1ff4091e437e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2825826,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_a840d0b9bf9b1cdb37edc581389dae79.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9970e851-b75e-51dc-a10b-1ff4091e437e/9970e851-b75e-51dc-a10b-1ff4091e437e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54760,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_988f5d804d467af54dd25fc27846b1e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9970e851-b75e-51dc-a10b-1ff4091e437e/9970e851-b75e-51dc-a10b-1ff4091e437e_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_6683cafa3ce674f867e1dff16234853a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9970e851-b75e-51dc-a10b-1ff4091e437e/9970e851-b75e-51dc-a10b-1ff4091e437e_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_67f972249a479382b46b7c4bfcd420f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9970e851-b75e-51dc-a10b-1ff4091e437e/9970e851-b75e-51dc-a10b-1ff4091e437e_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64822,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_222b234ec845a0b35e6447dc47f5e31e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9970e851-b75e-51dc-a10b-1ff4091e437e/9970e851-b75e-51dc-a10b-1ff4091e437e_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_5d824e957be6c509f7ec48aae408d505.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9970e851-b75e-51dc-a10b-1ff4091e437e/9970e851-b75e-51dc-a10b-1ff4091e437e_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_f71de0810bcf9f10bfd35e2e17ac7343.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9970e851-b75e-51dc-a10b-1ff4091e437e/9970e851-b75e-51dc-a10b-1ff4091e437e_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/04/e604b37d05bef408be43fa942e8fbedf/pa/NK06116_e515bab3cc0c707939ae99b69950d055.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford B-Max 1.6 Ti-VCT Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2017}
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK06116%27 HTTP/1.1" 200 None
2026-01-29 06:02:41 [auto1.fr] INFO: Saving data for NK06116: {'created_time': 1769666561.58845, 'last_price_update_time': 1769666561.588463, 'auction_closing_time': 1769702947.0}
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NK06116') HTTP/1.1" 204 0
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F34%252F52341f51be77abfc5b004cbb5a7bd1ff%252Fpa%252FUY38099_5c08063f537d0751d10f4516eeb89aff.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_5c08063f537d0751d10f4516eeb89aff.jpg not downloaded yet
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F10%252F961033bf702c435bcfdc3e7406463a6c%252Fpa%252FJB37332_fc4a4c6a78627c4554af17a71eb57597.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_fc4a4c6a78627c4554af17a71eb57597.jpg not downloaded yet
2026-01-29 06:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EX68791> (referer: https://www.auto1.com/v1/car-details-view/EX68791/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UK63573/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HV11648> (referer: https://www.auto1.com/v1/car-details-view/HV11648/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F34%252F52341f51be77abfc5b004cbb5a7bd1ff%252Fpa%252FUY38099_7f564678351978b35652b185f63f7c25.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_7f564678351978b35652b185f63f7c25.jpg not downloaded yet
2026-01-29 06:02:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ffa1150>
2026-01-29 06:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1d7377b-9af9-5c96-8031-2a907dc53a6a/c1d7377b-9af9-5c96-8031-2a907dc53a6a_image_13.jpg HTTP/1.1" 201 0
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff0%252Fb1f07102e6b2523a36ff46d7b3fbd390%252Fpa%252FFV47029_0e8571629b67742f701429b59d9adf95.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_0e8571629b67742f701429b59d9adf95.jpg saved to cache
2026-01-29 06:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item c1d7377b-9af9-5c96-8031-2a907dc53a6a
2026-01-29 06:02:41 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-01-29 06:02:41 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2026-01-29 06:02:41 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2026-01-29 06:02:41 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2026-01-29 06:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c1cb050>
2026-01-29 06:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1d7377b-9af9-5c96-8031-2a907dc53a6a/c1d7377b-9af9-5c96-8031-2a907dc53a6a_image_15.png HTTP/1.1" 201 0
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff0%252Fb1f07102e6b2523a36ff46d7b3fbd390%252Fpa%252FFV47029_bc4f941be73b087fa295089e784af21a.png') HTTP/1.1" 204 0
2026-01-29 06:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_bc4f941be73b087fa295089e784af21a.png saved to cache
2026-01-29 06:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item c1d7377b-9af9-5c96-8031-2a907dc53a6a
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F10%252F961033bf702c435bcfdc3e7406463a6c%252Fpa%252FJB37332_543f53639b558b0d7dcf8795647c4787.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_543f53639b558b0d7dcf8795647c4787.jpg not downloaded yet
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F34%252F52341f51be77abfc5b004cbb5a7bd1ff%252Fpa%252FUY38099_06d993a03986aede0a4d68c3a7c6b979.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_06d993a03986aede0a4d68c3a7c6b979.jpg not downloaded yet
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F10%252F961033bf702c435bcfdc3e7406463a6c%252Fpa%252FJB37332_de8742c62ea249bbe88b7506a57d62b6.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_de8742c62ea249bbe88b7506a57d62b6.jpg not downloaded yet
2026-01-29 06:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LX40728/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KL98727/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WF45820> (referer: https://www.auto1.com/v1/car-details-view/WF45820/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e55dc4b-1851-59c5-9233-edb3d96a8ca6 with identifier: EX68791
2026-01-29 06:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e55dc4b-1851-59c5-9233-edb3d96a8ca6 with scrape type 2
2026-01-29 06:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e55dc4b-1851-59c5-9233-edb3d96a8ca6 with scrape type 2
2026-01-29 06:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4e55dc4b-1851-59c5-9233-edb3d96a8ca6, identifier: EX68791
2026-01-29 06:02:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e18464c1-d77a-53f8-9a02-6118617f85b1 with identifier: HV11648
2026-01-29 06:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e18464c1-d77a-53f8-9a02-6118617f85b1 with scrape type 1
2026-01-29 06:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item e18464c1-d77a-53f8-9a02-6118617f85b1
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fa5%252F15a57247cf65a79bb5e2285eebb6c11b%252Fpa%252FHV11648_9e9cf5132e186978052be633f44beb51.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_9e9cf5132e186978052be633f44beb51.jpg not downloaded yet
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F34%252F52341f51be77abfc5b004cbb5a7bd1ff%252Fpa%252FUY38099_91737b601d4c83bf4b63b50285ea191e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_91737b601d4c83bf4b63b50285ea191e.jpg not downloaded yet
2026-01-29 06:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4e55dc4b-1851-59c5-9233-edb3d96a8ca6 with identifier: EX68791
2026-01-29 06:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4e55dc4b-1851-59c5-9233-edb3d96a8ca6 with identifier: EX68791
2026-01-29 06:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c5 aircross 1.6 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c5 aircross', 'transmission': 'automatic', 'odometer': 96198, 'odometer_reading_unit': 'km', 'registration_date': '2019-12-11', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ex68791', 'expiration_date': '2026-01-29t16:43:52z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 181, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.6l', 'location': 'fr, bussy-lettrée', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 128, 'id': '4e55dc4b-1851-59c5-9233-edb3d96a8ca6', 'current_year_diff': 7, 'age_in_months': 73, 'make_model': 'citroen c5 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 96198}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 73,
     'auction_title': '',
     'c_o_2_emission_value': 128,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.6l',
     'engine_horse_power': 181,
     'expiration_date': '2026-01-29t16:43:52z',
     'fuel_type': 'petrol',
     'id': '4e55dc4b-1851-59c5-9233-edb3d96a8ca6',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ex68791',
     'listing': 'auction',
     'location': 'fr, bussy-lettrée',
     'make': 'citroen',
     'make_model': 'citroen c5 aircross',
     'model': 'c5 aircross',
     'odometer': 96198,
     'odometer_in_km': 96198,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-12-11',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c5 aircross 1.6 puretech shine',
     'transmission': 'automatic',
     'trim': 'shine',
     'year': 2019}
2026-01-29 06:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 4e55dc4b-1851-59c5-9233-edb3d96a8ca6 spider: auto1.fr
2026-01-29 06:02:42 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 4e55dc4b-1851-59c5-9233-edb3d96a8ca6 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c5 aircross 1.6 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c5 aircross', 'transmission': 'automatic', 'odometer': 96198, 'odometer_reading_unit': 'km', 'registration_date': '2019-12-11', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ex68791', 'expiration_date': '2026-01-29t16:43:52z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 181, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.6l', 'location': 'fr, bussy-lettrée', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 128, 'id': '4e55dc4b-1851-59c5-9233-edb3d96a8ca6', 'current_year_diff': 7, 'age_in_months': 73, 'make_model': 'citroen c5 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 96198}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 73,
     'auction_title': '',
     'c_o_2_emission_value': 128,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.6l',
     'engine_horse_power': 181,
     'expiration_date': '2026-01-29t16:43:52z',
     'fuel_type': 'petrol',
     'id': '4e55dc4b-1851-59c5-9233-edb3d96a8ca6',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ex68791',
     'listing': 'auction',
     'location': 'fr, bussy-lettrée',
     'make': 'citroen',
     'make_model': 'citroen c5 aircross',
     'model': 'c5 aircross',
     'odometer': 96198,
     'odometer_in_km': 96198,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-12-11',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c5 aircross 1.6 puretech shine',
     'transmission': 'automatic',
     'trim': 'shine',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 181,
 'expiration_date': '2026-01-29T16:43:52Z',
 'fuel_type': 'petrol',
 'id': '4e55dc4b-1851-59c5-9233-edb3d96a8ca6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX68791',
 'listing': 'auction',
 'location': 'FR, Bussy-Lettrée',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 96198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.6 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2019}
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EX68791%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [auto1.fr] INFO: Saving data for EX68791: {'auction_closing_time': 1769705032.0, 'created_time': 1769015528.811933, 'last_price_update_time': 1769666562.758652}
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EX68791') HTTP/1.1" 204 0
2026-01-29 06:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_b1c99798f4cecc8be07770e48573f10b.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_b6746800fc35b8093d5918dfc8dd4319.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F10%252F961033bf702c435bcfdc3e7406463a6c%252Fpa%252FJB37332_57208b0f7c68276796760f9aea54b630.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_57208b0f7c68276796760f9aea54b630.jpg not downloaded yet
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fa5%252F15a57247cf65a79bb5e2285eebb6c11b%252Fpa%252FHV11648_e4de5a40d2d538303ee70f9f0b848ce5.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_e4de5a40d2d538303ee70f9f0b848ce5.jpg not downloaded yet
2026-01-29 06:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UG35109> (referer: https://www.auto1.com/v1/car-details-view/UG35109/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_5c08063f537d0751d10f4516eeb89aff.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F34%252F52341f51be77abfc5b004cbb5a7bd1ff%252Fpa%252FUY38099_70983fd913855fce2be17edd34374ad0.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_70983fd913855fce2be17edd34374ad0.jpg not downloaded yet
2026-01-29 06:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WB61267> (referer: https://www.auto1.com/v1/car-details-view/WB61267/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4970e336-fe74-5a91-8807-8371d7bb1da1 with identifier: WF45820
2026-01-29 06:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4970e336-fe74-5a91-8807-8371d7bb1da1 with scrape type 2
2026-01-29 06:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4970e336-fe74-5a91-8807-8371d7bb1da1 with scrape type 2
2026-01-29 06:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4970e336-fe74-5a91-8807-8371d7bb1da1, identifier: WF45820
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F10%252F961033bf702c435bcfdc3e7406463a6c%252Fpa%252FJB37332_02ee8be0407683f29058a3069243f421.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_02ee8be0407683f29058a3069243f421.jpg not downloaded yet
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fa5%252F15a57247cf65a79bb5e2285eebb6c11b%252Fpa%252FHV11648_d80ee4611acd9dc1ffce0e217674247f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_d80ee4611acd9dc1ffce0e217674247f.jpg not downloaded yet
2026-01-29 06:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4970e336-fe74-5a91-8807-8371d7bb1da1 with identifier: WF45820
2026-01-29 06:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4970e336-fe74-5a91-8807-8371d7bb1da1 with identifier: WF45820
2026-01-29 06:02:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4970e336-fe74-5a91-8807-8371d7bb1da1 with identifier: WF45820 to the API
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WF45820>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:38:53Z',
 'fuel_type': 'diesel',
 'id': '4970e336-fe74-5a91-8807-8371d7bb1da1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF45820',
 'listing': 'auction',
 'location': 'FR, Bruges',
 'make': 'Volvo',
 'model': 'V40 Cross Country',
 'odometer': 135400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V40 Cross Country 2.0 D2 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2018}
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WF45820%27 HTTP/1.1" 200 None
2026-01-29 06:02:43 [auto1.fr] INFO: Saving data for WF45820: {'auction_closing_time': 1769704733.0, 'created_time': 1768496634.90672, 'last_price_update_time': 1769666563.357316}
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WF45820') HTTP/1.1" 204 0
2026-01-29 06:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_06d993a03986aede0a4d68c3a7c6b979.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_543f53639b558b0d7dcf8795647c4787.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F34%252F52341f51be77abfc5b004cbb5a7bd1ff%252Fpa%252FUY38099_eceb2e4d31b478c524859a1ac2882d61.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_eceb2e4d31b478c524859a1ac2882d61.jpg not downloaded yet
2026-01-29 06:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_7f564678351978b35652b185f63f7c25.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F10%252F961033bf702c435bcfdc3e7406463a6c%252Fpa%252FJB37332_8a0adba3661472ce52ee12a7a8861ad6.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_8a0adba3661472ce52ee12a7a8861ad6.jpg not downloaded yet
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fa5%252F15a57247cf65a79bb5e2285eebb6c11b%252Fpa%252FHV11648_2e6e5278e23414c053103d9e5bf2acf9.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_2e6e5278e23414c053103d9e5bf2acf9.jpg not downloaded yet
2026-01-29 06:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_9e9cf5132e186978052be633f44beb51.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F34%252F52341f51be77abfc5b004cbb5a7bd1ff%252Fpa%252FUY38099_905de21de2df34aec5f40a86ca5ee91e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_905de21de2df34aec5f40a86ca5ee91e.jpg not downloaded yet
2026-01-29 06:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f3a7550>
2026-01-29 06:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04a5249f-ab6b-5856-8c3d-0a4021da83e9/04a5249f-ab6b-5856-8c3d-0a4021da83e9_image_0.jpg HTTP/1.1" 201 0
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F34%252F52341f51be77abfc5b004cbb5a7bd1ff%252Fpa%252FUY38099_b1c99798f4cecc8be07770e48573f10b.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_b1c99798f4cecc8be07770e48573f10b.jpg saved to cache
2026-01-29 06:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 04a5249f-ab6b-5856-8c3d-0a4021da83e9
2026-01-29 06:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f4b1f10>
2026-01-29 06:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b542ba20-2534-578d-8af4-2d58076300b4/b542ba20-2534-578d-8af4-2d58076300b4_image_2.jpg HTTP/1.1" 201 0
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F10%252F961033bf702c435bcfdc3e7406463a6c%252Fpa%252FJB37332_b6746800fc35b8093d5918dfc8dd4319.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_b6746800fc35b8093d5918dfc8dd4319.jpg saved to cache
2026-01-29 06:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b542ba20-2534-578d-8af4-2d58076300b4
2026-01-29 06:02:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 199ab5d0-e058-5bfe-9399-1fd641b24b93 with identifier: UG35109
2026-01-29 06:02:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 199ab5d0-e058-5bfe-9399-1fd641b24b93 with scrape type 1
2026-01-29 06:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 199ab5d0-e058-5bfe-9399-1fd641b24b93
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F61%252Fe4616a24ff11f27f03fa189a8d18f728%252Fpa%252FUG35109_1c3797d4e28bb6146bdd2673a084a460.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_1c3797d4e28bb6146bdd2673a084a460.jpg not downloaded yet
2026-01-29 06:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f4f7b90>
2026-01-29 06:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04a5249f-ab6b-5856-8c3d-0a4021da83e9/04a5249f-ab6b-5856-8c3d-0a4021da83e9_image_1.jpg HTTP/1.1" 201 0
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F34%252F52341f51be77abfc5b004cbb5a7bd1ff%252Fpa%252FUY38099_5c08063f537d0751d10f4516eeb89aff.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_5c08063f537d0751d10f4516eeb89aff.jpg saved to cache
2026-01-29 06:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 04a5249f-ab6b-5856-8c3d-0a4021da83e9
2026-01-29 06:02:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 500ac764-2262-5671-bdd2-bc1fa8566490 with identifier: WB61267
2026-01-29 06:02:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 500ac764-2262-5671-bdd2-bc1fa8566490 with scrape type 2
2026-01-29 06:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 500ac764-2262-5671-bdd2-bc1fa8566490 with scrape type 2
2026-01-29 06:02:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 500ac764-2262-5671-bdd2-bc1fa8566490, identifier: WB61267
2026-01-29 06:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_de8742c62ea249bbe88b7506a57d62b6.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F10%252F961033bf702c435bcfdc3e7406463a6c%252Fpa%252FJB37332_08f73b54f4f2a91fab1e37c401a8825a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_08f73b54f4f2a91fab1e37c401a8825a.jpg not downloaded yet
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fa5%252F15a57247cf65a79bb5e2285eebb6c11b%252Fpa%252FHV11648_865191e4927252a9f784c3d851a0db14.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_865191e4927252a9f784c3d851a0db14.jpg not downloaded yet
2026-01-29 06:02:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 500ac764-2262-5671-bdd2-bc1fa8566490 with identifier: WB61267
2026-01-29 06:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 500ac764-2262-5671-bdd2-bc1fa8566490 with identifier: WB61267
2026-01-29 06:02:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 500ac764-2262-5671-bdd2-bc1fa8566490 with identifier: WB61267 to the API
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WB61267>
{'auction_title': '',
 'c_o_2_emission_value': 55,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 341,
 'expiration_date': '2026-01-29T16:19:43Z',
 'fuel_type': 'hybrid',
 'id': '500ac764-2262-5671-bdd2-bc1fa8566490',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB61267',
 'listing': 'auction',
 'location': 'FR',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 101117,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T6 Recharge Inscription Business AWD',
 'transmission': 'automatic',
 'trim': 'Inscription Business AWD',
 'year': 2021}
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB61267%27 HTTP/1.1" 200 None
2026-01-29 06:02:44 [auto1.fr] INFO: Saving data for WB61267: {'auction_closing_time': 1769703583.0, 'created_time': 1768844477.037308, 'last_price_update_time': 1769666564.887572}
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WB61267') HTTP/1.1" 204 0
2026-01-29 06:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_91737b601d4c83bf4b63b50285ea191e.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_e4de5a40d2d538303ee70f9f0b848ce5.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F34%252F52341f51be77abfc5b004cbb5a7bd1ff%252Fpa%252FUY38099_5e44b955e6c81e6f072195e6b6e02c6b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_5e44b955e6c81e6f072195e6b6e02c6b.jpg not downloaded yet
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F61%252Fe4616a24ff11f27f03fa189a8d18f728%252Fpa%252FUG35109_e326430b199aef60c5a767df83d08606.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_e326430b199aef60c5a767df83d08606.jpg not downloaded yet
2026-01-29 06:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZH57094> (referer: https://www.auto1.com/v1/car-details-view/ZH57094/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F10%252F961033bf702c435bcfdc3e7406463a6c%252Fpa%252FJB37332_e77b9a00bd4b7d13f7ca2f40d44f2b3b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_e77b9a00bd4b7d13f7ca2f40d44f2b3b.jpg not downloaded yet
2026-01-29 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fa5%252F15a57247cf65a79bb5e2285eebb6c11b%252Fpa%252FHV11648_d081a5f043883e2c8e68e265954cd7f3.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_d081a5f043883e2c8e68e265954cd7f3.jpg not downloaded yet
2026-01-29 06:02:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CC73759/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PJ01244> (referer: https://www.auto1.com/v1/car-details-view/PJ01244/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FJ44298/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CJ16783/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JE59614/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f5b0d90>
2026-01-29 06:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04a5249f-ab6b-5856-8c3d-0a4021da83e9/04a5249f-ab6b-5856-8c3d-0a4021da83e9_image_3.jpg HTTP/1.1" 201 0
2026-01-29 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F34%252F52341f51be77abfc5b004cbb5a7bd1ff%252Fpa%252FUY38099_06d993a03986aede0a4d68c3a7c6b979.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_06d993a03986aede0a4d68c3a7c6b979.jpg saved to cache
2026-01-29 06:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 04a5249f-ab6b-5856-8c3d-0a4021da83e9
2026-01-29 06:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f45a390>
2026-01-29 06:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b542ba20-2534-578d-8af4-2d58076300b4/b542ba20-2534-578d-8af4-2d58076300b4_image_4.jpg HTTP/1.1" 201 0
2026-01-29 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F10%252F961033bf702c435bcfdc3e7406463a6c%252Fpa%252FJB37332_543f53639b558b0d7dcf8795647c4787.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_543f53639b558b0d7dcf8795647c4787.jpg saved to cache
2026-01-29 06:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b542ba20-2534-578d-8af4-2d58076300b4
2026-01-29 06:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c099b90>
2026-01-29 06:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04a5249f-ab6b-5856-8c3d-0a4021da83e9/04a5249f-ab6b-5856-8c3d-0a4021da83e9_image_2.jpg HTTP/1.1" 201 0
2026-01-29 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F34%252F52341f51be77abfc5b004cbb5a7bd1ff%252Fpa%252FUY38099_7f564678351978b35652b185f63f7c25.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_7f564678351978b35652b185f63f7c25.jpg saved to cache
2026-01-29 06:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 04a5249f-ab6b-5856-8c3d-0a4021da83e9
2026-01-29 06:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c05f550>
2026-01-29 06:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e18464c1-d77a-53f8-9a02-6118617f85b1/e18464c1-d77a-53f8-9a02-6118617f85b1_image_0.jpg HTTP/1.1" 201 0
2026-01-29 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fa5%252F15a57247cf65a79bb5e2285eebb6c11b%252Fpa%252FHV11648_9e9cf5132e186978052be633f44beb51.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_9e9cf5132e186978052be633f44beb51.jpg saved to cache
2026-01-29 06:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e18464c1-d77a-53f8-9a02-6118617f85b1
2026-01-29 06:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_eceb2e4d31b478c524859a1ac2882d61.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F34%252F52341f51be77abfc5b004cbb5a7bd1ff%252Fpa%252FUY38099_fdedd5daecae76229513c1d4fd5ee059.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_fdedd5daecae76229513c1d4fd5ee059.jpg not downloaded yet
2026-01-29 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F61%252Fe4616a24ff11f27f03fa189a8d18f728%252Fpa%252FUG35109_7c5cd791ee8b8e87ea00868ffad48650.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_7c5cd791ee8b8e87ea00868ffad48650.jpg not downloaded yet
2026-01-29 06:02:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6fe60610>
2026-01-29 06:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b542ba20-2534-578d-8af4-2d58076300b4/b542ba20-2534-578d-8af4-2d58076300b4_image_5.jpg HTTP/1.1" 201 0
2026-01-29 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F10%252F961033bf702c435bcfdc3e7406463a6c%252Fpa%252FJB37332_de8742c62ea249bbe88b7506a57d62b6.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_de8742c62ea249bbe88b7506a57d62b6.jpg saved to cache
2026-01-29 06:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b542ba20-2534-578d-8af4-2d58076300b4
2026-01-29 06:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_2e6e5278e23414c053103d9e5bf2acf9.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_d80ee4611acd9dc1ffce0e217674247f.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F10%252F961033bf702c435bcfdc3e7406463a6c%252Fpa%252FJB37332_0daf0d3faa68b11b527e9e46e5950335.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_0daf0d3faa68b11b527e9e46e5950335.jpg not downloaded yet
2026-01-29 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fa5%252F15a57247cf65a79bb5e2285eebb6c11b%252Fpa%252FHV11648_7729e34a115e5b26faa0005e33a9bd83.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_7729e34a115e5b26faa0005e33a9bd83.jpg not downloaded yet
2026-01-29 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F34%252F52341f51be77abfc5b004cbb5a7bd1ff%252Fpa%252FUY38099_e9f7ab1cf163c7608202e42ae0c8decb.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_e9f7ab1cf163c7608202e42ae0c8decb.jpg not downloaded yet
2026-01-29 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F61%252Fe4616a24ff11f27f03fa189a8d18f728%252Fpa%252FUG35109_9b100bc0b1f69cd6b8ad31d96a18a1be.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_9b100bc0b1f69cd6b8ad31d96a18a1be.jpg not downloaded yet
2026-01-29 06:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YG08279> (referer: https://www.auto1.com/v1/car-details-view/YG08279/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FP06893/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ffb0a10>
2026-01-29 06:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04a5249f-ab6b-5856-8c3d-0a4021da83e9/04a5249f-ab6b-5856-8c3d-0a4021da83e9_image_4.jpg HTTP/1.1" 201 0
2026-01-29 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F34%252F52341f51be77abfc5b004cbb5a7bd1ff%252Fpa%252FUY38099_91737b601d4c83bf4b63b50285ea191e.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_91737b601d4c83bf4b63b50285ea191e.jpg saved to cache
2026-01-29 06:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 04a5249f-ab6b-5856-8c3d-0a4021da83e9
2026-01-29 06:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c14a010>
2026-01-29 06:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e18464c1-d77a-53f8-9a02-6118617f85b1/e18464c1-d77a-53f8-9a02-6118617f85b1_image_1.jpg HTTP/1.1" 201 0
2026-01-29 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fa5%252F15a57247cf65a79bb5e2285eebb6c11b%252Fpa%252FHV11648_e4de5a40d2d538303ee70f9f0b848ce5.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_e4de5a40d2d538303ee70f9f0b848ce5.jpg saved to cache
2026-01-29 06:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e18464c1-d77a-53f8-9a02-6118617f85b1
2026-01-29 06:02:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a9df2b8-7c08-5966-be0f-591af074057e with identifier: ZH57094
2026-01-29 06:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a9df2b8-7c08-5966-be0f-591af074057e with scrape type 1
2026-01-29 06:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 4a9df2b8-7c08-5966-be0f-591af074057e
2026-01-29 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fbe%252Fc3be27b6261d9847ba839edb8d43f377%252Fpa%252FZH57094_99b40d36b7fa63529ec649f6a43e754a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_99b40d36b7fa63529ec649f6a43e754a.jpg not downloaded yet
2026-01-29 06:02:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5b14454-b79e-50a8-871f-1857026ddb79 with identifier: PJ01244
2026-01-29 06:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5b14454-b79e-50a8-871f-1857026ddb79 with scrape type 2
2026-01-29 06:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5b14454-b79e-50a8-871f-1857026ddb79 with scrape type 2
2026-01-29 06:02:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a5b14454-b79e-50a8-871f-1857026ddb79, identifier: PJ01244
2026-01-29 06:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_e326430b199aef60c5a767df83d08606.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_08f73b54f4f2a91fab1e37c401a8825a.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_905de21de2df34aec5f40a86ca5ee91e.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_1c3797d4e28bb6146bdd2673a084a460.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F10%252F961033bf702c435bcfdc3e7406463a6c%252Fpa%252FJB37332_8f598525dbbafb26415507405fb7bf56.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_8f598525dbbafb26415507405fb7bf56.jpg not downloaded yet
2026-01-29 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fa5%252F15a57247cf65a79bb5e2285eebb6c11b%252Fpa%252FHV11648_ebbbf462604a81250d403c9456c8d3e9.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_ebbbf462604a81250d403c9456c8d3e9.jpg not downloaded yet
2026-01-29 06:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a5b14454-b79e-50a8-871f-1857026ddb79 with identifier: PJ01244
2026-01-29 06:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a5b14454-b79e-50a8-871f-1857026ddb79 with identifier: PJ01244
2026-01-29 06:02:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a5b14454-b79e-50a8-871f-1857026ddb79 with identifier: PJ01244 to the API
2026-01-29 06:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:02:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PJ01244>
{'auction_title': '',
 'c_o_2_emission_value': 5,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 204,
 'expiration_date': '2026-01-29T16:44:57Z',
 'fuel_type': 'electro',
 'id': 'a5b14454-b79e-50a8-871f-1857026ddb79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ01244',
 'listing': 'auction',
 'location': 'Fouquières-lès-Lens',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 147976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Kona electric drive 150 kW Executive 2WD',
 'transmission': 'automatic',
 'trim': 'Executive 2WD',
 'year': 2019}
2026-01-29 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PJ01244%27 HTTP/1.1" 200 None
2026-01-29 06:02:47 [auto1.fr] INFO: Saving data for PJ01244: {'auction_closing_time': 1769705097.0, 'created_time': 1769015493.636303, 'last_price_update_time': 1769666567.953405}
2026-01-29 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PJ01244') HTTP/1.1" 204 0
2026-01-29 06:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff5b7d0>
2026-01-29 06:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04a5249f-ab6b-5856-8c3d-0a4021da83e9/04a5249f-ab6b-5856-8c3d-0a4021da83e9_image_6.jpg HTTP/1.1" 201 0
2026-01-29 06:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F34%252F52341f51be77abfc5b004cbb5a7bd1ff%252Fpa%252FUY38099_eceb2e4d31b478c524859a1ac2882d61.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_eceb2e4d31b478c524859a1ac2882d61.jpg saved to cache
2026-01-29 06:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 04a5249f-ab6b-5856-8c3d-0a4021da83e9
2026-01-29 06:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_02ee8be0407683f29058a3069243f421.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_5e44b955e6c81e6f072195e6b6e02c6b.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_8a0adba3661472ce52ee12a7a8861ad6.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_865191e4927252a9f784c3d851a0db14.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F34%252F52341f51be77abfc5b004cbb5a7bd1ff%252Fpa%252FUY38099_171d120fdbd419c7a9fdefef45cecec7.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_171d120fdbd419c7a9fdefef45cecec7.jpg not downloaded yet
2026-01-29 06:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F61%252Fe4616a24ff11f27f03fa189a8d18f728%252Fpa%252FUG35109_1bda08de376b5fda05c1afe9e6150ea5.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_1bda08de376b5fda05c1afe9e6150ea5.jpg not downloaded yet
2026-01-29 06:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fbe%252Fc3be27b6261d9847ba839edb8d43f377%252Fpa%252FZH57094_cd50facf990c01a4241b870fbda96da3.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_cd50facf990c01a4241b870fbda96da3.jpg not downloaded yet
2026-01-29 06:02:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F10%252F961033bf702c435bcfdc3e7406463a6c%252Fpa%252FJB37332_ba6bb7f172a23f228908944ce5778dc2.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_ba6bb7f172a23f228908944ce5778dc2.jpg not downloaded yet
2026-01-29 06:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fa5%252F15a57247cf65a79bb5e2285eebb6c11b%252Fpa%252FHV11648_62b7c73b7b4bc32ea151ce70c92776c9.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_62b7c73b7b4bc32ea151ce70c92776c9.jpg not downloaded yet
2026-01-29 06:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f337690>
2026-01-29 06:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e18464c1-d77a-53f8-9a02-6118617f85b1/e18464c1-d77a-53f8-9a02-6118617f85b1_image_3.jpg HTTP/1.1" 201 0
2026-01-29 06:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fa5%252F15a57247cf65a79bb5e2285eebb6c11b%252Fpa%252FHV11648_2e6e5278e23414c053103d9e5bf2acf9.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_2e6e5278e23414c053103d9e5bf2acf9.jpg saved to cache
2026-01-29 06:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e18464c1-d77a-53f8-9a02-6118617f85b1
2026-01-29 06:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f36e1d0>
2026-01-29 06:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e18464c1-d77a-53f8-9a02-6118617f85b1/e18464c1-d77a-53f8-9a02-6118617f85b1_image_2.jpg HTTP/1.1" 201 0
2026-01-29 06:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fa5%252F15a57247cf65a79bb5e2285eebb6c11b%252Fpa%252FHV11648_d80ee4611acd9dc1ffce0e217674247f.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_d80ee4611acd9dc1ffce0e217674247f.jpg saved to cache
2026-01-29 06:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e18464c1-d77a-53f8-9a02-6118617f85b1
2026-01-29 06:02:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de7934c8-31f3-52a2-bb44-316a2e680403 with identifier: YG08279
2026-01-29 06:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de7934c8-31f3-52a2-bb44-316a2e680403 with scrape type 2
2026-01-29 06:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de7934c8-31f3-52a2-bb44-316a2e680403 with scrape type 2
2026-01-29 06:02:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: de7934c8-31f3-52a2-bb44-316a2e680403, identifier: YG08279
2026-01-29 06:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_e77b9a00bd4b7d13f7ca2f40d44f2b3b.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_70983fd913855fce2be17edd34374ad0.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F34%252F52341f51be77abfc5b004cbb5a7bd1ff%252Fpa%252FUY38099_a804e0ff59e6c3518dca08ac37d72cba.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_a804e0ff59e6c3518dca08ac37d72cba.jpg not downloaded yet
2026-01-29 06:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F61%252Fe4616a24ff11f27f03fa189a8d18f728%252Fpa%252FUG35109_e818fec006d2492d77839df0c56fb530.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_e818fec006d2492d77839df0c56fb530.jpg not downloaded yet
2026-01-29 06:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fbe%252Fc3be27b6261d9847ba839edb8d43f377%252Fpa%252FZH57094_de0620396053ef18d9a1f7aa016b782b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_de0620396053ef18d9a1f7aa016b782b.jpg not downloaded yet
2026-01-29 06:02:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: de7934c8-31f3-52a2-bb44-316a2e680403 with identifier: YG08279
2026-01-29 06:02:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: de7934c8-31f3-52a2-bb44-316a2e680403 with identifier: YG08279
2026-01-29 06:02:49 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'renault captur 1.2 tce energy intens', 'price': 0, 'currency': 'eur', 'make': 'renault', 'model': 'captur', 'transmission': 'manual', 'odometer': 153416, 'odometer_reading_unit': 'km', 'registration_date': '2018-01-25', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yg08279', 'expiration_date': '2026-01-29t16:48:55z', 'origin_country_code': 'fr', 'trim': 'intens', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 120, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 125, 'id': 'de7934c8-31f3-52a2-bb44-316a2e680403', 'current_year_diff': 8, 'age_in_months': 96, 'make_model': 'renault captur', 'sanitized_make': 'renault', 'odometer_in_km': 153416}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 96,
     'auction_title': '',
     'c_o_2_emission_value': 125,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 120,
     'expiration_date': '2026-01-29t16:48:55z',
     'fuel_type': 'petrol',
     'id': 'de7934c8-31f3-52a2-bb44-316a2e680403',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yg08279',
     'listing': 'auction',
     'location': 'fr',
     'make': 'renault',
     'make_model': 'renault captur',
     'model': 'captur',
     'odometer': 153416,
     'odometer_in_km': 153416,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-01-25',
     'sanitized_make': 'renault',
     'seats_number': 5,
     'seller_name': None,
     'title': 'renault captur 1.2 tce energy intens',
     'transmission': 'manual',
     'trim': 'intens',
     'year': 2018}
2026-01-29 06:02:49 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: de7934c8-31f3-52a2-bb44-316a2e680403 spider: auto1.fr
2026-01-29 06:02:49 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: de7934c8-31f3-52a2-bb44-316a2e680403 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'renault captur 1.2 tce energy intens', 'price': 0, 'currency': 'eur', 'make': 'renault', 'model': 'captur', 'transmission': 'manual', 'odometer': 153416, 'odometer_reading_unit': 'km', 'registration_date': '2018-01-25', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yg08279', 'expiration_date': '2026-01-29t16:48:55z', 'origin_country_code': 'fr', 'trim': 'intens', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 120, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 125, 'id': 'de7934c8-31f3-52a2-bb44-316a2e680403', 'current_year_diff': 8, 'age_in_months': 96, 'make_model': 'renault captur', 'sanitized_make': 'renault', 'odometer_in_km': 153416}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 96,
     'auction_title': '',
     'c_o_2_emission_value': 125,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 120,
     'expiration_date': '2026-01-29t16:48:55z',
     'fuel_type': 'petrol',
     'id': 'de7934c8-31f3-52a2-bb44-316a2e680403',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yg08279',
     'listing': 'auction',
     'location': 'fr',
     'make': 'renault',
     'make_model': 'renault captur',
     'model': 'captur',
     'odometer': 153416,
     'odometer_in_km': 153416,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-01-25',
     'sanitized_make': 'renault',
     'seats_number': 5,
     'seller_name': None,
     'title': 'renault captur 1.2 tce energy intens',
     'transmission': 'manual',
     'trim': 'intens',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:48:55Z',
 'fuel_type': 'petrol',
 'id': 'de7934c8-31f3-52a2-bb44-316a2e680403',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG08279',
 'listing': 'auction',
 'location': 'FR',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 153416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.2 TCe Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2018}
2026-01-29 06:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG08279%27 HTTP/1.1" 200 None
2026-01-29 06:02:49 [auto1.fr] INFO: Saving data for YG08279: {'auction_closing_time': 1769705335.0, 'created_time': 1768584396.851201, 'last_price_update_time': 1769666569.42599}
2026-01-29 06:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YG08279') HTTP/1.1" 204 0
2026-01-29 06:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c2723d0>
2026-01-29 06:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_199ab5d0-e058-5bfe-9399-1fd641b24b93/199ab5d0-e058-5bfe-9399-1fd641b24b93_image_1.jpg HTTP/1.1" 201 0
2026-01-29 06:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F61%252Fe4616a24ff11f27f03fa189a8d18f728%252Fpa%252FUG35109_e326430b199aef60c5a767df83d08606.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_e326430b199aef60c5a767df83d08606.jpg saved to cache
2026-01-29 06:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 199ab5d0-e058-5bfe-9399-1fd641b24b93
2026-01-29 06:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6fe5ec50>
2026-01-29 06:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b542ba20-2534-578d-8af4-2d58076300b4/b542ba20-2534-578d-8af4-2d58076300b4_image_9.jpg HTTP/1.1" 201 0
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F10%252F961033bf702c435bcfdc3e7406463a6c%252Fpa%252FJB37332_08f73b54f4f2a91fab1e37c401a8825a.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_08f73b54f4f2a91fab1e37c401a8825a.jpg saved to cache
2026-01-29 06:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b542ba20-2534-578d-8af4-2d58076300b4
2026-01-29 06:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff49f90>
2026-01-29 06:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04a5249f-ab6b-5856-8c3d-0a4021da83e9/04a5249f-ab6b-5856-8c3d-0a4021da83e9_image_7.jpg HTTP/1.1" 201 0
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F34%252F52341f51be77abfc5b004cbb5a7bd1ff%252Fpa%252FUY38099_905de21de2df34aec5f40a86ca5ee91e.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_905de21de2df34aec5f40a86ca5ee91e.jpg saved to cache
2026-01-29 06:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 04a5249f-ab6b-5856-8c3d-0a4021da83e9
2026-01-29 06:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c141490>
2026-01-29 06:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_199ab5d0-e058-5bfe-9399-1fd641b24b93/199ab5d0-e058-5bfe-9399-1fd641b24b93_image_0.jpg HTTP/1.1" 201 0
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F61%252Fe4616a24ff11f27f03fa189a8d18f728%252Fpa%252FUG35109_1c3797d4e28bb6146bdd2673a084a460.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_1c3797d4e28bb6146bdd2673a084a460.jpg saved to cache
2026-01-29 06:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 199ab5d0-e058-5bfe-9399-1fd641b24b93
2026-01-29 06:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_57208b0f7c68276796760f9aea54b630.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_0daf0d3faa68b11b527e9e46e5950335.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_fdedd5daecae76229513c1d4fd5ee059.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_7c5cd791ee8b8e87ea00868ffad48650.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_d081a5f043883e2c8e68e265954cd7f3.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F10%252F961033bf702c435bcfdc3e7406463a6c%252Fpa%252FJB37332_1433cd3befcff2ed30ae9bef6347ed1a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_1433cd3befcff2ed30ae9bef6347ed1a.jpg not downloaded yet
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fa5%252F15a57247cf65a79bb5e2285eebb6c11b%252Fpa%252FHV11648_818090f666a549f4447b7dba46d9919e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_818090f666a549f4447b7dba46d9919e.jpg not downloaded yet
2026-01-29 06:02:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_7729e34a115e5b26faa0005e33a9bd83.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F34%252F52341f51be77abfc5b004cbb5a7bd1ff%252Fpa%252FUY38099_02354caa1bdbae611bd55ace18803a93.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_02354caa1bdbae611bd55ace18803a93.jpg not downloaded yet
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F61%252Fe4616a24ff11f27f03fa189a8d18f728%252Fpa%252FUG35109_d38b9655bb1997579b30f09662a7fe3a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_d38b9655bb1997579b30f09662a7fe3a.jpg not downloaded yet
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fbe%252Fc3be27b6261d9847ba839edb8d43f377%252Fpa%252FZH57094_14f7374218c694cdcca06d85ba62df27.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_14f7374218c694cdcca06d85ba62df27.jpg not downloaded yet
2026-01-29 06:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f503290>
2026-01-29 06:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b542ba20-2534-578d-8af4-2d58076300b4/b542ba20-2534-578d-8af4-2d58076300b4_image_7.jpg HTTP/1.1" 201 0
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F10%252F961033bf702c435bcfdc3e7406463a6c%252Fpa%252FJB37332_02ee8be0407683f29058a3069243f421.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_02ee8be0407683f29058a3069243f421.jpg saved to cache
2026-01-29 06:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b542ba20-2534-578d-8af4-2d58076300b4
2026-01-29 06:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f45df10>
2026-01-29 06:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04a5249f-ab6b-5856-8c3d-0a4021da83e9/04a5249f-ab6b-5856-8c3d-0a4021da83e9_image_8.jpg HTTP/1.1" 201 0
2026-01-29 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F34%252F52341f51be77abfc5b004cbb5a7bd1ff%252Fpa%252FUY38099_5e44b955e6c81e6f072195e6b6e02c6b.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_5e44b955e6c81e6f072195e6b6e02c6b.jpg saved to cache
2026-01-29 06:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 04a5249f-ab6b-5856-8c3d-0a4021da83e9
2026-01-29 06:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f5b7ad0>
2026-01-29 06:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b542ba20-2534-578d-8af4-2d58076300b4/b542ba20-2534-578d-8af4-2d58076300b4_image_8.jpg HTTP/1.1" 201 0
2026-01-29 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F10%252F961033bf702c435bcfdc3e7406463a6c%252Fpa%252FJB37332_8a0adba3661472ce52ee12a7a8861ad6.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_8a0adba3661472ce52ee12a7a8861ad6.jpg saved to cache
2026-01-29 06:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b542ba20-2534-578d-8af4-2d58076300b4
2026-01-29 06:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c06b450>
2026-01-29 06:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e18464c1-d77a-53f8-9a02-6118617f85b1/e18464c1-d77a-53f8-9a02-6118617f85b1_image_4.jpg HTTP/1.1" 201 0
2026-01-29 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fa5%252F15a57247cf65a79bb5e2285eebb6c11b%252Fpa%252FHV11648_865191e4927252a9f784c3d851a0db14.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_865191e4927252a9f784c3d851a0db14.jpg saved to cache
2026-01-29 06:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e18464c1-d77a-53f8-9a02-6118617f85b1
2026-01-29 06:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_fc4a4c6a78627c4554af17a71eb57597.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F10%252F961033bf702c435bcfdc3e7406463a6c%252Fpa%252FJB37332_558d4130a06f5e6dc64e0df4bcf5b1a9.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_558d4130a06f5e6dc64e0df4bcf5b1a9.jpg not downloaded yet
2026-01-29 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fa5%252F15a57247cf65a79bb5e2285eebb6c11b%252Fpa%252FHV11648_82befa91da219fa17884ea90c6d7d20b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_82befa91da219fa17884ea90c6d7d20b.jpg not downloaded yet
2026-01-29 06:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f5a2090>
2026-01-29 06:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b542ba20-2534-578d-8af4-2d58076300b4/b542ba20-2534-578d-8af4-2d58076300b4_image_10.jpg HTTP/1.1" 201 0
2026-01-29 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F10%252F961033bf702c435bcfdc3e7406463a6c%252Fpa%252FJB37332_e77b9a00bd4b7d13f7ca2f40d44f2b3b.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_e77b9a00bd4b7d13f7ca2f40d44f2b3b.jpg saved to cache
2026-01-29 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item b542ba20-2534-578d-8af4-2d58076300b4
2026-01-29 06:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f399010>
2026-01-29 06:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04a5249f-ab6b-5856-8c3d-0a4021da83e9/04a5249f-ab6b-5856-8c3d-0a4021da83e9_image_5.jpg HTTP/1.1" 201 0
2026-01-29 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F34%252F52341f51be77abfc5b004cbb5a7bd1ff%252Fpa%252FUY38099_70983fd913855fce2be17edd34374ad0.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_70983fd913855fce2be17edd34374ad0.jpg saved to cache
2026-01-29 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 04a5249f-ab6b-5856-8c3d-0a4021da83e9
2026-01-29 06:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_1bda08de376b5fda05c1afe9e6150ea5.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F34%252F52341f51be77abfc5b004cbb5a7bd1ff%252Fpa%252FUY38099_28d0b36b37ec044bdf4d6a2991654c18.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_28d0b36b37ec044bdf4d6a2991654c18.jpg not downloaded yet
2026-01-29 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F61%252Fe4616a24ff11f27f03fa189a8d18f728%252Fpa%252FUG35109_1607d6fe0175582252b1c24e69b938f0.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_1607d6fe0175582252b1c24e69b938f0.jpg not downloaded yet
2026-01-29 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fbe%252Fc3be27b6261d9847ba839edb8d43f377%252Fpa%252FZH57094_eef9edbd296eae652ff3155d1d60f8bf.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_eef9edbd296eae652ff3155d1d60f8bf.jpg not downloaded yet
2026-01-29 06:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_171d120fdbd419c7a9fdefef45cecec7.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_ba6bb7f172a23f228908944ce5778dc2.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_cd50facf990c01a4241b870fbda96da3.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fa5%252F15a57247cf65a79bb5e2285eebb6c11b%252Fpa%252FHV11648_587cec7dba88fd1bbb0268f3d2f07a10.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_587cec7dba88fd1bbb0268f3d2f07a10.jpg not downloaded yet
2026-01-29 06:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f356710>
2026-01-29 06:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b542ba20-2534-578d-8af4-2d58076300b4/b542ba20-2534-578d-8af4-2d58076300b4_image_6.jpg HTTP/1.1" 201 0
2026-01-29 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F10%252F961033bf702c435bcfdc3e7406463a6c%252Fpa%252FJB37332_57208b0f7c68276796760f9aea54b630.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_57208b0f7c68276796760f9aea54b630.jpg saved to cache
2026-01-29 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b542ba20-2534-578d-8af4-2d58076300b4
2026-01-29 06:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f5a37d0>
2026-01-29 06:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b542ba20-2534-578d-8af4-2d58076300b4/b542ba20-2534-578d-8af4-2d58076300b4_image_11.jpg HTTP/1.1" 201 0
2026-01-29 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F10%252F961033bf702c435bcfdc3e7406463a6c%252Fpa%252FJB37332_0daf0d3faa68b11b527e9e46e5950335.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_0daf0d3faa68b11b527e9e46e5950335.jpg saved to cache
2026-01-29 06:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item b542ba20-2534-578d-8af4-2d58076300b4
2026-01-29 06:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f3ec0d0>
2026-01-29 06:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04a5249f-ab6b-5856-8c3d-0a4021da83e9/04a5249f-ab6b-5856-8c3d-0a4021da83e9_image_9.jpg HTTP/1.1" 201 0
2026-01-29 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F34%252F52341f51be77abfc5b004cbb5a7bd1ff%252Fpa%252FUY38099_fdedd5daecae76229513c1d4fd5ee059.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_fdedd5daecae76229513c1d4fd5ee059.jpg saved to cache
2026-01-29 06:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 04a5249f-ab6b-5856-8c3d-0a4021da83e9
2026-01-29 06:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f558210>
2026-01-29 06:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_199ab5d0-e058-5bfe-9399-1fd641b24b93/199ab5d0-e058-5bfe-9399-1fd641b24b93_image_2.jpg HTTP/1.1" 201 0
2026-01-29 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F61%252Fe4616a24ff11f27f03fa189a8d18f728%252Fpa%252FUG35109_7c5cd791ee8b8e87ea00868ffad48650.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_7c5cd791ee8b8e87ea00868ffad48650.jpg saved to cache
2026-01-29 06:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 199ab5d0-e058-5bfe-9399-1fd641b24b93
2026-01-29 06:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f57eb90>
2026-01-29 06:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e18464c1-d77a-53f8-9a02-6118617f85b1/e18464c1-d77a-53f8-9a02-6118617f85b1_image_5.jpg HTTP/1.1" 201 0
2026-01-29 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fa5%252F15a57247cf65a79bb5e2285eebb6c11b%252Fpa%252FHV11648_d081a5f043883e2c8e68e265954cd7f3.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_d081a5f043883e2c8e68e265954cd7f3.jpg saved to cache
2026-01-29 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e18464c1-d77a-53f8-9a02-6118617f85b1
2026-01-29 06:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f59fd90>
2026-01-29 06:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e18464c1-d77a-53f8-9a02-6118617f85b1/e18464c1-d77a-53f8-9a02-6118617f85b1_image_6.jpg HTTP/1.1" 201 0
2026-01-29 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fa5%252F15a57247cf65a79bb5e2285eebb6c11b%252Fpa%252FHV11648_7729e34a115e5b26faa0005e33a9bd83.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_7729e34a115e5b26faa0005e33a9bd83.jpg saved to cache
2026-01-29 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e18464c1-d77a-53f8-9a02-6118617f85b1
2026-01-29 06:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_62b7c73b7b4bc32ea151ce70c92776c9.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_ebbbf462604a81250d403c9456c8d3e9.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F34%252F52341f51be77abfc5b004cbb5a7bd1ff%252Fpa%252FUY38099_17ee87171b3cfcf4ed1c964e8d2d1042.png%27 HTTP/1.1" 200 None
2026-01-29 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_17ee87171b3cfcf4ed1c964e8d2d1042.png not downloaded yet
2026-01-29 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F61%252Fe4616a24ff11f27f03fa189a8d18f728%252Fpa%252FUG35109_26169cec957f7c7fa672bfbcc9a7a0be.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_26169cec957f7c7fa672bfbcc9a7a0be.jpg not downloaded yet
2026-01-29 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fbe%252Fc3be27b6261d9847ba839edb8d43f377%252Fpa%252FZH57094_6f2f0b6324b94a8dc41caad063169d0f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_6f2f0b6324b94a8dc41caad063169d0f.jpg not downloaded yet
2026-01-29 06:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7e208490>
2026-01-29 06:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b542ba20-2534-578d-8af4-2d58076300b4/b542ba20-2534-578d-8af4-2d58076300b4_image_3.jpg HTTP/1.1" 201 0
2026-01-29 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F10%252F961033bf702c435bcfdc3e7406463a6c%252Fpa%252FJB37332_fc4a4c6a78627c4554af17a71eb57597.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_fc4a4c6a78627c4554af17a71eb57597.jpg saved to cache
2026-01-29 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b542ba20-2534-578d-8af4-2d58076300b4
2026-01-29 06:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_de0620396053ef18d9a1f7aa016b782b.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fa5%252F15a57247cf65a79bb5e2285eebb6c11b%252Fpa%252FHV11648_bbb4291cf238c7d12e0819468f38f61a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_bbb4291cf238c7d12e0819468f38f61a.jpg not downloaded yet
2026-01-29 06:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_14f7374218c694cdcca06d85ba62df27.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_818090f666a549f4447b7dba46d9919e.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F61%252Fe4616a24ff11f27f03fa189a8d18f728%252Fpa%252FUG35109_6017784d52fc83f1ff1a2dcb88e1cadf.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_6017784d52fc83f1ff1a2dcb88e1cadf.jpg not downloaded yet
2026-01-29 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fbe%252Fc3be27b6261d9847ba839edb8d43f377%252Fpa%252FZH57094_2ccc1bfea05db2281b0871e4d6972d7f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_2ccc1bfea05db2281b0871e4d6972d7f.jpg not downloaded yet
2026-01-29 06:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UK63573> (referer: https://www.auto1.com/v1/car-details-view/UK63573/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JE59614> (referer: https://www.auto1.com/v1/car-details-view/JE59614/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FJ44298> (referer: https://www.auto1.com/v1/car-details-view/FJ44298/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CJ16783> (referer: https://www.auto1.com/v1/car-details-view/CJ16783/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CC73759> (referer: https://www.auto1.com/v1/car-details-view/CC73759/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c2f43d0>
2026-01-29 06:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-29 06:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_199ab5d0-e058-5bfe-9399-1fd641b24b93/199ab5d0-e058-5bfe-9399-1fd641b24b93_image_4.jpg HTTP/1.1" 201 0
2026-01-29 06:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F61%252Fe4616a24ff11f27f03fa189a8d18f728%252Fpa%252FUG35109_1bda08de376b5fda05c1afe9e6150ea5.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_1bda08de376b5fda05c1afe9e6150ea5.jpg saved to cache
2026-01-29 06:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 199ab5d0-e058-5bfe-9399-1fd641b24b93
2026-01-29 06:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6fe27a90>
2026-01-29 06:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04a5249f-ab6b-5856-8c3d-0a4021da83e9/04a5249f-ab6b-5856-8c3d-0a4021da83e9_image_11.jpg HTTP/1.1" 201 0
2026-01-29 06:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F34%252F52341f51be77abfc5b004cbb5a7bd1ff%252Fpa%252FUY38099_171d120fdbd419c7a9fdefef45cecec7.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_171d120fdbd419c7a9fdefef45cecec7.jpg saved to cache
2026-01-29 06:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 04a5249f-ab6b-5856-8c3d-0a4021da83e9
2026-01-29 06:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c29a090>
2026-01-29 06:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b542ba20-2534-578d-8af4-2d58076300b4/b542ba20-2534-578d-8af4-2d58076300b4_image_13.jpg HTTP/1.1" 201 0
2026-01-29 06:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F10%252F961033bf702c435bcfdc3e7406463a6c%252Fpa%252FJB37332_ba6bb7f172a23f228908944ce5778dc2.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_ba6bb7f172a23f228908944ce5778dc2.jpg saved to cache
2026-01-29 06:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item b542ba20-2534-578d-8af4-2d58076300b4
2026-01-29 06:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ffb32d0>
2026-01-29 06:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a9df2b8-7c08-5966-be0f-591af074057e/4a9df2b8-7c08-5966-be0f-591af074057e_image_1.jpg HTTP/1.1" 201 0
2026-01-29 06:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fbe%252Fc3be27b6261d9847ba839edb8d43f377%252Fpa%252FZH57094_cd50facf990c01a4241b870fbda96da3.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_cd50facf990c01a4241b870fbda96da3.jpg saved to cache
2026-01-29 06:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4a9df2b8-7c08-5966-be0f-591af074057e
2026-01-29 06:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_558d4130a06f5e6dc64e0df4bcf5b1a9.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fa5%252F15a57247cf65a79bb5e2285eebb6c11b%252Fpa%252FHV11648_51d41e595fc576da125bc108d152dca0.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_51d41e595fc576da125bc108d152dca0.jpg not downloaded yet
2026-01-29 06:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ffec290>
2026-01-29 06:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e18464c1-d77a-53f8-9a02-6118617f85b1/e18464c1-d77a-53f8-9a02-6118617f85b1_image_8.jpg HTTP/1.1" 201 0
2026-01-29 06:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fa5%252F15a57247cf65a79bb5e2285eebb6c11b%252Fpa%252FHV11648_62b7c73b7b4bc32ea151ce70c92776c9.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_62b7c73b7b4bc32ea151ce70c92776c9.jpg saved to cache
2026-01-29 06:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e18464c1-d77a-53f8-9a02-6118617f85b1
2026-01-29 06:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f304190>
2026-01-29 06:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e18464c1-d77a-53f8-9a02-6118617f85b1/e18464c1-d77a-53f8-9a02-6118617f85b1_image_7.jpg HTTP/1.1" 201 0
2026-01-29 06:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fa5%252F15a57247cf65a79bb5e2285eebb6c11b%252Fpa%252FHV11648_ebbbf462604a81250d403c9456c8d3e9.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_ebbbf462604a81250d403c9456c8d3e9.jpg saved to cache
2026-01-29 06:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e18464c1-d77a-53f8-9a02-6118617f85b1
2026-01-29 06:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_d38b9655bb1997579b30f09662a7fe3a.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_82befa91da219fa17884ea90c6d7d20b.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F61%252Fe4616a24ff11f27f03fa189a8d18f728%252Fpa%252FUG35109_13623e9006466f3c599c8254b2acbe75.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_13623e9006466f3c599c8254b2acbe75.jpg not downloaded yet
2026-01-29 06:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fbe%252Fc3be27b6261d9847ba839edb8d43f377%252Fpa%252FZH57094_2d19ed05ab5847227db68db8db2a447b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_2d19ed05ab5847227db68db8db2a447b.jpg not downloaded yet
2026-01-29 06:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_587cec7dba88fd1bbb0268f3d2f07a10.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_eef9edbd296eae652ff3155d1d60f8bf.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_1607d6fe0175582252b1c24e69b938f0.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fa5%252F15a57247cf65a79bb5e2285eebb6c11b%252Fpa%252FHV11648_b096055bb322c4f29beb1243f42d7427.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_b096055bb322c4f29beb1243f42d7427.jpg not downloaded yet
2026-01-29 06:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FP06893> (referer: https://www.auto1.com/v1/car-details-view/FP06893/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KL98727> (referer: https://www.auto1.com/v1/car-details-view/KL98727/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LX40728> (referer: https://www.auto1.com/v1/car-details-view/LX40728/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f358d10>
2026-01-29 06:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a9df2b8-7c08-5966-be0f-591af074057e/4a9df2b8-7c08-5966-be0f-591af074057e_image_2.jpg HTTP/1.1" 201 0
2026-01-29 06:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fbe%252Fc3be27b6261d9847ba839edb8d43f377%252Fpa%252FZH57094_de0620396053ef18d9a1f7aa016b782b.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_de0620396053ef18d9a1f7aa016b782b.jpg saved to cache
2026-01-29 06:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4a9df2b8-7c08-5966-be0f-591af074057e
2026-01-29 06:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c0ec6d0>
2026-01-29 06:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a9df2b8-7c08-5966-be0f-591af074057e/4a9df2b8-7c08-5966-be0f-591af074057e_image_3.jpg HTTP/1.1" 201 0
2026-01-29 06:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fbe%252Fc3be27b6261d9847ba839edb8d43f377%252Fpa%252FZH57094_14f7374218c694cdcca06d85ba62df27.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_14f7374218c694cdcca06d85ba62df27.jpg saved to cache
2026-01-29 06:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4a9df2b8-7c08-5966-be0f-591af074057e
2026-01-29 06:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f531ad0>
2026-01-29 06:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e18464c1-d77a-53f8-9a02-6118617f85b1/e18464c1-d77a-53f8-9a02-6118617f85b1_image_9.jpg HTTP/1.1" 201 0
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fa5%252F15a57247cf65a79bb5e2285eebb6c11b%252Fpa%252FHV11648_818090f666a549f4447b7dba46d9919e.jpg') HTTP/1.1" 204 0
2026-01-29 06:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_818090f666a549f4447b7dba46d9919e.jpg saved to cache
2026-01-29 06:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e18464c1-d77a-53f8-9a02-6118617f85b1
2026-01-29 06:02:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a00412fb-0d8a-51ac-b4d7-7988e23c69fb with identifier: UK63573
2026-01-29 06:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a00412fb-0d8a-51ac-b4d7-7988e23c69fb with scrape type 2
2026-01-29 06:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a00412fb-0d8a-51ac-b4d7-7988e23c69fb with scrape type 2
2026-01-29 06:02:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a00412fb-0d8a-51ac-b4d7-7988e23c69fb, identifier: UK63573
2026-01-29 06:02:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73dfcff9-7d38-54e1-a9e1-e1d6903928bc with identifier: JE59614
2026-01-29 06:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73dfcff9-7d38-54e1-a9e1-e1d6903928bc with scrape type 2
2026-01-29 06:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73dfcff9-7d38-54e1-a9e1-e1d6903928bc with scrape type 2
2026-01-29 06:02:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 73dfcff9-7d38-54e1-a9e1-e1d6903928bc, identifier: JE59614
2026-01-29 06:02:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1e18c46-0cc2-5850-ab52-79022a198285 with identifier: FJ44298
2026-01-29 06:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1e18c46-0cc2-5850-ab52-79022a198285 with scrape type 2
2026-01-29 06:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1e18c46-0cc2-5850-ab52-79022a198285 with scrape type 2
2026-01-29 06:02:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e1e18c46-0cc2-5850-ab52-79022a198285, identifier: FJ44298
2026-01-29 06:02:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f446e073-a65c-523c-9786-9e73e1fe1c48 with identifier: CJ16783
2026-01-29 06:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f446e073-a65c-523c-9786-9e73e1fe1c48 with scrape type 1
2026-01-29 06:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item f446e073-a65c-523c-9786-9e73e1fe1c48
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffb%252F07fbaae6d38a104c95af1499a83d88e1%252Fpa%252FCJ16783_0c026b3c251431fac32d76a72116c192.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_0c026b3c251431fac32d76a72116c192.jpg already downloaded
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffb%252F07fbaae6d38a104c95af1499a83d88e1%252Fpa%252FCJ16783_2b56e9a8efc1b44c366cb4d6db5fa9c3.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_2b56e9a8efc1b44c366cb4d6db5fa9c3.jpg already downloaded
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffb%252F07fbaae6d38a104c95af1499a83d88e1%252Fpa%252FCJ16783_efd5c158d209b3653f24cf8e3ab5b4c0.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_efd5c158d209b3653f24cf8e3ab5b4c0.jpg already downloaded
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffb%252F07fbaae6d38a104c95af1499a83d88e1%252Fpa%252FCJ16783_cb3768c9ec622a4ee533e3b26c6a5dc5.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_cb3768c9ec622a4ee533e3b26c6a5dc5.jpg already downloaded
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffb%252F07fbaae6d38a104c95af1499a83d88e1%252Fpa%252FCJ16783_989e84a0f50fb8e99f719e98a4fdb806.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_989e84a0f50fb8e99f719e98a4fdb806.jpg already downloaded
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffb%252F07fbaae6d38a104c95af1499a83d88e1%252Fpa%252FCJ16783_d0f61dc544c57713440edbc70c0f26e1.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_d0f61dc544c57713440edbc70c0f26e1.jpg already downloaded
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffb%252F07fbaae6d38a104c95af1499a83d88e1%252Fpa%252FCJ16783_8c44094d9b443ae62e51e667d1c03778.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_8c44094d9b443ae62e51e667d1c03778.jpg already downloaded
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffb%252F07fbaae6d38a104c95af1499a83d88e1%252Fpa%252FCJ16783_0eb1b88b196fb832612e240a04db20ac.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_0eb1b88b196fb832612e240a04db20ac.jpg already downloaded
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffb%252F07fbaae6d38a104c95af1499a83d88e1%252Fpa%252FCJ16783_8b5d90e82c122573dc335270e4485a2b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_8b5d90e82c122573dc335270e4485a2b.jpg already downloaded
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffb%252F07fbaae6d38a104c95af1499a83d88e1%252Fpa%252FCJ16783_59a7c7b0f730414f0dbc6519dadb0561.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_59a7c7b0f730414f0dbc6519dadb0561.jpg already downloaded
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffb%252F07fbaae6d38a104c95af1499a83d88e1%252Fpa%252FCJ16783_142ef977dbffbe65a0b597dde483b675.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_142ef977dbffbe65a0b597dde483b675.jpg already downloaded
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffb%252F07fbaae6d38a104c95af1499a83d88e1%252Fpa%252FCJ16783_d9e94e24bba8896519507578e8e19977.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_d9e94e24bba8896519507578e8e19977.jpg already downloaded
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffb%252F07fbaae6d38a104c95af1499a83d88e1%252Fpa%252FCJ16783_76997eeeaafcd6c27ce31817a2c69085.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_76997eeeaafcd6c27ce31817a2c69085.jpg already downloaded
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffb%252F07fbaae6d38a104c95af1499a83d88e1%252Fpa%252FCJ16783_e5a229c0a9e7d4baab09f5f9e512f743.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_e5a229c0a9e7d4baab09f5f9e512f743.jpg already downloaded
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffb%252F07fbaae6d38a104c95af1499a83d88e1%252Fpa%252FCJ16783_a792634e128215b1af0990cfbc734572.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_a792634e128215b1af0990cfbc734572.jpg already downloaded
2026-01-29 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffb%252F07fbaae6d38a104c95af1499a83d88e1%252Fpa%252FCJ16783_1578c125a23a7200275298705726067f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_1578c125a23a7200275298705726067f.jpg already downloaded
2026-01-29 06:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f446e073-a65c-523c-9786-9e73e1fe1c48, identifier: CJ16783
2026-01-29 06:02:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4debfb4-0c79-50ef-afc1-b2070bcd9b22 with identifier: CC73759
2026-01-29 06:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4debfb4-0c79-50ef-afc1-b2070bcd9b22 with scrape type 2
2026-01-29 06:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4debfb4-0c79-50ef-afc1-b2070bcd9b22 with scrape type 2
2026-01-29 06:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d4debfb4-0c79-50ef-afc1-b2070bcd9b22, identifier: CC73759
2026-01-29 06:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F61%252Fe4616a24ff11f27f03fa189a8d18f728%252Fpa%252FUG35109_909429b3863532062ecf8297c350b0b0.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_909429b3863532062ecf8297c350b0b0.jpg not downloaded yet
2026-01-29 06:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fbe%252Fc3be27b6261d9847ba839edb8d43f377%252Fpa%252FZH57094_65f99f760430fbe070996c928f5ae93b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_65f99f760430fbe070996c928f5ae93b.jpg not downloaded yet
2026-01-29 06:02:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a00412fb-0d8a-51ac-b4d7-7988e23c69fb with identifier: UK63573
2026-01-29 06:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a00412fb-0d8a-51ac-b4d7-7988e23c69fb with identifier: UK63573
2026-01-29 06:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit courier' containing 'courier'
2026-01-29 06:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: a00412fb-0d8a-51ac-b4d7-7988e23c69fb spider: auto1.fr
2026-01-29 06:02:59 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: a00412fb-0d8a-51ac-b4d7-7988e23c69fb due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit courier' containing 'courier'
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:23:23Z',
 'fuel_type': 'diesel',
 'id': 'a00412fb-0d8a-51ac-b4d7-7988e23c69fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK63573',
 'listing': 'auction',
 'location': 'FR',
 'make': 'Ford',
 'model': 'Transit Courier',
 'odometer': 196622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-09-07',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Ford Transit Courier 1.5 TDCi Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2021}
2026-01-29 06:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UK63573%27 HTTP/1.1" 200 None
2026-01-29 06:02:59 [auto1.fr] INFO: Saving data for UK63573: {'auction_closing_time': 1769703803.0, 'created_time': 1768844536.686581, 'last_price_update_time': 1769666579.504691}
2026-01-29 06:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UK63573') HTTP/1.1" 204 0
2026-01-29 06:02:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 73dfcff9-7d38-54e1-a9e1-e1d6903928bc with identifier: JE59614
2026-01-29 06:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 73dfcff9-7d38-54e1-a9e1-e1d6903928bc with identifier: JE59614
2026-01-29 06:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c4 grand picasso 1.2 e-thp feel', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c4 grand picasso', 'transmission': 'manual', 'odometer': 125097, 'odometer_reading_unit': 'km', 'registration_date': '2019-07-22', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/je59614', 'expiration_date': '2026-01-29t16:46:39z', 'origin_country_code': 'fr', 'trim': 'feel', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 7, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 114, 'id': '73dfcff9-7d38-54e1-a9e1-e1d6903928bc', 'current_year_diff': 7, 'age_in_months': 78, 'make_model': 'citroen c4 grand picasso', 'sanitized_make': 'citroen', 'odometer_in_km': 125097}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 78,
     'auction_title': '',
     'c_o_2_emission_value': 114,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:46:39z',
     'fuel_type': 'petrol',
     'id': '73dfcff9-7d38-54e1-a9e1-e1d6903928bc',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/je59614',
     'listing': 'auction',
     'location': 'fr',
     'make': 'citroen',
     'make_model': 'citroen c4 grand picasso',
     'model': 'c4 grand picasso',
     'odometer': 125097,
     'odometer_in_km': 125097,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-07-22',
     'sanitized_make': 'citroen',
     'seats_number': 7,
     'seller_name': None,
     'title': 'citroen c4 grand picasso 1.2 e-thp feel',
     'transmission': 'manual',
     'trim': 'feel',
     'year': 2019}
2026-01-29 06:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 73dfcff9-7d38-54e1-a9e1-e1d6903928bc spider: auto1.fr
2026-01-29 06:02:59 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 73dfcff9-7d38-54e1-a9e1-e1d6903928bc due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c4 grand picasso 1.2 e-thp feel', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c4 grand picasso', 'transmission': 'manual', 'odometer': 125097, 'odometer_reading_unit': 'km', 'registration_date': '2019-07-22', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/je59614', 'expiration_date': '2026-01-29t16:46:39z', 'origin_country_code': 'fr', 'trim': 'feel', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr', 'category': None, 'seats_number': 7, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 114, 'id': '73dfcff9-7d38-54e1-a9e1-e1d6903928bc', 'current_year_diff': 7, 'age_in_months': 78, 'make_model': 'citroen c4 grand picasso', 'sanitized_make': 'citroen', 'odometer_in_km': 125097}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 78,
     'auction_title': '',
     'c_o_2_emission_value': 114,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:46:39z',
     'fuel_type': 'petrol',
     'id': '73dfcff9-7d38-54e1-a9e1-e1d6903928bc',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/je59614',
     'listing': 'auction',
     'location': 'fr',
     'make': 'citroen',
     'make_model': 'citroen c4 grand picasso',
     'model': 'c4 grand picasso',
     'odometer': 125097,
     'odometer_in_km': 125097,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-07-22',
     'sanitized_make': 'citroen',
     'seats_number': 7,
     'seller_name': None,
     'title': 'citroen c4 grand picasso 1.2 e-thp feel',
     'transmission': 'manual',
     'trim': 'feel',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:46:39Z',
 'fuel_type': 'petrol',
 'id': '73dfcff9-7d38-54e1-a9e1-e1d6903928bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE59614',
 'listing': 'auction',
 'location': 'FR',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 125097,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-22',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.2 e-THP Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2019}
2026-01-29 06:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JE59614%27 HTTP/1.1" 200 None
2026-01-29 06:02:59 [auto1.fr] INFO: Saving data for JE59614: {'auction_closing_time': 1769705199.0, 'created_time': 1767116408.870353, 'last_price_update_time': 1769666579.76511}
2026-01-29 06:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JE59614') HTTP/1.1" 204 0
2026-01-29 06:02:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e1e18c46-0cc2-5850-ab52-79022a198285 with identifier: FJ44298
2026-01-29 06:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e1e18c46-0cc2-5850-ab52-79022a198285 with identifier: FJ44298
2026-01-29 06:02:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e1e18c46-0cc2-5850-ab52-79022a198285 with identifier: FJ44298 to the API
2026-01-29 06:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:02:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:03:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FJ44298>
{'auction_title': '',
 'c_o_2_emission_value': 62,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 320,
 'expiration_date': '2026-01-29T16:03:25Z',
 'fuel_type': 'hybrid',
 'id': 'e1e18c46-0cc2-5850-ab52-79022a198285',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ44298',
 'listing': 'auction',
 'location': 'Puget-sur-Argens',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 58630,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 300e 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2020}
2026-01-29 06:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ44298%27 HTTP/1.1" 200 None
2026-01-29 06:03:00 [auto1.fr] INFO: Saving data for FJ44298: {'auction_closing_time': 1769702605.0, 'created_time': 1769533793.674046, 'last_price_update_time': 1769666580.166056}
2026-01-29 06:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FJ44298') HTTP/1.1" 204 0
2026-01-29 06:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f446e073-a65c-523c-9786-9e73e1fe1c48 with identifier: CJ16783
2026-01-29 06:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f446e073-a65c-523c-9786-9e73e1fe1c48 with identifier: CJ16783
2026-01-29 06:03:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f446e073-a65c-523c-9786-9e73e1fe1c48 with identifier: CJ16783 to the API
2026-01-29 06:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:03:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:03:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CJ16783>
{'auction_title': '',
 'c_o_2_emission_value': 24,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 218,
 'expiration_date': '2026-01-29T16:46:55Z',
 'fuel_type': 'hybrid',
 'id': 'f446e073-a65c-523c-9786-9e73e1fe1c48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ16783',
 'listing': 'auction',
 'location': 'FR, Warluis',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 54609,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_0c026b3c251431fac32d76a72116c192.jpg',
                'https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_2b56e9a8efc1b44c366cb4d6db5fa9c3.jpg',
                'https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_efd5c158d209b3653f24cf8e3ab5b4c0.jpg',
                'https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_cb3768c9ec622a4ee533e3b26c6a5dc5.jpg',
                'https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_989e84a0f50fb8e99f719e98a4fdb806.jpg',
                'https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_d0f61dc544c57713440edbc70c0f26e1.jpg',
                'https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_8c44094d9b443ae62e51e667d1c03778.jpg',
                'https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_0eb1b88b196fb832612e240a04db20ac.jpg',
                'https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_8b5d90e82c122573dc335270e4485a2b.jpg',
                'https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_59a7c7b0f730414f0dbc6519dadb0561.jpg',
                'https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_142ef977dbffbe65a0b597dde483b675.jpg',
                'https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_d9e94e24bba8896519507578e8e19977.jpg',
                'https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_76997eeeaafcd6c27ce31817a2c69085.jpg',
                'https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_e5a229c0a9e7d4baab09f5f9e512f743.jpg',
                'https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_a792634e128215b1af0990cfbc734572.jpg',
                'https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_1578c125a23a7200275298705726067f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f446e073-a65c-523c-9786-9e73e1fe1c48/f446e073-a65c-523c-9786-9e73e1fe1c48_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_0c026b3c251431fac32d76a72116c192.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f446e073-a65c-523c-9786-9e73e1fe1c48/f446e073-a65c-523c-9786-9e73e1fe1c48_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_2b56e9a8efc1b44c366cb4d6db5fa9c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f446e073-a65c-523c-9786-9e73e1fe1c48/f446e073-a65c-523c-9786-9e73e1fe1c48_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75794,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_efd5c158d209b3653f24cf8e3ab5b4c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f446e073-a65c-523c-9786-9e73e1fe1c48/f446e073-a65c-523c-9786-9e73e1fe1c48_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_cb3768c9ec622a4ee533e3b26c6a5dc5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f446e073-a65c-523c-9786-9e73e1fe1c48/f446e073-a65c-523c-9786-9e73e1fe1c48_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_989e84a0f50fb8e99f719e98a4fdb806.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f446e073-a65c-523c-9786-9e73e1fe1c48/f446e073-a65c-523c-9786-9e73e1fe1c48_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71847,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_d0f61dc544c57713440edbc70c0f26e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f446e073-a65c-523c-9786-9e73e1fe1c48/f446e073-a65c-523c-9786-9e73e1fe1c48_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55014,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_8c44094d9b443ae62e51e667d1c03778.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f446e073-a65c-523c-9786-9e73e1fe1c48/f446e073-a65c-523c-9786-9e73e1fe1c48_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_0eb1b88b196fb832612e240a04db20ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f446e073-a65c-523c-9786-9e73e1fe1c48/f446e073-a65c-523c-9786-9e73e1fe1c48_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_8b5d90e82c122573dc335270e4485a2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f446e073-a65c-523c-9786-9e73e1fe1c48/f446e073-a65c-523c-9786-9e73e1fe1c48_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_59a7c7b0f730414f0dbc6519dadb0561.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f446e073-a65c-523c-9786-9e73e1fe1c48/f446e073-a65c-523c-9786-9e73e1fe1c48_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_142ef977dbffbe65a0b597dde483b675.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f446e073-a65c-523c-9786-9e73e1fe1c48/f446e073-a65c-523c-9786-9e73e1fe1c48_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65981,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_d9e94e24bba8896519507578e8e19977.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f446e073-a65c-523c-9786-9e73e1fe1c48/f446e073-a65c-523c-9786-9e73e1fe1c48_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_76997eeeaafcd6c27ce31817a2c69085.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f446e073-a65c-523c-9786-9e73e1fe1c48/f446e073-a65c-523c-9786-9e73e1fe1c48_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66064,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_e5a229c0a9e7d4baab09f5f9e512f743.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f446e073-a65c-523c-9786-9e73e1fe1c48/f446e073-a65c-523c-9786-9e73e1fe1c48_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_a792634e128215b1af0990cfbc734572.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f446e073-a65c-523c-9786-9e73e1fe1c48/f446e073-a65c-523c-9786-9e73e1fe1c48_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76224,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/fb/07fbaae6d38a104c95af1499a83d88e1/pa/CJ16783_1578c125a23a7200275298705726067f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 250e Edition 2020 AMG Line',
 'transmission': 'automatic',
 'trim': 'Edition 2020 AMG Line',
 'year': 2020}
2026-01-29 06:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CJ16783%27 HTTP/1.1" 200 None
2026-01-29 06:03:00 [auto1.fr] INFO: Saving data for CJ16783: {'created_time': 1769666580.496272, 'last_price_update_time': 1769666580.496282, 'auction_closing_time': 1769705215.0}
2026-01-29 06:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CJ16783') HTTP/1.1" 204 0
2026-01-29 06:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d4debfb4-0c79-50ef-afc1-b2070bcd9b22 with identifier: CC73759
2026-01-29 06:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:03:00 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-01-29 06:03:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d4debfb4-0c79-50ef-afc1-b2070bcd9b22 with identifier: CC73759
2026-01-29 06:03:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d4debfb4-0c79-50ef-afc1-b2070bcd9b22 with identifier: CC73759 to the API
2026-01-29 06:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:03:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:03:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CC73759>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:18:30Z',
 'fuel_type': 'diesel',
 'id': 'd4debfb4-0c79-50ef-afc1-b2070bcd9b22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC73759',
 'listing': 'auction',
 'location': 'Chambray-Lès-Tours',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 137922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 sDrive 18d M Sport X',
 'transmission': 'automatic',
 'trim': 'M Sport X',
 'year': 2019}
2026-01-29 06:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CC73759%27 HTTP/1.1" 200 None
2026-01-29 06:03:01 [auto1.fr] INFO: Saving data for CC73759: {'auction_closing_time': 1769703510.0, 'created_time': 1769534059.516905, 'last_price_update_time': 1769666581.012054}
2026-01-29 06:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CC73759') HTTP/1.1" 204 0
2026-01-29 06:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6fffa350>
2026-01-29 06:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b542ba20-2534-578d-8af4-2d58076300b4/b542ba20-2534-578d-8af4-2d58076300b4_image_15.jpg HTTP/1.1" 201 0
2026-01-29 06:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F10%252F961033bf702c435bcfdc3e7406463a6c%252Fpa%252FJB37332_558d4130a06f5e6dc64e0df4bcf5b1a9.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_558d4130a06f5e6dc64e0df4bcf5b1a9.jpg saved to cache
2026-01-29 06:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item b542ba20-2534-578d-8af4-2d58076300b4
2026-01-29 06:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_28d0b36b37ec044bdf4d6a2991654c18.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_bbb4291cf238c7d12e0819468f38f61a.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_6f2f0b6324b94a8dc41caad063169d0f.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_26169cec957f7c7fa672bfbcc9a7a0be.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_02354caa1bdbae611bd55ace18803a93.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_17ee87171b3cfcf4ed1c964e8d2d1042.png> (referer: https://www.auto1.com/)
2026-01-29 06:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F61%252Fe4616a24ff11f27f03fa189a8d18f728%252Fpa%252FUG35109_9413765f7f7e9fb94062f3dc957919c5.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_9413765f7f7e9fb94062f3dc957919c5.jpg not downloaded yet
2026-01-29 06:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fbe%252Fc3be27b6261d9847ba839edb8d43f377%252Fpa%252FZH57094_1214b6f3d0230c45f0e135ab1a16396f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_1214b6f3d0230c45f0e135ab1a16396f.jpg not downloaded yet
2026-01-29 06:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f5c2750>
2026-01-29 06:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_199ab5d0-e058-5bfe-9399-1fd641b24b93/199ab5d0-e058-5bfe-9399-1fd641b24b93_image_6.jpg HTTP/1.1" 201 0
2026-01-29 06:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F61%252Fe4616a24ff11f27f03fa189a8d18f728%252Fpa%252FUG35109_d38b9655bb1997579b30f09662a7fe3a.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_d38b9655bb1997579b30f09662a7fe3a.jpg saved to cache
2026-01-29 06:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 199ab5d0-e058-5bfe-9399-1fd641b24b93
2026-01-29 06:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f5c13d0>
2026-01-29 06:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e18464c1-d77a-53f8-9a02-6118617f85b1/e18464c1-d77a-53f8-9a02-6118617f85b1_image_10.jpg HTTP/1.1" 201 0
2026-01-29 06:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fa5%252F15a57247cf65a79bb5e2285eebb6c11b%252Fpa%252FHV11648_82befa91da219fa17884ea90c6d7d20b.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_82befa91da219fa17884ea90c6d7d20b.jpg saved to cache
2026-01-29 06:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e18464c1-d77a-53f8-9a02-6118617f85b1
2026-01-29 06:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c0c1410>
2026-01-29 06:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e18464c1-d77a-53f8-9a02-6118617f85b1/e18464c1-d77a-53f8-9a02-6118617f85b1_image_11.jpg HTTP/1.1" 201 0
2026-01-29 06:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fa5%252F15a57247cf65a79bb5e2285eebb6c11b%252Fpa%252FHV11648_587cec7dba88fd1bbb0268f3d2f07a10.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_587cec7dba88fd1bbb0268f3d2f07a10.jpg saved to cache
2026-01-29 06:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e18464c1-d77a-53f8-9a02-6118617f85b1
2026-01-29 06:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f4f0050>
2026-01-29 06:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a9df2b8-7c08-5966-be0f-591af074057e/4a9df2b8-7c08-5966-be0f-591af074057e_image_4.jpg HTTP/1.1" 201 0
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fbe%252Fc3be27b6261d9847ba839edb8d43f377%252Fpa%252FZH57094_eef9edbd296eae652ff3155d1d60f8bf.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_eef9edbd296eae652ff3155d1d60f8bf.jpg saved to cache
2026-01-29 06:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4a9df2b8-7c08-5966-be0f-591af074057e
2026-01-29 06:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff9a310>
2026-01-29 06:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_199ab5d0-e058-5bfe-9399-1fd641b24b93/199ab5d0-e058-5bfe-9399-1fd641b24b93_image_7.jpg HTTP/1.1" 201 0
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F61%252Fe4616a24ff11f27f03fa189a8d18f728%252Fpa%252FUG35109_1607d6fe0175582252b1c24e69b938f0.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_1607d6fe0175582252b1c24e69b938f0.jpg saved to cache
2026-01-29 06:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 199ab5d0-e058-5bfe-9399-1fd641b24b93
2026-01-29 06:03:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0811a5e2-ff31-5899-ab31-51ce836261e1 with identifier: FP06893
2026-01-29 06:03:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0811a5e2-ff31-5899-ab31-51ce836261e1 with scrape type 1
2026-01-29 06:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 0811a5e2-ff31-5899-ab31-51ce836261e1
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F18%252Fed18f6da3775b06188f97e98fdd6a7ad%252Fpa%252FFP06893_3db1d752660c208b0d061e0fad60a4ea.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_3db1d752660c208b0d061e0fad60a4ea.jpg already downloaded
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F18%252Fed18f6da3775b06188f97e98fdd6a7ad%252Fpa%252FFP06893_d2969d13a556cd33bcfdcd9ead8c5a5a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_d2969d13a556cd33bcfdcd9ead8c5a5a.jpg already downloaded
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F18%252Fed18f6da3775b06188f97e98fdd6a7ad%252Fpa%252FFP06893_516d69abbc1a99a07e93babe2c32123b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_516d69abbc1a99a07e93babe2c32123b.jpg already downloaded
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F18%252Fed18f6da3775b06188f97e98fdd6a7ad%252Fpa%252FFP06893_5f8cbeb85515066e946f1764ab2d19c5.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_5f8cbeb85515066e946f1764ab2d19c5.jpg already downloaded
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F18%252Fed18f6da3775b06188f97e98fdd6a7ad%252Fpa%252FFP06893_24a7e46f6877ced7473ea7ae27648957.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_24a7e46f6877ced7473ea7ae27648957.jpg already downloaded
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F18%252Fed18f6da3775b06188f97e98fdd6a7ad%252Fpa%252FFP06893_358d5abfaf49cd528087d21c82e6739a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_358d5abfaf49cd528087d21c82e6739a.jpg already downloaded
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F18%252Fed18f6da3775b06188f97e98fdd6a7ad%252Fpa%252FFP06893_5e8b32e7b69af37a74d904005ae11c5e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_5e8b32e7b69af37a74d904005ae11c5e.jpg already downloaded
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F18%252Fed18f6da3775b06188f97e98fdd6a7ad%252Fpa%252FFP06893_2fd1c653d7b4dddc9b5fcde758d4a147.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_2fd1c653d7b4dddc9b5fcde758d4a147.jpg already downloaded
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F18%252Fed18f6da3775b06188f97e98fdd6a7ad%252Fpa%252FFP06893_87b71dfc8cfbd8f5616b6f67d279ee4a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_87b71dfc8cfbd8f5616b6f67d279ee4a.jpg already downloaded
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F18%252Fed18f6da3775b06188f97e98fdd6a7ad%252Fpa%252FFP06893_0a1879a12e6cacc429dae1e8792cb64e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_0a1879a12e6cacc429dae1e8792cb64e.jpg already downloaded
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F18%252Fed18f6da3775b06188f97e98fdd6a7ad%252Fpa%252FFP06893_e34092f2d35f54f056b16b9e8082e6e7.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_e34092f2d35f54f056b16b9e8082e6e7.jpg already downloaded
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F18%252Fed18f6da3775b06188f97e98fdd6a7ad%252Fpa%252FFP06893_b376f2d61ed516308588120eb6c91bef.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_b376f2d61ed516308588120eb6c91bef.jpg already downloaded
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F18%252Fed18f6da3775b06188f97e98fdd6a7ad%252Fpa%252FFP06893_818c7c18a696d9c59882530a3ee1b59d.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_818c7c18a696d9c59882530a3ee1b59d.jpg already downloaded
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F18%252Fed18f6da3775b06188f97e98fdd6a7ad%252Fpa%252FFP06893_533abc3746d140365943ffb99e84ff92.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_533abc3746d140365943ffb99e84ff92.jpg already downloaded
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F18%252Fed18f6da3775b06188f97e98fdd6a7ad%252Fpa%252FFP06893_1ddcb86c02f3ac591ff57b88f8d4d15a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_1ddcb86c02f3ac591ff57b88f8d4d15a.jpg already downloaded
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F18%252Fed18f6da3775b06188f97e98fdd6a7ad%252Fpa%252FFP06893_e82ae550edbe1466d8e6d8d25fe0680a.png%27 HTTP/1.1" 200 None
2026-01-29 06:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_e82ae550edbe1466d8e6d8d25fe0680a.png already downloaded
2026-01-29 06:03:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0811a5e2-ff31-5899-ab31-51ce836261e1, identifier: FP06893
2026-01-29 06:03:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 550437ca-88f2-5acf-8f8c-ba5f86e5df5a with identifier: KL98727
2026-01-29 06:03:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 550437ca-88f2-5acf-8f8c-ba5f86e5df5a with scrape type 2
2026-01-29 06:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 550437ca-88f2-5acf-8f8c-ba5f86e5df5a with scrape type 2
2026-01-29 06:03:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 550437ca-88f2-5acf-8f8c-ba5f86e5df5a, identifier: KL98727
2026-01-29 06:03:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3639c24f-ca0b-53ce-9bd2-407816a36663 with identifier: LX40728
2026-01-29 06:03:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3639c24f-ca0b-53ce-9bd2-407816a36663 with scrape type 2
2026-01-29 06:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3639c24f-ca0b-53ce-9bd2-407816a36663 with scrape type 2
2026-01-29 06:03:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3639c24f-ca0b-53ce-9bd2-407816a36663, identifier: LX40728
2026-01-29 06:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_1433cd3befcff2ed30ae9bef6347ed1a.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_e818fec006d2492d77839df0c56fb530.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0811a5e2-ff31-5899-ab31-51ce836261e1 with identifier: FP06893
2026-01-29 06:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0811a5e2-ff31-5899-ab31-51ce836261e1 with identifier: FP06893
2026-01-29 06:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'automatic', 'odometer': 99745, 'odometer_reading_unit': 'km', 'registration_date': '2018-07-08', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fp06893', 'expiration_date': '2026-01-29t16:10:36z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_3db1d752660c208b0d061e0fad60a4ea.jpg', 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_d2969d13a556cd33bcfdcd9ead8c5a5a.jpg', 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_516d69abbc1a99a07e93babe2c32123b.jpg', 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_5f8cbeb85515066e946f1764ab2d19c5.jpg', 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_24a7e46f6877ced7473ea7ae27648957.jpg', 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_358d5abfaf49cd528087d21c82e6739a.jpg', 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_5e8b32e7b69af37a74d904005ae11c5e.jpg', 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_2fd1c653d7b4dddc9b5fcde758d4a147.jpg', 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_87b71dfc8cfbd8f5616b6f67d279ee4a.jpg', 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_0a1879a12e6cacc429dae1e8792cb64e.jpg', 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_e34092f2d35f54f056b16b9e8082e6e7.jpg', 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_b376f2d61ed516308588120eb6c91bef.jpg', 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_818c7c18a696d9c59882530a3ee1b59d.jpg', 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_533abc3746d140365943ffb99e84ff92.jpg', 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_1ddcb86c02f3ac591ff57b88f8d4d15a.jpg', 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_e82ae550edbe1466d8e6d8d25fe0680a.png'], 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 126, 'id': '0811a5e2-ff31-5899-ab31-51ce836261e1', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_3db1d752660c208b0d061e0fad60a4ea.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76312}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_d2969d13a556cd33bcfdcd9ead8c5a5a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 73494}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_516d69abbc1a99a07e93babe2c32123b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 64257}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_5f8cbeb85515066e946f1764ab2d19c5.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58966}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_24a7e46f6877ced7473ea7ae27648957.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57625}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_358d5abfaf49cd528087d21c82e6739a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 72575}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_5e8b32e7b69af37a74d904005ae11c5e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62023}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_2fd1c653d7b4dddc9b5fcde758d4a147.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 75896}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_87b71dfc8cfbd8f5616b6f67d279ee4a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 78807}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_0a1879a12e6cacc429dae1e8792cb64e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 51519}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_e34092f2d35f54f056b16b9e8082e6e7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 50690}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_b376f2d61ed516308588120eb6c91bef.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58857}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_818c7c18a696d9c59882530a3ee1b59d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 49296}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_533abc3746d140365943ffb99e84ff92.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 54497}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_1ddcb86c02f3ac591ff57b88f8d4d15a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 89232}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_e82ae550edbe1466d8e6d8d25fe0680a.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 74832}], 'current_year_diff': 8, 'age_in_months': 90, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 99745}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 90,
     'auction_title': '',
     'c_o_2_emission_value': 126,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:10:36z',
     'fuel_type': 'petrol',
     'id': '0811a5e2-ff31-5899-ab31-51ce836261e1',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fp06893',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'citroen',
     'make_model': 'citroen c3 aircross',
     'model': 'c3 aircross',
     'odometer': 99745,
     'odometer_in_km': 99745,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 16,
     'photo_urls': ['https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_3db1d752660c208b0d061e0fad60a4ea.jpg',
                    'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_d2969d13a556cd33bcfdcd9ead8c5a5a.jpg',
                    'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_516d69abbc1a99a07e93babe2c32123b.jpg',
                    'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_5f8cbeb85515066e946f1764ab2d19c5.jpg',
                    'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_24a7e46f6877ced7473ea7ae27648957.jpg',
                    'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_358d5abfaf49cd528087d21c82e6739a.jpg',
                    'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_5e8b32e7b69af37a74d904005ae11c5e.jpg',
                    'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_2fd1c653d7b4dddc9b5fcde758d4a147.jpg',
                    'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_87b71dfc8cfbd8f5616b6f67d279ee4a.jpg',
                    'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_0a1879a12e6cacc429dae1e8792cb64e.jpg',
                    'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_e34092f2d35f54f056b16b9e8082e6e7.jpg',
                    'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_b376f2d61ed516308588120eb6c91bef.jpg',
                    'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_818c7c18a696d9c59882530a3ee1b59d.jpg',
                    'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_533abc3746d140365943ffb99e84ff92.jpg',
                    'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_1ddcb86c02f3ac591ff57b88f8d4d15a.jpg',
                    'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_e82ae550edbe1466d8e6d8d25fe0680a.png'],
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 76312,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_3db1d752660c208b0d061e0fad60a4ea.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 73494,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_d2969d13a556cd33bcfdcd9ead8c5a5a.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 64257,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_516d69abbc1a99a07e93babe2c32123b.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 58966,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_5f8cbeb85515066e946f1764ab2d19c5.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57625,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_24a7e46f6877ced7473ea7ae27648957.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 72575,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_358d5abfaf49cd528087d21c82e6739a.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 62023,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_5e8b32e7b69af37a74d904005ae11c5e.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 75896,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_2fd1c653d7b4dddc9b5fcde758d4a147.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 78807,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_87b71dfc8cfbd8f5616b6f67d279ee4a.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51519,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_0a1879a12e6cacc429dae1e8792cb64e.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50690,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_e34092f2d35f54f056b16b9e8082e6e7.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 58857,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_b376f2d61ed516308588120eb6c91bef.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 49296,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_818c7c18a696d9c59882530a3ee1b59d.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 54497,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_533abc3746d140365943ffb99e84ff92.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 89232,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_1ddcb86c02f3ac591ff57b88f8d4d15a.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_15.png',
                 'Extension': 'png',
                 'FileSizeInBytes': 74832,
                 'Height': 525,
                 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_e82ae550edbe1466d8e6d8d25fe0680a.png',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-07-08',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 aircross 1.2 puretech shine',
     'transmission': 'automatic',
     'trim': 'shine',
     'year': 2018}
2026-01-29 06:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 0811a5e2-ff31-5899-ab31-51ce836261e1 spider: auto1.fr
2026-01-29 06:03:04 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 0811a5e2-ff31-5899-ab31-51ce836261e1 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'automatic', 'odometer': 99745, 'odometer_reading_unit': 'km', 'registration_date': '2018-07-08', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fp06893', 'expiration_date': '2026-01-29t16:10:36z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_3db1d752660c208b0d061e0fad60a4ea.jpg', 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_d2969d13a556cd33bcfdcd9ead8c5a5a.jpg', 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_516d69abbc1a99a07e93babe2c32123b.jpg', 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_5f8cbeb85515066e946f1764ab2d19c5.jpg', 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_24a7e46f6877ced7473ea7ae27648957.jpg', 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_358d5abfaf49cd528087d21c82e6739a.jpg', 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_5e8b32e7b69af37a74d904005ae11c5e.jpg', 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_2fd1c653d7b4dddc9b5fcde758d4a147.jpg', 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_87b71dfc8cfbd8f5616b6f67d279ee4a.jpg', 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_0a1879a12e6cacc429dae1e8792cb64e.jpg', 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_e34092f2d35f54f056b16b9e8082e6e7.jpg', 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_b376f2d61ed516308588120eb6c91bef.jpg', 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_818c7c18a696d9c59882530a3ee1b59d.jpg', 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_533abc3746d140365943ffb99e84ff92.jpg', 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_1ddcb86c02f3ac591ff57b88f8d4d15a.jpg', 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_e82ae550edbe1466d8e6d8d25fe0680a.png'], 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 126, 'id': '0811a5e2-ff31-5899-ab31-51ce836261e1', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_3db1d752660c208b0d061e0fad60a4ea.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76312}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_d2969d13a556cd33bcfdcd9ead8c5a5a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 73494}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_516d69abbc1a99a07e93babe2c32123b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 64257}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_5f8cbeb85515066e946f1764ab2d19c5.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58966}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_24a7e46f6877ced7473ea7ae27648957.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57625}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_358d5abfaf49cd528087d21c82e6739a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 72575}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_5e8b32e7b69af37a74d904005ae11c5e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62023}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_2fd1c653d7b4dddc9b5fcde758d4a147.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 75896}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_87b71dfc8cfbd8f5616b6f67d279ee4a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 78807}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_0a1879a12e6cacc429dae1e8792cb64e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 51519}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_e34092f2d35f54f056b16b9e8082e6e7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 50690}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_b376f2d61ed516308588120eb6c91bef.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 58857}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_818c7c18a696d9c59882530a3ee1b59d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 49296}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_533abc3746d140365943ffb99e84ff92.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 54497}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_1ddcb86c02f3ac591ff57b88f8d4d15a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 89232}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_e82ae550edbe1466d8e6d8d25fe0680a.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 74832}], 'current_year_diff': 8, 'age_in_months': 90, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 99745}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 90,
     'auction_title': '',
     'c_o_2_emission_value': 126,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:10:36z',
     'fuel_type': 'petrol',
     'id': '0811a5e2-ff31-5899-ab31-51ce836261e1',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fp06893',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'citroen',
     'make_model': 'citroen c3 aircross',
     'model': 'c3 aircross',
     'odometer': 99745,
     'odometer_in_km': 99745,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 16,
     'photo_urls': ['https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_3db1d752660c208b0d061e0fad60a4ea.jpg',
                    'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_d2969d13a556cd33bcfdcd9ead8c5a5a.jpg',
                    'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_516d69abbc1a99a07e93babe2c32123b.jpg',
                    'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_5f8cbeb85515066e946f1764ab2d19c5.jpg',
                    'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_24a7e46f6877ced7473ea7ae27648957.jpg',
                    'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_358d5abfaf49cd528087d21c82e6739a.jpg',
                    'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_5e8b32e7b69af37a74d904005ae11c5e.jpg',
                    'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_2fd1c653d7b4dddc9b5fcde758d4a147.jpg',
                    'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_87b71dfc8cfbd8f5616b6f67d279ee4a.jpg',
                    'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_0a1879a12e6cacc429dae1e8792cb64e.jpg',
                    'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_e34092f2d35f54f056b16b9e8082e6e7.jpg',
                    'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_b376f2d61ed516308588120eb6c91bef.jpg',
                    'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_818c7c18a696d9c59882530a3ee1b59d.jpg',
                    'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_533abc3746d140365943ffb99e84ff92.jpg',
                    'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_1ddcb86c02f3ac591ff57b88f8d4d15a.jpg',
                    'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_e82ae550edbe1466d8e6d8d25fe0680a.png'],
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 76312,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_3db1d752660c208b0d061e0fad60a4ea.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 73494,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_d2969d13a556cd33bcfdcd9ead8c5a5a.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 64257,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_516d69abbc1a99a07e93babe2c32123b.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 58966,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_5f8cbeb85515066e946f1764ab2d19c5.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57625,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_24a7e46f6877ced7473ea7ae27648957.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 72575,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_358d5abfaf49cd528087d21c82e6739a.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 62023,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_5e8b32e7b69af37a74d904005ae11c5e.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 75896,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_2fd1c653d7b4dddc9b5fcde758d4a147.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 78807,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_87b71dfc8cfbd8f5616b6f67d279ee4a.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51519,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_0a1879a12e6cacc429dae1e8792cb64e.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50690,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_e34092f2d35f54f056b16b9e8082e6e7.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 58857,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_b376f2d61ed516308588120eb6c91bef.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 49296,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_818c7c18a696d9c59882530a3ee1b59d.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 54497,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_533abc3746d140365943ffb99e84ff92.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 89232,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_1ddcb86c02f3ac591ff57b88f8d4d15a.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_15.png',
                 'Extension': 'png',
                 'FileSizeInBytes': 74832,
                 'Height': 525,
                 'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_e82ae550edbe1466d8e6d8d25fe0680a.png',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-07-08',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 aircross 1.2 puretech shine',
     'transmission': 'automatic',
     'trim': 'shine',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:10:36Z',
 'fuel_type': 'petrol',
 'id': '0811a5e2-ff31-5899-ab31-51ce836261e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP06893',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 99745,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_3db1d752660c208b0d061e0fad60a4ea.jpg',
                'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_d2969d13a556cd33bcfdcd9ead8c5a5a.jpg',
                'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_516d69abbc1a99a07e93babe2c32123b.jpg',
                'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_5f8cbeb85515066e946f1764ab2d19c5.jpg',
                'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_24a7e46f6877ced7473ea7ae27648957.jpg',
                'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_358d5abfaf49cd528087d21c82e6739a.jpg',
                'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_5e8b32e7b69af37a74d904005ae11c5e.jpg',
                'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_2fd1c653d7b4dddc9b5fcde758d4a147.jpg',
                'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_87b71dfc8cfbd8f5616b6f67d279ee4a.jpg',
                'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_0a1879a12e6cacc429dae1e8792cb64e.jpg',
                'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_e34092f2d35f54f056b16b9e8082e6e7.jpg',
                'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_b376f2d61ed516308588120eb6c91bef.jpg',
                'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_818c7c18a696d9c59882530a3ee1b59d.jpg',
                'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_533abc3746d140365943ffb99e84ff92.jpg',
                'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_1ddcb86c02f3ac591ff57b88f8d4d15a.jpg',
                'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_e82ae550edbe1466d8e6d8d25fe0680a.png'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_3db1d752660c208b0d061e0fad60a4ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73494,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_d2969d13a556cd33bcfdcd9ead8c5a5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_516d69abbc1a99a07e93babe2c32123b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_5f8cbeb85515066e946f1764ab2d19c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_24a7e46f6877ced7473ea7ae27648957.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_358d5abfaf49cd528087d21c82e6739a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_5e8b32e7b69af37a74d904005ae11c5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75896,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_2fd1c653d7b4dddc9b5fcde758d4a147.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_87b71dfc8cfbd8f5616b6f67d279ee4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_0a1879a12e6cacc429dae1e8792cb64e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_e34092f2d35f54f056b16b9e8082e6e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_b376f2d61ed516308588120eb6c91bef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_818c7c18a696d9c59882530a3ee1b59d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_533abc3746d140365943ffb99e84ff92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89232,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_1ddcb86c02f3ac591ff57b88f8d4d15a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0811a5e2-ff31-5899-ab31-51ce836261e1/0811a5e2-ff31-5899-ab31-51ce836261e1_image_15.png',
             'Extension': 'png',
             'FileSizeInBytes': 74832,
             'Height': 525,
             'OriginUrl': 'https://img-pa.auto1.com/imged/18/ed18f6da3775b06188f97e98fdd6a7ad/pa/FP06893_e82ae550edbe1466d8e6d8d25fe0680a.png',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2018}
2026-01-29 06:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP06893%27 HTTP/1.1" 200 None
2026-01-29 06:03:04 [auto1.fr] INFO: Saving data for FP06893: {'created_time': 1769666584.488195, 'last_price_update_time': 1769666584.488208, 'auction_closing_time': 1769703036.0}
2026-01-29 06:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FP06893') HTTP/1.1" 204 0
2026-01-29 06:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 550437ca-88f2-5acf-8f8c-ba5f86e5df5a with identifier: KL98727
2026-01-29 06:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 550437ca-88f2-5acf-8f8c-ba5f86e5df5a with identifier: KL98727
2026-01-29 06:03:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 550437ca-88f2-5acf-8f8c-ba5f86e5df5a with identifier: KL98727 to the API
2026-01-29 06:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:03:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:03:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KL98727>
{'auction_title': '',
 'c_o_2_emission_value': 63,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 381,
 'expiration_date': '2026-01-29T16:33:06Z',
 'fuel_type': 'hybrid',
 'id': '550437ca-88f2-5acf-8f8c-ba5f86e5df5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL98727',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 70183,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 eHybrid Elegance 4Motion',
 'transmission': 'automatic',
 'trim': 'Elegance 4Motion',
 'year': 2021}
2026-01-29 06:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KL98727%27 HTTP/1.1" 200 None
2026-01-29 06:03:04 [auto1.fr] INFO: Saving data for KL98727: {'auction_closing_time': 1769704386.0, 'created_time': 1769533756.355096, 'last_price_update_time': 1769666584.918833}
2026-01-29 06:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KL98727') HTTP/1.1" 204 0
2026-01-29 06:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3639c24f-ca0b-53ce-9bd2-407816a36663 with identifier: LX40728
2026-01-29 06:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3639c24f-ca0b-53ce-9bd2-407816a36663 with identifier: LX40728
2026-01-29 06:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 196798 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    196798
2026-01-29 06:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3639c24f-ca0b-53ce-9bd2-407816a36663 spider: auto1.fr
2026-01-29 06:03:05 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 3639c24f-ca0b-53ce-9bd2-407816a36663 due to rule: high_mileage_for_country.json, error: 196798 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    196798
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.7L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:04:08Z',
 'fuel_type': 'diesel',
 'id': '3639c24f-ca0b-53ce-9bd2-407816a36663',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX40728',
 'listing': 'auction',
 'location': 'FR',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 196798,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Scenic 1.7 Blue dCi Business Edition',
 'transmission': 'automatic',
 'trim': 'Business Edition',
 'year': 2021}
2026-01-29 06:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LX40728%27 HTTP/1.1" 200 None
2026-01-29 06:03:05 [auto1.fr] INFO: Saving data for LX40728: {'auction_closing_time': 1769702648.0, 'created_time': 1769016898.69622, 'last_price_update_time': 1769666585.240283}
2026-01-29 06:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LX40728') HTTP/1.1" 204 0
2026-01-29 06:03:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_2ccc1bfea05db2281b0871e4d6972d7f.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_a804e0ff59e6c3518dca08ac37d72cba.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_6017784d52fc83f1ff1a2dcb88e1cadf.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F61%252Fe4616a24ff11f27f03fa189a8d18f728%252Fpa%252FUG35109_0931e59fd3dfc3625a9fa4f58f0c374a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_0931e59fd3dfc3625a9fa4f58f0c374a.jpg not downloaded yet
2026-01-29 06:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fbe%252Fc3be27b6261d9847ba839edb8d43f377%252Fpa%252FZH57094_302a39b21668cd859583815fc7ed096e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_302a39b21668cd859583815fc7ed096e.jpg not downloaded yet
2026-01-29 06:03:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_51d41e595fc576da125bc108d152dca0.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f4b6e90>
2026-01-29 06:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04a5249f-ab6b-5856-8c3d-0a4021da83e9/04a5249f-ab6b-5856-8c3d-0a4021da83e9_image_14.jpg HTTP/1.1" 201 0
2026-01-29 06:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F34%252F52341f51be77abfc5b004cbb5a7bd1ff%252Fpa%252FUY38099_28d0b36b37ec044bdf4d6a2991654c18.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_28d0b36b37ec044bdf4d6a2991654c18.jpg saved to cache
2026-01-29 06:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 04a5249f-ab6b-5856-8c3d-0a4021da83e9
2026-01-29 06:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c060250>
2026-01-29 06:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-29 06:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e18464c1-d77a-53f8-9a02-6118617f85b1/e18464c1-d77a-53f8-9a02-6118617f85b1_image_12.jpg HTTP/1.1" 201 0
2026-01-29 06:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fa5%252F15a57247cf65a79bb5e2285eebb6c11b%252Fpa%252FHV11648_bbb4291cf238c7d12e0819468f38f61a.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_bbb4291cf238c7d12e0819468f38f61a.jpg saved to cache
2026-01-29 06:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item e18464c1-d77a-53f8-9a02-6118617f85b1
2026-01-29 06:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f430310>
2026-01-29 06:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a9df2b8-7c08-5966-be0f-591af074057e/4a9df2b8-7c08-5966-be0f-591af074057e_image_5.jpg HTTP/1.1" 201 0
2026-01-29 06:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fbe%252Fc3be27b6261d9847ba839edb8d43f377%252Fpa%252FZH57094_6f2f0b6324b94a8dc41caad063169d0f.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_6f2f0b6324b94a8dc41caad063169d0f.jpg saved to cache
2026-01-29 06:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4a9df2b8-7c08-5966-be0f-591af074057e
2026-01-29 06:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f530810>
2026-01-29 06:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_199ab5d0-e058-5bfe-9399-1fd641b24b93/199ab5d0-e058-5bfe-9399-1fd641b24b93_image_8.jpg HTTP/1.1" 201 0
2026-01-29 06:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F61%252Fe4616a24ff11f27f03fa189a8d18f728%252Fpa%252FUG35109_26169cec957f7c7fa672bfbcc9a7a0be.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_26169cec957f7c7fa672bfbcc9a7a0be.jpg saved to cache
2026-01-29 06:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 199ab5d0-e058-5bfe-9399-1fd641b24b93
2026-01-29 06:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f4312d0>
2026-01-29 06:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04a5249f-ab6b-5856-8c3d-0a4021da83e9/04a5249f-ab6b-5856-8c3d-0a4021da83e9_image_13.jpg HTTP/1.1" 201 0
2026-01-29 06:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F34%252F52341f51be77abfc5b004cbb5a7bd1ff%252Fpa%252FUY38099_02354caa1bdbae611bd55ace18803a93.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_02354caa1bdbae611bd55ace18803a93.jpg saved to cache
2026-01-29 06:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 04a5249f-ab6b-5856-8c3d-0a4021da83e9
2026-01-29 06:03:07 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-01-29 06:03:07 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2026-01-29 06:03:07 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2026-01-29 06:03:07 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2026-01-29 06:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f38c8d0>
2026-01-29 06:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04a5249f-ab6b-5856-8c3d-0a4021da83e9/04a5249f-ab6b-5856-8c3d-0a4021da83e9_image_15.png HTTP/1.1" 201 0
2026-01-29 06:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F34%252F52341f51be77abfc5b004cbb5a7bd1ff%252Fpa%252FUY38099_17ee87171b3cfcf4ed1c964e8d2d1042.png') HTTP/1.1" 204 0
2026-01-29 06:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_17ee87171b3cfcf4ed1c964e8d2d1042.png saved to cache
2026-01-29 06:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 04a5249f-ab6b-5856-8c3d-0a4021da83e9
2026-01-29 06:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_13623e9006466f3c599c8254b2acbe75.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_2d19ed05ab5847227db68db8db2a447b.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_8f598525dbbafb26415507405fb7bf56.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F61%252Fe4616a24ff11f27f03fa189a8d18f728%252Fpa%252FUG35109_457a380c444bc719b5a824aa7796ed92.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_457a380c444bc719b5a824aa7796ed92.jpg not downloaded yet
2026-01-29 06:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fbe%252Fc3be27b6261d9847ba839edb8d43f377%252Fpa%252FZH57094_03575f3dd991a4a895cfd14609ecb428.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_03575f3dd991a4a895cfd14609ecb428.jpg not downloaded yet
2026-01-29 06:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_e9f7ab1cf163c7608202e42ae0c8decb.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_99b40d36b7fa63529ec649f6a43e754a.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f523d90>
2026-01-29 06:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b542ba20-2534-578d-8af4-2d58076300b4/b542ba20-2534-578d-8af4-2d58076300b4_image_14.jpg HTTP/1.1" 201 0
2026-01-29 06:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F10%252F961033bf702c435bcfdc3e7406463a6c%252Fpa%252FJB37332_1433cd3befcff2ed30ae9bef6347ed1a.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_1433cd3befcff2ed30ae9bef6347ed1a.jpg saved to cache
2026-01-29 06:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item b542ba20-2534-578d-8af4-2d58076300b4
2026-01-29 06:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c166590>
2026-01-29 06:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_199ab5d0-e058-5bfe-9399-1fd641b24b93/199ab5d0-e058-5bfe-9399-1fd641b24b93_image_5.jpg HTTP/1.1" 201 0
2026-01-29 06:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F61%252Fe4616a24ff11f27f03fa189a8d18f728%252Fpa%252FUG35109_e818fec006d2492d77839df0c56fb530.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_e818fec006d2492d77839df0c56fb530.jpg saved to cache
2026-01-29 06:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 199ab5d0-e058-5bfe-9399-1fd641b24b93
2026-01-29 06:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c167710>
2026-01-29 06:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a9df2b8-7c08-5966-be0f-591af074057e/4a9df2b8-7c08-5966-be0f-591af074057e_image_6.jpg HTTP/1.1" 201 0
2026-01-29 06:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fbe%252Fc3be27b6261d9847ba839edb8d43f377%252Fpa%252FZH57094_2ccc1bfea05db2281b0871e4d6972d7f.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_2ccc1bfea05db2281b0871e4d6972d7f.jpg saved to cache
2026-01-29 06:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4a9df2b8-7c08-5966-be0f-591af074057e
2026-01-29 06:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c27cad0>
2026-01-29 06:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-29 06:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04a5249f-ab6b-5856-8c3d-0a4021da83e9/04a5249f-ab6b-5856-8c3d-0a4021da83e9_image_12.jpg HTTP/1.1" 201 0
2026-01-29 06:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F34%252F52341f51be77abfc5b004cbb5a7bd1ff%252Fpa%252FUY38099_a804e0ff59e6c3518dca08ac37d72cba.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_a804e0ff59e6c3518dca08ac37d72cba.jpg saved to cache
2026-01-29 06:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 04a5249f-ab6b-5856-8c3d-0a4021da83e9
2026-01-29 06:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff5b5d0>
2026-01-29 06:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_199ab5d0-e058-5bfe-9399-1fd641b24b93/199ab5d0-e058-5bfe-9399-1fd641b24b93_image_9.jpg HTTP/1.1" 201 0
2026-01-29 06:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F61%252Fe4616a24ff11f27f03fa189a8d18f728%252Fpa%252FUG35109_6017784d52fc83f1ff1a2dcb88e1cadf.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_6017784d52fc83f1ff1a2dcb88e1cadf.jpg saved to cache
2026-01-29 06:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 199ab5d0-e058-5bfe-9399-1fd641b24b93
2026-01-29 06:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_b096055bb322c4f29beb1243f42d7427.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_9b100bc0b1f69cd6b8ad31d96a18a1be.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F61%252Fe4616a24ff11f27f03fa189a8d18f728%252Fpa%252FUG35109_9e6a242b40bc1a6d0da2a01a6860275f.png%27 HTTP/1.1" 200 None
2026-01-29 06:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_9e6a242b40bc1a6d0da2a01a6860275f.png not downloaded yet
2026-01-29 06:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fbe%252Fc3be27b6261d9847ba839edb8d43f377%252Fpa%252FZH57094_80c58851c8022fd47b7d5ab7cfc21bd7.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_80c58851c8022fd47b7d5ab7cfc21bd7.jpg not downloaded yet
2026-01-29 06:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_6f4235205989b01362c8773d0f0c8065.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fbe%252Fc3be27b6261d9847ba839edb8d43f377%252Fpa%252FZH57094_f3d7a96b4604b6c2131763c58668909e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_f3d7a96b4604b6c2131763c58668909e.jpg not downloaded yet
2026-01-29 06:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f5a2d90>
2026-01-29 06:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e18464c1-d77a-53f8-9a02-6118617f85b1/e18464c1-d77a-53f8-9a02-6118617f85b1_image_13.jpg HTTP/1.1" 201 0
2026-01-29 06:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fa5%252F15a57247cf65a79bb5e2285eebb6c11b%252Fpa%252FHV11648_51d41e595fc576da125bc108d152dca0.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_51d41e595fc576da125bc108d152dca0.jpg saved to cache
2026-01-29 06:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item e18464c1-d77a-53f8-9a02-6118617f85b1
2026-01-29 06:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ffd2a90>
2026-01-29 06:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_199ab5d0-e058-5bfe-9399-1fd641b24b93/199ab5d0-e058-5bfe-9399-1fd641b24b93_image_10.jpg HTTP/1.1" 201 0
2026-01-29 06:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F61%252Fe4616a24ff11f27f03fa189a8d18f728%252Fpa%252FUG35109_13623e9006466f3c599c8254b2acbe75.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_13623e9006466f3c599c8254b2acbe75.jpg saved to cache
2026-01-29 06:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 199ab5d0-e058-5bfe-9399-1fd641b24b93
2026-01-29 06:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f3b3fd0>
2026-01-29 06:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a9df2b8-7c08-5966-be0f-591af074057e/4a9df2b8-7c08-5966-be0f-591af074057e_image_7.jpg HTTP/1.1" 201 0
2026-01-29 06:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fbe%252Fc3be27b6261d9847ba839edb8d43f377%252Fpa%252FZH57094_2d19ed05ab5847227db68db8db2a447b.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_2d19ed05ab5847227db68db8db2a447b.jpg saved to cache
2026-01-29 06:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4a9df2b8-7c08-5966-be0f-591af074057e
2026-01-29 06:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f5d2810>
2026-01-29 06:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b542ba20-2534-578d-8af4-2d58076300b4/b542ba20-2534-578d-8af4-2d58076300b4_image_12.jpg HTTP/1.1" 201 0
2026-01-29 06:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F10%252F961033bf702c435bcfdc3e7406463a6c%252Fpa%252FJB37332_8f598525dbbafb26415507405fb7bf56.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_8f598525dbbafb26415507405fb7bf56.jpg saved to cache
2026-01-29 06:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item b542ba20-2534-578d-8af4-2d58076300b4
2026-01-29 06:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c041d50>
2026-01-29 06:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04a5249f-ab6b-5856-8c3d-0a4021da83e9/04a5249f-ab6b-5856-8c3d-0a4021da83e9_image_10.jpg HTTP/1.1" 201 0
2026-01-29 06:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F34%252F52341f51be77abfc5b004cbb5a7bd1ff%252Fpa%252FUY38099_e9f7ab1cf163c7608202e42ae0c8decb.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_e9f7ab1cf163c7608202e42ae0c8decb.jpg saved to cache
2026-01-29 06:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 04a5249f-ab6b-5856-8c3d-0a4021da83e9
2026-01-29 06:03:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 04a5249f-ab6b-5856-8c3d-0a4021da83e9, skipping ID generation
2026-01-29 06:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04a5249f-ab6b-5856-8c3d-0a4021da83e9 with scrape type 1
2026-01-29 06:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 04a5249f-ab6b-5856-8c3d-0a4021da83e9 from tracking dictionaries
2026-01-29 06:03:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 04a5249f-ab6b-5856-8c3d-0a4021da83e9 sending to next pipeline
2026-01-29 06:03:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 04a5249f-ab6b-5856-8c3d-0a4021da83e9, identifier: UY38099
2026-01-29 06:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7e0c5710>
2026-01-29 06:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a9df2b8-7c08-5966-be0f-591af074057e/4a9df2b8-7c08-5966-be0f-591af074057e_image_0.jpg HTTP/1.1" 201 0
2026-01-29 06:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fbe%252Fc3be27b6261d9847ba839edb8d43f377%252Fpa%252FZH57094_99b40d36b7fa63529ec649f6a43e754a.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_99b40d36b7fa63529ec649f6a43e754a.jpg saved to cache
2026-01-29 06:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4a9df2b8-7c08-5966-be0f-591af074057e
2026-01-29 06:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_909429b3863532062ecf8297c350b0b0.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_1214b6f3d0230c45f0e135ab1a16396f.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_65f99f760430fbe070996c928f5ae93b.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 04a5249f-ab6b-5856-8c3d-0a4021da83e9 with identifier: UY38099
2026-01-29 06:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 04a5249f-ab6b-5856-8c3d-0a4021da83e9 with identifier: UY38099
2026-01-29 06:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 167280 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    167280
2026-01-29 06:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 04a5249f-ab6b-5856-8c3d-0a4021da83e9 spider: auto1.fr
2026-01-29 06:03:11 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 04a5249f-ab6b-5856-8c3d-0a4021da83e9 due to rule: high_mileage_for_country.json, error: 167280 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    167280
{'auction_title': '',
 'c_o_2_emission_value': 87,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'engine_horse_power': 122,
 'expiration_date': '2026-01-29T16:18:35Z',
 'fuel_type': 'hybrid',
 'id': '04a5249f-ab6b-5856-8c3d-0a4021da83e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY38099',
 'listing': 'auction',
 'location': 'FR, Sarreguemines',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 167280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04a5249f-ab6b-5856-8c3d-0a4021da83e9/04a5249f-ab6b-5856-8c3d-0a4021da83e9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_b1c99798f4cecc8be07770e48573f10b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04a5249f-ab6b-5856-8c3d-0a4021da83e9/04a5249f-ab6b-5856-8c3d-0a4021da83e9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_5c08063f537d0751d10f4516eeb89aff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04a5249f-ab6b-5856-8c3d-0a4021da83e9/04a5249f-ab6b-5856-8c3d-0a4021da83e9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_7f564678351978b35652b185f63f7c25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04a5249f-ab6b-5856-8c3d-0a4021da83e9/04a5249f-ab6b-5856-8c3d-0a4021da83e9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_06d993a03986aede0a4d68c3a7c6b979.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04a5249f-ab6b-5856-8c3d-0a4021da83e9/04a5249f-ab6b-5856-8c3d-0a4021da83e9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_91737b601d4c83bf4b63b50285ea191e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04a5249f-ab6b-5856-8c3d-0a4021da83e9/04a5249f-ab6b-5856-8c3d-0a4021da83e9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_70983fd913855fce2be17edd34374ad0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04a5249f-ab6b-5856-8c3d-0a4021da83e9/04a5249f-ab6b-5856-8c3d-0a4021da83e9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_eceb2e4d31b478c524859a1ac2882d61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04a5249f-ab6b-5856-8c3d-0a4021da83e9/04a5249f-ab6b-5856-8c3d-0a4021da83e9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78916,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_905de21de2df34aec5f40a86ca5ee91e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04a5249f-ab6b-5856-8c3d-0a4021da83e9/04a5249f-ab6b-5856-8c3d-0a4021da83e9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71221,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_5e44b955e6c81e6f072195e6b6e02c6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04a5249f-ab6b-5856-8c3d-0a4021da83e9/04a5249f-ab6b-5856-8c3d-0a4021da83e9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_fdedd5daecae76229513c1d4fd5ee059.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04a5249f-ab6b-5856-8c3d-0a4021da83e9/04a5249f-ab6b-5856-8c3d-0a4021da83e9_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_e9f7ab1cf163c7608202e42ae0c8decb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04a5249f-ab6b-5856-8c3d-0a4021da83e9/04a5249f-ab6b-5856-8c3d-0a4021da83e9_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39400,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_171d120fdbd419c7a9fdefef45cecec7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04a5249f-ab6b-5856-8c3d-0a4021da83e9/04a5249f-ab6b-5856-8c3d-0a4021da83e9_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_a804e0ff59e6c3518dca08ac37d72cba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04a5249f-ab6b-5856-8c3d-0a4021da83e9/04a5249f-ab6b-5856-8c3d-0a4021da83e9_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26220,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_02354caa1bdbae611bd55ace18803a93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04a5249f-ab6b-5856-8c3d-0a4021da83e9/04a5249f-ab6b-5856-8c3d-0a4021da83e9_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49765,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_28d0b36b37ec044bdf4d6a2991654c18.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04a5249f-ab6b-5856-8c3d-0a4021da83e9/04a5249f-ab6b-5856-8c3d-0a4021da83e9_image_15.png',
             'Extension': 'png',
             'FileSizeInBytes': 124962,
             'Height': 525,
             'OriginUrl': 'https://img-pa.auto1.com/img52/34/52341f51be77abfc5b004cbb5a7bd1ff/pa/UY38099_17ee87171b3cfcf4ed1c964e8d2d1042.png',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota C-HR 1.8 Hybrid Team D',
 'transmission': 'automatic',
 'trim': 'Team D',
 'year': 2018}
2026-01-29 06:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY38099%27 HTTP/1.1" 200 None
2026-01-29 06:03:11 [auto1.fr] INFO: Saving data for UY38099: {'created_time': 1769666591.753576, 'last_price_update_time': 1769666591.753587, 'auction_closing_time': 1769703515.0}
2026-01-29 06:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UY38099') HTTP/1.1" 204 0
2026-01-29 06:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_9413765f7f7e9fb94062f3dc957919c5.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_302a39b21668cd859583815fc7ed096e.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_0931e59fd3dfc3625a9fa4f58f0c374a.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_9f7ea191c39ce73bf483edeb6a84affa.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fbe%252Fc3be27b6261d9847ba839edb8d43f377%252Fpa%252FZH57094_6f55f71df996521957d4975850a03f60.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_6f55f71df996521957d4975850a03f60.jpg not downloaded yet
2026-01-29 06:03:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_5f5a4898992a6f405da9fd190565ebc2.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fbe%252Fc3be27b6261d9847ba839edb8d43f377%252Fpa%252FZH57094_03a7072a874f263fabb4b92a59282d39.png%27 HTTP/1.1" 200 None
2026-01-29 06:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_03a7072a874f263fabb4b92a59282d39.png not downloaded yet
2026-01-29 06:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f54e490>
2026-01-29 06:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e18464c1-d77a-53f8-9a02-6118617f85b1/e18464c1-d77a-53f8-9a02-6118617f85b1_image_14.jpg HTTP/1.1" 201 0
2026-01-29 06:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fa5%252F15a57247cf65a79bb5e2285eebb6c11b%252Fpa%252FHV11648_b096055bb322c4f29beb1243f42d7427.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_b096055bb322c4f29beb1243f42d7427.jpg saved to cache
2026-01-29 06:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item e18464c1-d77a-53f8-9a02-6118617f85b1
2026-01-29 06:03:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e18464c1-d77a-53f8-9a02-6118617f85b1, skipping ID generation
2026-01-29 06:03:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e18464c1-d77a-53f8-9a02-6118617f85b1 with scrape type 1
2026-01-29 06:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e18464c1-d77a-53f8-9a02-6118617f85b1 from tracking dictionaries
2026-01-29 06:03:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e18464c1-d77a-53f8-9a02-6118617f85b1 sending to next pipeline
2026-01-29 06:03:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e18464c1-d77a-53f8-9a02-6118617f85b1, identifier: HV11648
2026-01-29 06:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6fe62350>
2026-01-29 06:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_199ab5d0-e058-5bfe-9399-1fd641b24b93/199ab5d0-e058-5bfe-9399-1fd641b24b93_image_3.jpg HTTP/1.1" 201 0
2026-01-29 06:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F61%252Fe4616a24ff11f27f03fa189a8d18f728%252Fpa%252FUG35109_9b100bc0b1f69cd6b8ad31d96a18a1be.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_9b100bc0b1f69cd6b8ad31d96a18a1be.jpg saved to cache
2026-01-29 06:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 199ab5d0-e058-5bfe-9399-1fd641b24b93
2026-01-29 06:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f58ae50>
2026-01-29 06:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b542ba20-2534-578d-8af4-2d58076300b4/b542ba20-2534-578d-8af4-2d58076300b4_image_1.jpg HTTP/1.1" 201 0
2026-01-29 06:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F10%252F961033bf702c435bcfdc3e7406463a6c%252Fpa%252FJB37332_6f4235205989b01362c8773d0f0c8065.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_6f4235205989b01362c8773d0f0c8065.jpg saved to cache
2026-01-29 06:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b542ba20-2534-578d-8af4-2d58076300b4
2026-01-29 06:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c2bc750>
2026-01-29 06:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-29 06:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_199ab5d0-e058-5bfe-9399-1fd641b24b93/199ab5d0-e058-5bfe-9399-1fd641b24b93_image_11.jpg HTTP/1.1" 201 0
2026-01-29 06:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F61%252Fe4616a24ff11f27f03fa189a8d18f728%252Fpa%252FUG35109_909429b3863532062ecf8297c350b0b0.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_909429b3863532062ecf8297c350b0b0.jpg saved to cache
2026-01-29 06:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 199ab5d0-e058-5bfe-9399-1fd641b24b93
2026-01-29 06:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f5c0150>
2026-01-29 06:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a9df2b8-7c08-5966-be0f-591af074057e/4a9df2b8-7c08-5966-be0f-591af074057e_image_9.jpg HTTP/1.1" 201 0
2026-01-29 06:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fbe%252Fc3be27b6261d9847ba839edb8d43f377%252Fpa%252FZH57094_1214b6f3d0230c45f0e135ab1a16396f.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_1214b6f3d0230c45f0e135ab1a16396f.jpg saved to cache
2026-01-29 06:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4a9df2b8-7c08-5966-be0f-591af074057e
2026-01-29 06:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff6d0d0>
2026-01-29 06:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a9df2b8-7c08-5966-be0f-591af074057e/4a9df2b8-7c08-5966-be0f-591af074057e_image_8.jpg HTTP/1.1" 201 0
2026-01-29 06:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fbe%252Fc3be27b6261d9847ba839edb8d43f377%252Fpa%252FZH57094_65f99f760430fbe070996c928f5ae93b.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_65f99f760430fbe070996c928f5ae93b.jpg saved to cache
2026-01-29 06:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4a9df2b8-7c08-5966-be0f-591af074057e
2026-01-29 06:03:13 [scrapy.extensions.logstats] INFO: Crawled 173 pages (at 73 pages/min), scraped 38 items (at 21 items/min)
2026-01-29 06:03:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e18464c1-d77a-53f8-9a02-6118617f85b1 with identifier: HV11648
2026-01-29 06:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e18464c1-d77a-53f8-9a02-6118617f85b1 with identifier: HV11648
2026-01-29 06:03:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e18464c1-d77a-53f8-9a02-6118617f85b1 with identifier: HV11648 to the API
2026-01-29 06:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:03:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:03:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_b096055bb322c4f29beb1243f42d7427.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:36:31Z',
 'fuel_type': 'diesel',
 'id': 'e18464c1-d77a-53f8-9a02-6118617f85b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV11648',
 'listing': 'auction',
 'location': 'FR, Loudéac',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 122623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e18464c1-d77a-53f8-9a02-6118617f85b1/e18464c1-d77a-53f8-9a02-6118617f85b1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_9e9cf5132e186978052be633f44beb51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e18464c1-d77a-53f8-9a02-6118617f85b1/e18464c1-d77a-53f8-9a02-6118617f85b1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_e4de5a40d2d538303ee70f9f0b848ce5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e18464c1-d77a-53f8-9a02-6118617f85b1/e18464c1-d77a-53f8-9a02-6118617f85b1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73837,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_d80ee4611acd9dc1ffce0e217674247f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e18464c1-d77a-53f8-9a02-6118617f85b1/e18464c1-d77a-53f8-9a02-6118617f85b1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_2e6e5278e23414c053103d9e5bf2acf9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e18464c1-d77a-53f8-9a02-6118617f85b1/e18464c1-d77a-53f8-9a02-6118617f85b1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_865191e4927252a9f784c3d851a0db14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e18464c1-d77a-53f8-9a02-6118617f85b1/e18464c1-d77a-53f8-9a02-6118617f85b1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_d081a5f043883e2c8e68e265954cd7f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e18464c1-d77a-53f8-9a02-6118617f85b1/e18464c1-d77a-53f8-9a02-6118617f85b1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66771,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_7729e34a115e5b26faa0005e33a9bd83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e18464c1-d77a-53f8-9a02-6118617f85b1/e18464c1-d77a-53f8-9a02-6118617f85b1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79447,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_ebbbf462604a81250d403c9456c8d3e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e18464c1-d77a-53f8-9a02-6118617f85b1/e18464c1-d77a-53f8-9a02-6118617f85b1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_62b7c73b7b4bc32ea151ce70c92776c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e18464c1-d77a-53f8-9a02-6118617f85b1/e18464c1-d77a-53f8-9a02-6118617f85b1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_818090f666a549f4447b7dba46d9919e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e18464c1-d77a-53f8-9a02-6118617f85b1/e18464c1-d77a-53f8-9a02-6118617f85b1_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_82befa91da219fa17884ea90c6d7d20b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e18464c1-d77a-53f8-9a02-6118617f85b1/e18464c1-d77a-53f8-9a02-6118617f85b1_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59364,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_587cec7dba88fd1bbb0268f3d2f07a10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e18464c1-d77a-53f8-9a02-6118617f85b1/e18464c1-d77a-53f8-9a02-6118617f85b1_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_bbb4291cf238c7d12e0819468f38f61a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e18464c1-d77a-53f8-9a02-6118617f85b1/e18464c1-d77a-53f8-9a02-6118617f85b1_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_51d41e595fc576da125bc108d152dca0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e18464c1-d77a-53f8-9a02-6118617f85b1/e18464c1-d77a-53f8-9a02-6118617f85b1_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/a5/15a57247cf65a79bb5e2285eebb6c11b/pa/HV11648_b096055bb322c4f29beb1243f42d7427.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-04-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.5 BLUE dCi Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2020}
2026-01-29 06:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HV11648%27 HTTP/1.1" 200 None
2026-01-29 06:03:14 [auto1.fr] INFO: Saving data for HV11648: {'created_time': 1769666594.39362, 'last_price_update_time': 1769666594.393631, 'auction_closing_time': 1769704591.0}
2026-01-29 06:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HV11648') HTTP/1.1" 204 0
2026-01-29 06:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_80c58851c8022fd47b7d5ab7cfc21bd7.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_f3d7a96b4604b6c2131763c58668909e.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_92adab970f19b7966893fc35f6504674.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_aa67fc451d0074f9068a0b5d83cbb2b6.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_03575f3dd991a4a895cfd14609ecb428.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_457a380c444bc719b5a824aa7796ed92.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_9e6a242b40bc1a6d0da2a01a6860275f.png> (referer: https://www.auto1.com/)
2026-01-29 06:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YY96568> (referer: https://www.auto1.com/v1/car-details-view/YY96568/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UD83687> (referer: https://www.auto1.com/v1/car-details-view/UD83687/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c142690>
2026-01-29 06:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_199ab5d0-e058-5bfe-9399-1fd641b24b93/199ab5d0-e058-5bfe-9399-1fd641b24b93_image_12.jpg HTTP/1.1" 201 0
2026-01-29 06:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F61%252Fe4616a24ff11f27f03fa189a8d18f728%252Fpa%252FUG35109_9413765f7f7e9fb94062f3dc957919c5.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_9413765f7f7e9fb94062f3dc957919c5.jpg saved to cache
2026-01-29 06:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 199ab5d0-e058-5bfe-9399-1fd641b24b93
2026-01-29 06:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f576dd0>
2026-01-29 06:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a9df2b8-7c08-5966-be0f-591af074057e/4a9df2b8-7c08-5966-be0f-591af074057e_image_10.jpg HTTP/1.1" 201 0
2026-01-29 06:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fbe%252Fc3be27b6261d9847ba839edb8d43f377%252Fpa%252FZH57094_302a39b21668cd859583815fc7ed096e.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_302a39b21668cd859583815fc7ed096e.jpg saved to cache
2026-01-29 06:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 4a9df2b8-7c08-5966-be0f-591af074057e
2026-01-29 06:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f576010>
2026-01-29 06:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_199ab5d0-e058-5bfe-9399-1fd641b24b93/199ab5d0-e058-5bfe-9399-1fd641b24b93_image_13.jpg HTTP/1.1" 201 0
2026-01-29 06:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F61%252Fe4616a24ff11f27f03fa189a8d18f728%252Fpa%252FUG35109_0931e59fd3dfc3625a9fa4f58f0c374a.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_0931e59fd3dfc3625a9fa4f58f0c374a.jpg saved to cache
2026-01-29 06:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 199ab5d0-e058-5bfe-9399-1fd641b24b93
2026-01-29 06:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c141ad0>
2026-01-29 06:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b542ba20-2534-578d-8af4-2d58076300b4/b542ba20-2534-578d-8af4-2d58076300b4_image_0.jpg HTTP/1.1" 201 0
2026-01-29 06:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F10%252F961033bf702c435bcfdc3e7406463a6c%252Fpa%252FJB37332_9f7ea191c39ce73bf483edeb6a84affa.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_9f7ea191c39ce73bf483edeb6a84affa.jpg saved to cache
2026-01-29 06:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b542ba20-2534-578d-8af4-2d58076300b4
2026-01-29 06:03:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b542ba20-2534-578d-8af4-2d58076300b4, skipping ID generation
2026-01-29 06:03:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b542ba20-2534-578d-8af4-2d58076300b4 with scrape type 1
2026-01-29 06:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b542ba20-2534-578d-8af4-2d58076300b4 from tracking dictionaries
2026-01-29 06:03:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b542ba20-2534-578d-8af4-2d58076300b4 sending to next pipeline
2026-01-29 06:03:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b542ba20-2534-578d-8af4-2d58076300b4, identifier: JB37332
2026-01-29 06:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c0ef950>
2026-01-29 06:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-29 06:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1d7377b-9af9-5c96-8031-2a907dc53a6a/c1d7377b-9af9-5c96-8031-2a907dc53a6a_image_10.jpg HTTP/1.1" 201 0
2026-01-29 06:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff0%252Fb1f07102e6b2523a36ff46d7b3fbd390%252Fpa%252FFV47029_5f5a4898992a6f405da9fd190565ebc2.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_5f5a4898992a6f405da9fd190565ebc2.jpg saved to cache
2026-01-29 06:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item c1d7377b-9af9-5c96-8031-2a907dc53a6a
2026-01-29 06:03:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b542ba20-2534-578d-8af4-2d58076300b4 with identifier: JB37332
2026-01-29 06:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:03:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-01-29 06:03:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b542ba20-2534-578d-8af4-2d58076300b4 with identifier: JB37332
2026-01-29 06:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 145704 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    145704
2026-01-29 06:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: b542ba20-2534-578d-8af4-2d58076300b4 spider: auto1.fr
2026-01-29 06:03:16 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: b542ba20-2534-578d-8af4-2d58076300b4 due to rule: high_mileage_for_make.json, error: 145704 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    145704
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:05:37Z',
 'fuel_type': 'diesel',
 'id': 'b542ba20-2534-578d-8af4-2d58076300b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB37332',
 'listing': 'auction',
 'location': 'FR, Lavau',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 145704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b542ba20-2534-578d-8af4-2d58076300b4/b542ba20-2534-578d-8af4-2d58076300b4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_9f7ea191c39ce73bf483edeb6a84affa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b542ba20-2534-578d-8af4-2d58076300b4/b542ba20-2534-578d-8af4-2d58076300b4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_6f4235205989b01362c8773d0f0c8065.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b542ba20-2534-578d-8af4-2d58076300b4/b542ba20-2534-578d-8af4-2d58076300b4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_b6746800fc35b8093d5918dfc8dd4319.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b542ba20-2534-578d-8af4-2d58076300b4/b542ba20-2534-578d-8af4-2d58076300b4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_fc4a4c6a78627c4554af17a71eb57597.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b542ba20-2534-578d-8af4-2d58076300b4/b542ba20-2534-578d-8af4-2d58076300b4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_543f53639b558b0d7dcf8795647c4787.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b542ba20-2534-578d-8af4-2d58076300b4/b542ba20-2534-578d-8af4-2d58076300b4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72406,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_de8742c62ea249bbe88b7506a57d62b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b542ba20-2534-578d-8af4-2d58076300b4/b542ba20-2534-578d-8af4-2d58076300b4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_57208b0f7c68276796760f9aea54b630.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b542ba20-2534-578d-8af4-2d58076300b4/b542ba20-2534-578d-8af4-2d58076300b4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_02ee8be0407683f29058a3069243f421.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b542ba20-2534-578d-8af4-2d58076300b4/b542ba20-2534-578d-8af4-2d58076300b4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_8a0adba3661472ce52ee12a7a8861ad6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b542ba20-2534-578d-8af4-2d58076300b4/b542ba20-2534-578d-8af4-2d58076300b4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_08f73b54f4f2a91fab1e37c401a8825a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b542ba20-2534-578d-8af4-2d58076300b4/b542ba20-2534-578d-8af4-2d58076300b4_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_e77b9a00bd4b7d13f7ca2f40d44f2b3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b542ba20-2534-578d-8af4-2d58076300b4/b542ba20-2534-578d-8af4-2d58076300b4_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_0daf0d3faa68b11b527e9e46e5950335.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b542ba20-2534-578d-8af4-2d58076300b4/b542ba20-2534-578d-8af4-2d58076300b4_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65385,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_8f598525dbbafb26415507405fb7bf56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b542ba20-2534-578d-8af4-2d58076300b4/b542ba20-2534-578d-8af4-2d58076300b4_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_ba6bb7f172a23f228908944ce5778dc2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b542ba20-2534-578d-8af4-2d58076300b4/b542ba20-2534-578d-8af4-2d58076300b4_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_1433cd3befcff2ed30ae9bef6347ed1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b542ba20-2534-578d-8af4-2d58076300b4/b542ba20-2534-578d-8af4-2d58076300b4_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/10/961033bf702c435bcfdc3e7406463a6c/pa/JB37332_558d4130a06f5e6dc64e0df4bcf5b1a9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-30',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2017}
2026-01-29 06:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JB37332%27 HTTP/1.1" 200 None
2026-01-29 06:03:16 [auto1.fr] INFO: Saving data for JB37332: {'created_time': 1769666596.425032, 'last_price_update_time': 1769666596.425043, 'auction_closing_time': 1769702737.0}
2026-01-29 06:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JB37332') HTTP/1.1" 204 0
2026-01-29 06:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_6f55f71df996521957d4975850a03f60.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XU49551> (referer: https://www.auto1.com/v1/car-details-view/XU49551/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NS66111> (referer: https://www.auto1.com/v1/car-details-view/NS66111/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CL14274> (referer: https://www.auto1.com/v1/car-details-view/CL14274/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f358310>
2026-01-29 06:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a9df2b8-7c08-5966-be0f-591af074057e/4a9df2b8-7c08-5966-be0f-591af074057e_image_12.jpg HTTP/1.1" 201 0
2026-01-29 06:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fbe%252Fc3be27b6261d9847ba839edb8d43f377%252Fpa%252FZH57094_80c58851c8022fd47b7d5ab7cfc21bd7.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_80c58851c8022fd47b7d5ab7cfc21bd7.jpg saved to cache
2026-01-29 06:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 4a9df2b8-7c08-5966-be0f-591af074057e
2026-01-29 06:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c14a390>
2026-01-29 06:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a9df2b8-7c08-5966-be0f-591af074057e/4a9df2b8-7c08-5966-be0f-591af074057e_image_13.jpg HTTP/1.1" 201 0
2026-01-29 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fbe%252Fc3be27b6261d9847ba839edb8d43f377%252Fpa%252FZH57094_f3d7a96b4604b6c2131763c58668909e.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_f3d7a96b4604b6c2131763c58668909e.jpg saved to cache
2026-01-29 06:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 4a9df2b8-7c08-5966-be0f-591af074057e
2026-01-29 06:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f35a690>
2026-01-29 06:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1d7377b-9af9-5c96-8031-2a907dc53a6a/c1d7377b-9af9-5c96-8031-2a907dc53a6a_image_4.jpg HTTP/1.1" 201 0
2026-01-29 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff0%252Fb1f07102e6b2523a36ff46d7b3fbd390%252Fpa%252FFV47029_92adab970f19b7966893fc35f6504674.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_92adab970f19b7966893fc35f6504674.jpg saved to cache
2026-01-29 06:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c1d7377b-9af9-5c96-8031-2a907dc53a6a
2026-01-29 06:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f47f350>
2026-01-29 06:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23739264-4f6d-59e2-b61e-61310693cdd1/23739264-4f6d-59e2-b61e-61310693cdd1_image_13.jpg HTTP/1.1" 201 0
2026-01-29 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fa7%252Feda74badf47d0358e82583630100dd51%252Fpa%252FSA16378_aa67fc451d0074f9068a0b5d83cbb2b6.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_aa67fc451d0074f9068a0b5d83cbb2b6.jpg saved to cache
2026-01-29 06:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 23739264-4f6d-59e2-b61e-61310693cdd1
2026-01-29 06:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c2860d0>
2026-01-29 06:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a9df2b8-7c08-5966-be0f-591af074057e/4a9df2b8-7c08-5966-be0f-591af074057e_image_11.jpg HTTP/1.1" 201 0
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fbe%252Fc3be27b6261d9847ba839edb8d43f377%252Fpa%252FZH57094_03575f3dd991a4a895cfd14609ecb428.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_03575f3dd991a4a895cfd14609ecb428.jpg saved to cache
2026-01-29 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 4a9df2b8-7c08-5966-be0f-591af074057e
2026-01-29 06:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f4b2b10>
2026-01-29 06:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_199ab5d0-e058-5bfe-9399-1fd641b24b93/199ab5d0-e058-5bfe-9399-1fd641b24b93_image_14.jpg HTTP/1.1" 201 0
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F61%252Fe4616a24ff11f27f03fa189a8d18f728%252Fpa%252FUG35109_457a380c444bc719b5a824aa7796ed92.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_457a380c444bc719b5a824aa7796ed92.jpg saved to cache
2026-01-29 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 199ab5d0-e058-5bfe-9399-1fd641b24b93
2026-01-29 06:03:18 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-01-29 06:03:18 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2026-01-29 06:03:18 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2026-01-29 06:03:18 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2026-01-29 06:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6fe6ca50>
2026-01-29 06:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_199ab5d0-e058-5bfe-9399-1fd641b24b93/199ab5d0-e058-5bfe-9399-1fd641b24b93_image_15.png HTTP/1.1" 201 0
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F61%252Fe4616a24ff11f27f03fa189a8d18f728%252Fpa%252FUG35109_9e6a242b40bc1a6d0da2a01a6860275f.png') HTTP/1.1" 204 0
2026-01-29 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_9e6a242b40bc1a6d0da2a01a6860275f.png saved to cache
2026-01-29 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 199ab5d0-e058-5bfe-9399-1fd641b24b93
2026-01-29 06:03:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 199ab5d0-e058-5bfe-9399-1fd641b24b93, skipping ID generation
2026-01-29 06:03:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 199ab5d0-e058-5bfe-9399-1fd641b24b93 with scrape type 1
2026-01-29 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 199ab5d0-e058-5bfe-9399-1fd641b24b93 from tracking dictionaries
2026-01-29 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 199ab5d0-e058-5bfe-9399-1fd641b24b93 sending to next pipeline
2026-01-29 06:03:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 199ab5d0-e058-5bfe-9399-1fd641b24b93, identifier: UG35109
2026-01-29 06:03:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ea45969-607f-56b0-b651-21ef39157bcc with identifier: YY96568
2026-01-29 06:03:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ea45969-607f-56b0-b651-21ef39157bcc with scrape type 1
2026-01-29 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 6ea45969-607f-56b0-b651-21ef39157bcc
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fe2%252Fd6e2be6ea592fb8c7e35cb543f951831%252Fpa%252FYY96568_26e248a2da0b87bc9bb9e113a2959740.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_26e248a2da0b87bc9bb9e113a2959740.jpg already downloaded
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fe2%252Fd6e2be6ea592fb8c7e35cb543f951831%252Fpa%252FYY96568_7b0f59adccf5192a8861b4b91c6b7d43.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_7b0f59adccf5192a8861b4b91c6b7d43.jpg already downloaded
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fe2%252Fd6e2be6ea592fb8c7e35cb543f951831%252Fpa%252FYY96568_49ed4ce5980c61cb08ef456925aa8090.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_49ed4ce5980c61cb08ef456925aa8090.jpg already downloaded
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fe2%252Fd6e2be6ea592fb8c7e35cb543f951831%252Fpa%252FYY96568_9c04a8c10ed07e4dce74bbb371759506.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_9c04a8c10ed07e4dce74bbb371759506.jpg already downloaded
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fe2%252Fd6e2be6ea592fb8c7e35cb543f951831%252Fpa%252FYY96568_50aec77f8653286629ffb3f82c510c0a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_50aec77f8653286629ffb3f82c510c0a.jpg already downloaded
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fe2%252Fd6e2be6ea592fb8c7e35cb543f951831%252Fpa%252FYY96568_35afe3f77aebf3d0e8377a9878f1d5e0.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_35afe3f77aebf3d0e8377a9878f1d5e0.jpg already downloaded
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fe2%252Fd6e2be6ea592fb8c7e35cb543f951831%252Fpa%252FYY96568_5322e56b412d09e797346dff598af8f5.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_5322e56b412d09e797346dff598af8f5.jpg already downloaded
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fe2%252Fd6e2be6ea592fb8c7e35cb543f951831%252Fpa%252FYY96568_e14c6b22e88dc88738ecaa4ce6f7edbe.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_e14c6b22e88dc88738ecaa4ce6f7edbe.jpg already downloaded
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fe2%252Fd6e2be6ea592fb8c7e35cb543f951831%252Fpa%252FYY96568_9323102b3e407acd74cf44aa3faf8804.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_9323102b3e407acd74cf44aa3faf8804.jpg already downloaded
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fe2%252Fd6e2be6ea592fb8c7e35cb543f951831%252Fpa%252FYY96568_3487657ab888586793fdc24b394e9e48.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_3487657ab888586793fdc24b394e9e48.jpg already downloaded
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fe2%252Fd6e2be6ea592fb8c7e35cb543f951831%252Fpa%252FYY96568_db9ffce8c3ffad9b2942c3b361634d88.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_db9ffce8c3ffad9b2942c3b361634d88.jpg already downloaded
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fe2%252Fd6e2be6ea592fb8c7e35cb543f951831%252Fpa%252FYY96568_40e84c4fd485c7f4a17be63b5886ef56.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_40e84c4fd485c7f4a17be63b5886ef56.jpg already downloaded
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fe2%252Fd6e2be6ea592fb8c7e35cb543f951831%252Fpa%252FYY96568_abc384bb310523ccc42398ea6166b915.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_abc384bb310523ccc42398ea6166b915.jpg already downloaded
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fe2%252Fd6e2be6ea592fb8c7e35cb543f951831%252Fpa%252FYY96568_158d09272ff4b33b95edc12b678b3fa1.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_158d09272ff4b33b95edc12b678b3fa1.jpg already downloaded
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fe2%252Fd6e2be6ea592fb8c7e35cb543f951831%252Fpa%252FYY96568_a2404b9a6e6ff6a93364fe7737b69bb2.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_a2404b9a6e6ff6a93364fe7737b69bb2.jpg already downloaded
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fe2%252Fd6e2be6ea592fb8c7e35cb543f951831%252Fpa%252FYY96568_6eefa938183f4119d8eed6d48be66034.png%27 HTTP/1.1" 200 None
2026-01-29 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_6eefa938183f4119d8eed6d48be66034.png already downloaded
2026-01-29 06:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6ea45969-607f-56b0-b651-21ef39157bcc, identifier: YY96568
2026-01-29 06:03:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7002579-a488-5146-9a09-9bf7321d9bc8 with identifier: UD83687
2026-01-29 06:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7002579-a488-5146-9a09-9bf7321d9bc8 with scrape type 1
2026-01-29 06:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item d7002579-a488-5146-9a09-9bf7321d9bc8
2026-01-29 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F91%252F85915de238ab51b74adac37321c2b80e%252Fpa%252FUD83687_edf7f6683386141d8495ee84df496957.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_edf7f6683386141d8495ee84df496957.jpg already downloaded
2026-01-29 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F91%252F85915de238ab51b74adac37321c2b80e%252Fpa%252FUD83687_5e3558605cf273e9f08e655b91e6331c.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_5e3558605cf273e9f08e655b91e6331c.jpg already downloaded
2026-01-29 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F91%252F85915de238ab51b74adac37321c2b80e%252Fpa%252FUD83687_7e0732104d51e9aee3c9f59ea4ef4aec.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_7e0732104d51e9aee3c9f59ea4ef4aec.jpg already downloaded
2026-01-29 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F91%252F85915de238ab51b74adac37321c2b80e%252Fpa%252FUD83687_5a0dc567e08f2a0bef9105f51c72f4a2.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_5a0dc567e08f2a0bef9105f51c72f4a2.jpg already downloaded
2026-01-29 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F91%252F85915de238ab51b74adac37321c2b80e%252Fpa%252FUD83687_e306f4034e06866a3313aa48906266ac.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_e306f4034e06866a3313aa48906266ac.jpg already downloaded
2026-01-29 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F91%252F85915de238ab51b74adac37321c2b80e%252Fpa%252FUD83687_b122a367b878a729d33b32416844ac87.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_b122a367b878a729d33b32416844ac87.jpg already downloaded
2026-01-29 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F91%252F85915de238ab51b74adac37321c2b80e%252Fpa%252FUD83687_26623324911bb8e2b3015eaa562308af.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_26623324911bb8e2b3015eaa562308af.jpg already downloaded
2026-01-29 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F91%252F85915de238ab51b74adac37321c2b80e%252Fpa%252FUD83687_5465b0a12fa30262a6dacf44d336ebe7.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_5465b0a12fa30262a6dacf44d336ebe7.jpg already downloaded
2026-01-29 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F91%252F85915de238ab51b74adac37321c2b80e%252Fpa%252FUD83687_73915d9e6ef36ba1bafcf3ac4e16cf38.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_73915d9e6ef36ba1bafcf3ac4e16cf38.jpg already downloaded
2026-01-29 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F91%252F85915de238ab51b74adac37321c2b80e%252Fpa%252FUD83687_8a8258c063a53a849b5f408e50c3c447.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_8a8258c063a53a849b5f408e50c3c447.jpg already downloaded
2026-01-29 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F91%252F85915de238ab51b74adac37321c2b80e%252Fpa%252FUD83687_8c7fdc016ea6d3ce805a3e9fef0d3cc5.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_8c7fdc016ea6d3ce805a3e9fef0d3cc5.jpg already downloaded
2026-01-29 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F91%252F85915de238ab51b74adac37321c2b80e%252Fpa%252FUD83687_ccd420fcbf0144025287970966d2bae0.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_ccd420fcbf0144025287970966d2bae0.jpg already downloaded
2026-01-29 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F91%252F85915de238ab51b74adac37321c2b80e%252Fpa%252FUD83687_e97bcee18b093497208a442a1b74ffb9.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_e97bcee18b093497208a442a1b74ffb9.jpg already downloaded
2026-01-29 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F91%252F85915de238ab51b74adac37321c2b80e%252Fpa%252FUD83687_4ca08d07801ab00fe3fad53d0263bff7.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_4ca08d07801ab00fe3fad53d0263bff7.jpg already downloaded
2026-01-29 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F91%252F85915de238ab51b74adac37321c2b80e%252Fpa%252FUD83687_addc53eaa243eb36864d3ed3335d8af9.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_addc53eaa243eb36864d3ed3335d8af9.jpg already downloaded
2026-01-29 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F91%252F85915de238ab51b74adac37321c2b80e%252Fpa%252FUD83687_7fd79d1ac06d5eca47c78250fec5f06f.png%27 HTTP/1.1" 200 None
2026-01-29 06:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_7fd79d1ac06d5eca47c78250fec5f06f.png already downloaded
2026-01-29 06:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d7002579-a488-5146-9a09-9bf7321d9bc8, identifier: UD83687
2026-01-29 06:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_03a7072a874f263fabb4b92a59282d39.png> (referer: https://www.auto1.com/)
2026-01-29 06:03:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 199ab5d0-e058-5bfe-9399-1fd641b24b93 with identifier: UG35109
2026-01-29 06:03:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 199ab5d0-e058-5bfe-9399-1fd641b24b93 with identifier: UG35109
2026-01-29 06:03:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 199ab5d0-e058-5bfe-9399-1fd641b24b93 with identifier: UG35109 to the API
2026-01-29 06:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:03:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:03:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_9e6a242b40bc1a6d0da2a01a6860275f.png>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:41:47Z',
 'fuel_type': 'petrol',
 'id': '199ab5d0-e058-5bfe-9399-1fd641b24b93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG35109',
 'listing': 'auction',
 'location': 'FR, Saint-Léonard',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 144931,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_199ab5d0-e058-5bfe-9399-1fd641b24b93/199ab5d0-e058-5bfe-9399-1fd641b24b93_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_1c3797d4e28bb6146bdd2673a084a460.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_199ab5d0-e058-5bfe-9399-1fd641b24b93/199ab5d0-e058-5bfe-9399-1fd641b24b93_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_e326430b199aef60c5a767df83d08606.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_199ab5d0-e058-5bfe-9399-1fd641b24b93/199ab5d0-e058-5bfe-9399-1fd641b24b93_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_7c5cd791ee8b8e87ea00868ffad48650.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_199ab5d0-e058-5bfe-9399-1fd641b24b93/199ab5d0-e058-5bfe-9399-1fd641b24b93_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_9b100bc0b1f69cd6b8ad31d96a18a1be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_199ab5d0-e058-5bfe-9399-1fd641b24b93/199ab5d0-e058-5bfe-9399-1fd641b24b93_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_1bda08de376b5fda05c1afe9e6150ea5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_199ab5d0-e058-5bfe-9399-1fd641b24b93/199ab5d0-e058-5bfe-9399-1fd641b24b93_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_e818fec006d2492d77839df0c56fb530.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_199ab5d0-e058-5bfe-9399-1fd641b24b93/199ab5d0-e058-5bfe-9399-1fd641b24b93_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61988,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_d38b9655bb1997579b30f09662a7fe3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_199ab5d0-e058-5bfe-9399-1fd641b24b93/199ab5d0-e058-5bfe-9399-1fd641b24b93_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_1607d6fe0175582252b1c24e69b938f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_199ab5d0-e058-5bfe-9399-1fd641b24b93/199ab5d0-e058-5bfe-9399-1fd641b24b93_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_26169cec957f7c7fa672bfbcc9a7a0be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_199ab5d0-e058-5bfe-9399-1fd641b24b93/199ab5d0-e058-5bfe-9399-1fd641b24b93_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_6017784d52fc83f1ff1a2dcb88e1cadf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_199ab5d0-e058-5bfe-9399-1fd641b24b93/199ab5d0-e058-5bfe-9399-1fd641b24b93_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_13623e9006466f3c599c8254b2acbe75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_199ab5d0-e058-5bfe-9399-1fd641b24b93/199ab5d0-e058-5bfe-9399-1fd641b24b93_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_909429b3863532062ecf8297c350b0b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_199ab5d0-e058-5bfe-9399-1fd641b24b93/199ab5d0-e058-5bfe-9399-1fd641b24b93_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_9413765f7f7e9fb94062f3dc957919c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_199ab5d0-e058-5bfe-9399-1fd641b24b93/199ab5d0-e058-5bfe-9399-1fd641b24b93_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44709,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_0931e59fd3dfc3625a9fa4f58f0c374a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_199ab5d0-e058-5bfe-9399-1fd641b24b93/199ab5d0-e058-5bfe-9399-1fd641b24b93_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_457a380c444bc719b5a824aa7796ed92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_199ab5d0-e058-5bfe-9399-1fd641b24b93/199ab5d0-e058-5bfe-9399-1fd641b24b93_image_15.png',
             'Extension': 'png',
             'FileSizeInBytes': 80605,
             'Height': 525,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/61/e4616a24ff11f27f03fa189a8d18f728/pa/UG35109_9e6a242b40bc1a6d0da2a01a6860275f.png',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2019}
2026-01-29 06:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG35109%27 HTTP/1.1" 200 None
2026-01-29 06:03:20 [auto1.fr] INFO: Saving data for UG35109: {'created_time': 1769666600.085047, 'last_price_update_time': 1769666600.085057, 'auction_closing_time': 1769704907.0}
2026-01-29 06:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UG35109') HTTP/1.1" 204 0
2026-01-29 06:03:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6ea45969-607f-56b0-b651-21ef39157bcc with identifier: YY96568
2026-01-29 06:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6ea45969-607f-56b0-b651-21ef39157bcc with identifier: YY96568
2026-01-29 06:03:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6ea45969-607f-56b0-b651-21ef39157bcc with identifier: YY96568 to the API
2026-01-29 06:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:03:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:03:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YY96568>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-01-29T16:28:52Z',
 'fuel_type': 'diesel',
 'id': '6ea45969-607f-56b0-b651-21ef39157bcc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY96568',
 'listing': 'auction',
 'location': 'FR, Quincieux',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 104751,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_26e248a2da0b87bc9bb9e113a2959740.jpg',
                'https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_7b0f59adccf5192a8861b4b91c6b7d43.jpg',
                'https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_49ed4ce5980c61cb08ef456925aa8090.jpg',
                'https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_9c04a8c10ed07e4dce74bbb371759506.jpg',
                'https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_50aec77f8653286629ffb3f82c510c0a.jpg',
                'https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_35afe3f77aebf3d0e8377a9878f1d5e0.jpg',
                'https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_5322e56b412d09e797346dff598af8f5.jpg',
                'https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_e14c6b22e88dc88738ecaa4ce6f7edbe.jpg',
                'https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_9323102b3e407acd74cf44aa3faf8804.jpg',
                'https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_3487657ab888586793fdc24b394e9e48.jpg',
                'https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_db9ffce8c3ffad9b2942c3b361634d88.jpg',
                'https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_40e84c4fd485c7f4a17be63b5886ef56.jpg',
                'https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_abc384bb310523ccc42398ea6166b915.jpg',
                'https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_158d09272ff4b33b95edc12b678b3fa1.jpg',
                'https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_a2404b9a6e6ff6a93364fe7737b69bb2.jpg',
                'https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_6eefa938183f4119d8eed6d48be66034.png'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea45969-607f-56b0-b651-21ef39157bcc/6ea45969-607f-56b0-b651-21ef39157bcc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2590522,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_26e248a2da0b87bc9bb9e113a2959740.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea45969-607f-56b0-b651-21ef39157bcc/6ea45969-607f-56b0-b651-21ef39157bcc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2628558,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_7b0f59adccf5192a8861b4b91c6b7d43.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea45969-607f-56b0-b651-21ef39157bcc/6ea45969-607f-56b0-b651-21ef39157bcc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2370538,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_49ed4ce5980c61cb08ef456925aa8090.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea45969-607f-56b0-b651-21ef39157bcc/6ea45969-607f-56b0-b651-21ef39157bcc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_9c04a8c10ed07e4dce74bbb371759506.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea45969-607f-56b0-b651-21ef39157bcc/6ea45969-607f-56b0-b651-21ef39157bcc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_50aec77f8653286629ffb3f82c510c0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea45969-607f-56b0-b651-21ef39157bcc/6ea45969-607f-56b0-b651-21ef39157bcc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_35afe3f77aebf3d0e8377a9878f1d5e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea45969-607f-56b0-b651-21ef39157bcc/6ea45969-607f-56b0-b651-21ef39157bcc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_5322e56b412d09e797346dff598af8f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea45969-607f-56b0-b651-21ef39157bcc/6ea45969-607f-56b0-b651-21ef39157bcc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77376,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_e14c6b22e88dc88738ecaa4ce6f7edbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea45969-607f-56b0-b651-21ef39157bcc/6ea45969-607f-56b0-b651-21ef39157bcc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_9323102b3e407acd74cf44aa3faf8804.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea45969-607f-56b0-b651-21ef39157bcc/6ea45969-607f-56b0-b651-21ef39157bcc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_3487657ab888586793fdc24b394e9e48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea45969-607f-56b0-b651-21ef39157bcc/6ea45969-607f-56b0-b651-21ef39157bcc_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_db9ffce8c3ffad9b2942c3b361634d88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea45969-607f-56b0-b651-21ef39157bcc/6ea45969-607f-56b0-b651-21ef39157bcc_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_40e84c4fd485c7f4a17be63b5886ef56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea45969-607f-56b0-b651-21ef39157bcc/6ea45969-607f-56b0-b651-21ef39157bcc_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70037,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_abc384bb310523ccc42398ea6166b915.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea45969-607f-56b0-b651-21ef39157bcc/6ea45969-607f-56b0-b651-21ef39157bcc_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2672353,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_158d09272ff4b33b95edc12b678b3fa1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea45969-607f-56b0-b651-21ef39157bcc/6ea45969-607f-56b0-b651-21ef39157bcc_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124007,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_a2404b9a6e6ff6a93364fe7737b69bb2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ea45969-607f-56b0-b651-21ef39157bcc/6ea45969-607f-56b0-b651-21ef39157bcc_image_15.png',
             'Extension': 'png',
             'FileSizeInBytes': 81605,
             'Height': 525,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/e2/d6e2be6ea592fb8c7e35cb543f951831/pa/YY96568_6eefa938183f4119d8eed6d48be66034.png',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 508 2.0 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2019}
2026-01-29 06:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YY96568%27 HTTP/1.1" 200 None
2026-01-29 06:03:20 [auto1.fr] INFO: Saving data for YY96568: {'created_time': 1769666600.460968, 'last_price_update_time': 1769666600.460978, 'auction_closing_time': 1769704132.0}
2026-01-29 06:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YY96568') HTTP/1.1" 204 0
2026-01-29 06:03:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d7002579-a488-5146-9a09-9bf7321d9bc8 with identifier: UD83687
2026-01-29 06:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d7002579-a488-5146-9a09-9bf7321d9bc8 with identifier: UD83687
2026-01-29 06:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 158575 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    158575
2026-01-29 06:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d7002579-a488-5146-9a09-9bf7321d9bc8 spider: auto1.fr
2026-01-29 06:03:20 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: d7002579-a488-5146-9a09-9bf7321d9bc8 due to rule: high_mileage_for_country.json, error: 158575 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    158575
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 105,
 'expiration_date': '2026-01-29T16:39:39Z',
 'fuel_type': 'diesel',
 'id': 'd7002579-a488-5146-9a09-9bf7321d9bc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD83687',
 'listing': 'auction',
 'location': 'FR, \u200bCHEVIGNY-SAINT-SAUVEUR',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 158575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_edf7f6683386141d8495ee84df496957.jpg',
                'https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_5e3558605cf273e9f08e655b91e6331c.jpg',
                'https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_7e0732104d51e9aee3c9f59ea4ef4aec.jpg',
                'https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_5a0dc567e08f2a0bef9105f51c72f4a2.jpg',
                'https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_e306f4034e06866a3313aa48906266ac.jpg',
                'https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_b122a367b878a729d33b32416844ac87.jpg',
                'https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_26623324911bb8e2b3015eaa562308af.jpg',
                'https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_5465b0a12fa30262a6dacf44d336ebe7.jpg',
                'https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_73915d9e6ef36ba1bafcf3ac4e16cf38.jpg',
                'https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_8a8258c063a53a849b5f408e50c3c447.jpg',
                'https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_8c7fdc016ea6d3ce805a3e9fef0d3cc5.jpg',
                'https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_ccd420fcbf0144025287970966d2bae0.jpg',
                'https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_e97bcee18b093497208a442a1b74ffb9.jpg',
                'https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_4ca08d07801ab00fe3fad53d0263bff7.jpg',
                'https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_addc53eaa243eb36864d3ed3335d8af9.jpg',
                'https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_7fd79d1ac06d5eca47c78250fec5f06f.png'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7002579-a488-5146-9a09-9bf7321d9bc8/d7002579-a488-5146-9a09-9bf7321d9bc8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_edf7f6683386141d8495ee84df496957.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7002579-a488-5146-9a09-9bf7321d9bc8/d7002579-a488-5146-9a09-9bf7321d9bc8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61578,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_5e3558605cf273e9f08e655b91e6331c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7002579-a488-5146-9a09-9bf7321d9bc8/d7002579-a488-5146-9a09-9bf7321d9bc8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_7e0732104d51e9aee3c9f59ea4ef4aec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7002579-a488-5146-9a09-9bf7321d9bc8/d7002579-a488-5146-9a09-9bf7321d9bc8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_5a0dc567e08f2a0bef9105f51c72f4a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7002579-a488-5146-9a09-9bf7321d9bc8/d7002579-a488-5146-9a09-9bf7321d9bc8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_e306f4034e06866a3313aa48906266ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7002579-a488-5146-9a09-9bf7321d9bc8/d7002579-a488-5146-9a09-9bf7321d9bc8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_b122a367b878a729d33b32416844ac87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7002579-a488-5146-9a09-9bf7321d9bc8/d7002579-a488-5146-9a09-9bf7321d9bc8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_26623324911bb8e2b3015eaa562308af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7002579-a488-5146-9a09-9bf7321d9bc8/d7002579-a488-5146-9a09-9bf7321d9bc8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_5465b0a12fa30262a6dacf44d336ebe7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7002579-a488-5146-9a09-9bf7321d9bc8/d7002579-a488-5146-9a09-9bf7321d9bc8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_73915d9e6ef36ba1bafcf3ac4e16cf38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7002579-a488-5146-9a09-9bf7321d9bc8/d7002579-a488-5146-9a09-9bf7321d9bc8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_8a8258c063a53a849b5f408e50c3c447.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7002579-a488-5146-9a09-9bf7321d9bc8/d7002579-a488-5146-9a09-9bf7321d9bc8_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_8c7fdc016ea6d3ce805a3e9fef0d3cc5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7002579-a488-5146-9a09-9bf7321d9bc8/d7002579-a488-5146-9a09-9bf7321d9bc8_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_ccd420fcbf0144025287970966d2bae0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7002579-a488-5146-9a09-9bf7321d9bc8/d7002579-a488-5146-9a09-9bf7321d9bc8_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_e97bcee18b093497208a442a1b74ffb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7002579-a488-5146-9a09-9bf7321d9bc8/d7002579-a488-5146-9a09-9bf7321d9bc8_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_4ca08d07801ab00fe3fad53d0263bff7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7002579-a488-5146-9a09-9bf7321d9bc8/d7002579-a488-5146-9a09-9bf7321d9bc8_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123364,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_addc53eaa243eb36864d3ed3335d8af9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7002579-a488-5146-9a09-9bf7321d9bc8/d7002579-a488-5146-9a09-9bf7321d9bc8_image_15.png',
             'Extension': 'png',
             'FileSizeInBytes': 72604,
             'Height': 525,
             'OriginUrl': 'https://img-pa.auto1.com/img85/91/85915de238ab51b74adac37321c2b80e/pa/UD83687_7fd79d1ac06d5eca47c78250fec5f06f.png',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-3 1.5 Diesel Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2017}
2026-01-29 06:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UD83687%27 HTTP/1.1" 200 None
2026-01-29 06:03:20 [auto1.fr] INFO: Saving data for UD83687: {'created_time': 1769666600.730801, 'last_price_update_time': 1769666600.730814, 'auction_closing_time': 1769704779.0}
2026-01-29 06:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UD83687') HTTP/1.1" 204 0
2026-01-29 06:03:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_b3c1322d65f3278c7f6c5611c4201daa.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_c9ae30db06576ecaa1805ffb727cf3fc.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_c2ceda50e6e26e2fbda02f6e79f42340.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_b9ff03276bcf9941b3dc0fb57df7d39a.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XA49145/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ER42739> (referer: https://www.auto1.com/v1/car-details-view/ER42739/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MF46010/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f4bf2d0>
2026-01-29 06:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a9df2b8-7c08-5966-be0f-591af074057e/4a9df2b8-7c08-5966-be0f-591af074057e_image_14.jpg HTTP/1.1" 201 0
2026-01-29 06:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fbe%252Fc3be27b6261d9847ba839edb8d43f377%252Fpa%252FZH57094_6f55f71df996521957d4975850a03f60.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_6f55f71df996521957d4975850a03f60.jpg saved to cache
2026-01-29 06:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 4a9df2b8-7c08-5966-be0f-591af074057e
2026-01-29 06:03:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfab3c5d-2ff9-5b46-af89-03dca342d41b with identifier: XU49551
2026-01-29 06:03:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfab3c5d-2ff9-5b46-af89-03dca342d41b with scrape type 2
2026-01-29 06:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfab3c5d-2ff9-5b46-af89-03dca342d41b with scrape type 2
2026-01-29 06:03:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cfab3c5d-2ff9-5b46-af89-03dca342d41b, identifier: XU49551
2026-01-29 06:03:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcf229a0-4638-5196-9e49-efe252c9723f with identifier: NS66111
2026-01-29 06:03:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcf229a0-4638-5196-9e49-efe252c9723f with scrape type 1
2026-01-29 06:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item dcf229a0-4638-5196-9e49-efe252c9723f
2026-01-29 06:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F93%252F2693cda41323c87cb0eb7c1c8c926a70%252Fpa%252FNS66111_5d6ee3919a1c2b609f486abc52d084bb.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_5d6ee3919a1c2b609f486abc52d084bb.jpg not downloaded yet
2026-01-29 06:03:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 280585a1-c2c7-51d5-8738-b8293c23eb71 with identifier: CL14274
2026-01-29 06:03:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 280585a1-c2c7-51d5-8738-b8293c23eb71 with scrape type 2
2026-01-29 06:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 280585a1-c2c7-51d5-8738-b8293c23eb71 with scrape type 2
2026-01-29 06:03:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 280585a1-c2c7-51d5-8738-b8293c23eb71, identifier: CL14274
2026-01-29 06:03:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cfab3c5d-2ff9-5b46-af89-03dca342d41b with identifier: XU49551
2026-01-29 06:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cfab3c5d-2ff9-5b46-af89-03dca342d41b with identifier: XU49551
2026-01-29 06:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech feel', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 85216, 'odometer_reading_unit': 'km', 'registration_date': '2018-01-22', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xu49551', 'expiration_date': '2026-01-29t16:01:55z', 'origin_country_code': 'fr', 'trim': 'feel', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'ergué-gabéric', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': 'cfab3c5d-2ff9-5b46-af89-03dca342d41b', 'current_year_diff': 8, 'age_in_months': 96, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 85216}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 96,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:01:55z',
     'fuel_type': 'petrol',
     'id': 'cfab3c5d-2ff9-5b46-af89-03dca342d41b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xu49551',
     'listing': 'auction',
     'location': 'ergué-gabéric',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 85216,
     'odometer_in_km': 85216,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-01-22',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech feel',
     'transmission': 'manual',
     'trim': 'feel',
     'year': 2018}
2026-01-29 06:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: cfab3c5d-2ff9-5b46-af89-03dca342d41b spider: auto1.fr
2026-01-29 06:03:21 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: cfab3c5d-2ff9-5b46-af89-03dca342d41b due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech feel', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 85216, 'odometer_reading_unit': 'km', 'registration_date': '2018-01-22', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xu49551', 'expiration_date': '2026-01-29t16:01:55z', 'origin_country_code': 'fr', 'trim': 'feel', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'ergué-gabéric', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': 'cfab3c5d-2ff9-5b46-af89-03dca342d41b', 'current_year_diff': 8, 'age_in_months': 96, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 85216}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 96,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:01:55z',
     'fuel_type': 'petrol',
     'id': 'cfab3c5d-2ff9-5b46-af89-03dca342d41b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xu49551',
     'listing': 'auction',
     'location': 'ergué-gabéric',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 85216,
     'odometer_in_km': 85216,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-01-22',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech feel',
     'transmission': 'manual',
     'trim': 'feel',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:01:55Z',
 'fuel_type': 'petrol',
 'id': 'cfab3c5d-2ff9-5b46-af89-03dca342d41b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU49551',
 'listing': 'auction',
 'location': 'Ergué-Gabéric',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 85216,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2018}
2026-01-29 06:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XU49551%27 HTTP/1.1" 200 None
2026-01-29 06:03:21 [auto1.fr] INFO: Saving data for XU49551: {'auction_closing_time': 1769702515.0, 'created_time': 1769015398.363131, 'last_price_update_time': 1769666601.93176}
2026-01-29 06:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XU49551') HTTP/1.1" 204 0
2026-01-29 06:03:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 280585a1-c2c7-51d5-8738-b8293c23eb71 with identifier: CL14274
2026-01-29 06:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 280585a1-c2c7-51d5-8738-b8293c23eb71 with identifier: CL14274
2026-01-29 06:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 vti style', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 72008, 'odometer_reading_unit': 'km', 'registration_date': '2017-03-20', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cl14274', 'expiration_date': '2026-01-29t16:16:56z', 'origin_country_code': 'fr', 'trim': 'style', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ambarès-et-lagrave', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 114, 'id': '280585a1-c2c7-51d5-8738-b8293c23eb71', 'current_year_diff': 9, 'age_in_months': 106, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 72008}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 106,
     'auction_title': '',
     'c_o_2_emission_value': 114,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:16:56z',
     'fuel_type': 'petrol',
     'id': '280585a1-c2c7-51d5-8738-b8293c23eb71',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cl14274',
     'listing': 'auction',
     'location': 'fr, ambarès-et-lagrave',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 72008,
     'odometer_in_km': 72008,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-03-20',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 vti style',
     'transmission': 'manual',
     'trim': 'style',
     'year': 2017}
2026-01-29 06:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 280585a1-c2c7-51d5-8738-b8293c23eb71 spider: auto1.fr
2026-01-29 06:03:22 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 280585a1-c2c7-51d5-8738-b8293c23eb71 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 vti style', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 72008, 'odometer_reading_unit': 'km', 'registration_date': '2017-03-20', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cl14274', 'expiration_date': '2026-01-29t16:16:56z', 'origin_country_code': 'fr', 'trim': 'style', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ambarès-et-lagrave', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 114, 'id': '280585a1-c2c7-51d5-8738-b8293c23eb71', 'current_year_diff': 9, 'age_in_months': 106, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 72008}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 106,
     'auction_title': '',
     'c_o_2_emission_value': 114,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:16:56z',
     'fuel_type': 'petrol',
     'id': '280585a1-c2c7-51d5-8738-b8293c23eb71',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cl14274',
     'listing': 'auction',
     'location': 'fr, ambarès-et-lagrave',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 72008,
     'odometer_in_km': 72008,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-03-20',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 vti style',
     'transmission': 'manual',
     'trim': 'style',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:16:56Z',
 'fuel_type': 'petrol',
 'id': '280585a1-c2c7-51d5-8738-b8293c23eb71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL14274',
 'listing': 'auction',
 'location': 'FR, Ambarès-et-Lagrave',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 72008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 VTi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2017}
2026-01-29 06:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CL14274%27 HTTP/1.1" 200 None
2026-01-29 06:03:22 [auto1.fr] INFO: Saving data for CL14274: {'auction_closing_time': 1769703416.0, 'created_time': 1768991775.014848, 'last_price_update_time': 1769666602.214455}
2026-01-29 06:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CL14274') HTTP/1.1" 204 0
2026-01-29 06:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_cd7ecf7054331e6988ad779e3d6971e4.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F93%252F2693cda41323c87cb0eb7c1c8c926a70%252Fpa%252FNS66111_4ebdf75f5e9027f4e4530a661e2369e4.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_4ebdf75f5e9027f4e4530a661e2369e4.jpg not downloaded yet
2026-01-29 06:03:22 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-01-29 06:03:22 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2026-01-29 06:03:22 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2026-01-29 06:03:22 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2026-01-29 06:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7e0795d0>
2026-01-29 06:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a9df2b8-7c08-5966-be0f-591af074057e/4a9df2b8-7c08-5966-be0f-591af074057e_image_15.png HTTP/1.1" 201 0
2026-01-29 06:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fbe%252Fc3be27b6261d9847ba839edb8d43f377%252Fpa%252FZH57094_03a7072a874f263fabb4b92a59282d39.png') HTTP/1.1" 204 0
2026-01-29 06:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_03a7072a874f263fabb4b92a59282d39.png saved to cache
2026-01-29 06:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 4a9df2b8-7c08-5966-be0f-591af074057e
2026-01-29 06:03:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4a9df2b8-7c08-5966-be0f-591af074057e, skipping ID generation
2026-01-29 06:03:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a9df2b8-7c08-5966-be0f-591af074057e with scrape type 1
2026-01-29 06:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4a9df2b8-7c08-5966-be0f-591af074057e from tracking dictionaries
2026-01-29 06:03:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4a9df2b8-7c08-5966-be0f-591af074057e sending to next pipeline
2026-01-29 06:03:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4a9df2b8-7c08-5966-be0f-591af074057e, identifier: ZH57094
2026-01-29 06:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_33fe3ac1771aa7ff2a9069ed4dd28d26.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_68d2097e82d660cbfedc71bb9be8b4fa.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_bcc5ec32581de62097c45d4f76c30164.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4a9df2b8-7c08-5966-be0f-591af074057e with identifier: ZH57094
2026-01-29 06:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4a9df2b8-7c08-5966-be0f-591af074057e with identifier: ZH57094
2026-01-29 06:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'boxer' containing 'boxer'
2026-01-29 06:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 4a9df2b8-7c08-5966-be0f-591af074057e spider: auto1.fr
2026-01-29 06:03:22 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 4a9df2b8-7c08-5966-be0f-591af074057e due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'boxer' containing 'boxer'
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-01-29T16:50:05Z',
 'fuel_type': 'diesel',
 'id': '4a9df2b8-7c08-5966-be0f-591af074057e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH57094',
 'listing': 'auction',
 'location': 'FR, La Garde',
 'make': 'Peugeot',
 'model': 'Boxer',
 'odometer': 192091,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a9df2b8-7c08-5966-be0f-591af074057e/4a9df2b8-7c08-5966-be0f-591af074057e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75961,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_99b40d36b7fa63529ec649f6a43e754a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a9df2b8-7c08-5966-be0f-591af074057e/4a9df2b8-7c08-5966-be0f-591af074057e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_cd50facf990c01a4241b870fbda96da3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a9df2b8-7c08-5966-be0f-591af074057e/4a9df2b8-7c08-5966-be0f-591af074057e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_de0620396053ef18d9a1f7aa016b782b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a9df2b8-7c08-5966-be0f-591af074057e/4a9df2b8-7c08-5966-be0f-591af074057e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62157,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_14f7374218c694cdcca06d85ba62df27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a9df2b8-7c08-5966-be0f-591af074057e/4a9df2b8-7c08-5966-be0f-591af074057e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_eef9edbd296eae652ff3155d1d60f8bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a9df2b8-7c08-5966-be0f-591af074057e/4a9df2b8-7c08-5966-be0f-591af074057e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_6f2f0b6324b94a8dc41caad063169d0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a9df2b8-7c08-5966-be0f-591af074057e/4a9df2b8-7c08-5966-be0f-591af074057e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_2ccc1bfea05db2281b0871e4d6972d7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a9df2b8-7c08-5966-be0f-591af074057e/4a9df2b8-7c08-5966-be0f-591af074057e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70535,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_2d19ed05ab5847227db68db8db2a447b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a9df2b8-7c08-5966-be0f-591af074057e/4a9df2b8-7c08-5966-be0f-591af074057e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73121,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_65f99f760430fbe070996c928f5ae93b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a9df2b8-7c08-5966-be0f-591af074057e/4a9df2b8-7c08-5966-be0f-591af074057e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62259,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_1214b6f3d0230c45f0e135ab1a16396f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a9df2b8-7c08-5966-be0f-591af074057e/4a9df2b8-7c08-5966-be0f-591af074057e_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64381,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_302a39b21668cd859583815fc7ed096e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a9df2b8-7c08-5966-be0f-591af074057e/4a9df2b8-7c08-5966-be0f-591af074057e_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66371,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_03575f3dd991a4a895cfd14609ecb428.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a9df2b8-7c08-5966-be0f-591af074057e/4a9df2b8-7c08-5966-be0f-591af074057e_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62366,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_80c58851c8022fd47b7d5ab7cfc21bd7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a9df2b8-7c08-5966-be0f-591af074057e/4a9df2b8-7c08-5966-be0f-591af074057e_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43366,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_f3d7a96b4604b6c2131763c58668909e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a9df2b8-7c08-5966-be0f-591af074057e/4a9df2b8-7c08-5966-be0f-591af074057e_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_6f55f71df996521957d4975850a03f60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a9df2b8-7c08-5966-be0f-591af074057e/4a9df2b8-7c08-5966-be0f-591af074057e_image_15.png',
             'Extension': 'png',
             'FileSizeInBytes': 113196,
             'Height': 525,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/be/c3be27b6261d9847ba839edb8d43f377/pa/ZH57094_03a7072a874f263fabb4b92a59282d39.png',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-29',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Peugeot Boxer 2.0 Blue-HDi 333 L3H2 Pro BlueHDi 160',
 'transmission': 'manual',
 'trim': '333 L3H2 Pro BlueHDi 160',
 'year': 2019}
2026-01-29 06:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZH57094%27 HTTP/1.1" 200 None
2026-01-29 06:03:22 [auto1.fr] INFO: Saving data for ZH57094: {'created_time': 1769666602.989225, 'last_price_update_time': 1769666602.989238, 'auction_closing_time': 1769705405.0}
2026-01-29 06:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZH57094') HTTP/1.1" 204 0
2026-01-29 06:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_e24f6d5689aec4e57cb7a4fa7938821d.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F93%252F2693cda41323c87cb0eb7c1c8c926a70%252Fpa%252FNS66111_e28c990cbd09c320fb169122600bbcf9.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_e28c990cbd09c320fb169122600bbcf9.jpg not downloaded yet
2026-01-29 06:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f47c610>
2026-01-29 06:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23739264-4f6d-59e2-b61e-61310693cdd1/23739264-4f6d-59e2-b61e-61310693cdd1_image_11.jpg HTTP/1.1" 201 0
2026-01-29 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fa7%252Feda74badf47d0358e82583630100dd51%252Fpa%252FSA16378_b3c1322d65f3278c7f6c5611c4201daa.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_b3c1322d65f3278c7f6c5611c4201daa.jpg saved to cache
2026-01-29 06:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 23739264-4f6d-59e2-b61e-61310693cdd1
2026-01-29 06:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f3f2650>
2026-01-29 06:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1d7377b-9af9-5c96-8031-2a907dc53a6a/c1d7377b-9af9-5c96-8031-2a907dc53a6a_image_2.jpg HTTP/1.1" 201 0
2026-01-29 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff0%252Fb1f07102e6b2523a36ff46d7b3fbd390%252Fpa%252FFV47029_c9ae30db06576ecaa1805ffb727cf3fc.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_c9ae30db06576ecaa1805ffb727cf3fc.jpg saved to cache
2026-01-29 06:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c1d7377b-9af9-5c96-8031-2a907dc53a6a
2026-01-29 06:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f3f25d0>
2026-01-29 06:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23739264-4f6d-59e2-b61e-61310693cdd1/23739264-4f6d-59e2-b61e-61310693cdd1_image_10.jpg HTTP/1.1" 201 0
2026-01-29 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fa7%252Feda74badf47d0358e82583630100dd51%252Fpa%252FSA16378_c2ceda50e6e26e2fbda02f6e79f42340.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_c2ceda50e6e26e2fbda02f6e79f42340.jpg saved to cache
2026-01-29 06:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 23739264-4f6d-59e2-b61e-61310693cdd1
2026-01-29 06:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c288050>
2026-01-29 06:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1d7377b-9af9-5c96-8031-2a907dc53a6a/c1d7377b-9af9-5c96-8031-2a907dc53a6a_image_1.jpg HTTP/1.1" 201 0
2026-01-29 06:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff0%252Fb1f07102e6b2523a36ff46d7b3fbd390%252Fpa%252FFV47029_b9ff03276bcf9941b3dc0fb57df7d39a.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_b9ff03276bcf9941b3dc0fb57df7d39a.jpg saved to cache
2026-01-29 06:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c1d7377b-9af9-5c96-8031-2a907dc53a6a
2026-01-29 06:03:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66f7e6a2-0a6d-553f-b185-90432f042f62 with identifier: ER42739
2026-01-29 06:03:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66f7e6a2-0a6d-553f-b185-90432f042f62 with scrape type 2
2026-01-29 06:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66f7e6a2-0a6d-553f-b185-90432f042f62 with scrape type 2
2026-01-29 06:03:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 66f7e6a2-0a6d-553f-b185-90432f042f62, identifier: ER42739
2026-01-29 06:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WN92685/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UF99896> (referer: https://www.auto1.com/v1/car-details-view/UF99896/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 66f7e6a2-0a6d-553f-b185-90432f042f62 with identifier: ER42739
2026-01-29 06:03:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 66f7e6a2-0a6d-553f-b185-90432f042f62 with identifier: ER42739
2026-01-29 06:03:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'fiat 500 1.2 lounge', 'price': 0, 'currency': 'eur', 'make': 'fiat', 'model': '500', 'transmission': 'manual', 'odometer': 77265, 'odometer_reading_unit': 'km', 'registration_date': '2017-11-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/er42739', 'expiration_date': '2026-01-29t16:30:27z', 'origin_country_code': 'fr', 'trim': 'lounge', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 70, 'doors_number': 3, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, allennes-les-marais', 'category': None, 'seats_number': 4, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 115, 'id': '66f7e6a2-0a6d-553f-b185-90432f042f62', 'current_year_diff': 9, 'age_in_months': 98, 'make_model': 'fiat 500', 'sanitized_make': 'fiat', 'odometer_in_km': 77265}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 98,
     'auction_title': '',
     'c_o_2_emission_value': 115,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 3,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 70,
     'expiration_date': '2026-01-29t16:30:27z',
     'fuel_type': 'petrol',
     'id': '66f7e6a2-0a6d-553f-b185-90432f042f62',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/er42739',
     'listing': 'auction',
     'location': 'fr, allennes-les-marais',
     'make': 'fiat',
     'make_model': 'fiat 500',
     'model': '500',
     'odometer': 77265,
     'odometer_in_km': 77265,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-11-29',
     'sanitized_make': 'fiat',
     'seats_number': 4,
     'seller_name': None,
     'title': 'fiat 500 1.2 lounge',
     'transmission': 'manual',
     'trim': 'lounge',
     'year': 2017}
2026-01-29 06:03:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 66f7e6a2-0a6d-553f-b185-90432f042f62 spider: auto1.fr
2026-01-29 06:03:24 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 66f7e6a2-0a6d-553f-b185-90432f042f62 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'fiat 500 1.2 lounge', 'price': 0, 'currency': 'eur', 'make': 'fiat', 'model': '500', 'transmission': 'manual', 'odometer': 77265, 'odometer_reading_unit': 'km', 'registration_date': '2017-11-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/er42739', 'expiration_date': '2026-01-29t16:30:27z', 'origin_country_code': 'fr', 'trim': 'lounge', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 70, 'doors_number': 3, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, allennes-les-marais', 'category': None, 'seats_number': 4, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 115, 'id': '66f7e6a2-0a6d-553f-b185-90432f042f62', 'current_year_diff': 9, 'age_in_months': 98, 'make_model': 'fiat 500', 'sanitized_make': 'fiat', 'odometer_in_km': 77265}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 98,
     'auction_title': '',
     'c_o_2_emission_value': 115,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 3,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 70,
     'expiration_date': '2026-01-29t16:30:27z',
     'fuel_type': 'petrol',
     'id': '66f7e6a2-0a6d-553f-b185-90432f042f62',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/er42739',
     'listing': 'auction',
     'location': 'fr, allennes-les-marais',
     'make': 'fiat',
     'make_model': 'fiat 500',
     'model': '500',
     'odometer': 77265,
     'odometer_in_km': 77265,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-11-29',
     'sanitized_make': 'fiat',
     'seats_number': 4,
     'seller_name': None,
     'title': 'fiat 500 1.2 lounge',
     'transmission': 'manual',
     'trim': 'lounge',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-01-29T16:30:27Z',
 'fuel_type': 'petrol',
 'id': '66f7e6a2-0a6d-553f-b185-90432f042f62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER42739',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'make': 'Fiat',
 'model': '500',
 'odometer': 77265,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2017}
2026-01-29 06:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER42739%27 HTTP/1.1" 200 None
2026-01-29 06:03:24 [auto1.fr] INFO: Saving data for ER42739: {'auction_closing_time': 1769704227.0, 'created_time': 1769447589.38795, 'last_price_update_time': 1769666604.801085}
2026-01-29 06:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ER42739') HTTP/1.1" 204 0
2026-01-29 06:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c0950d0>
2026-01-29 06:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23739264-4f6d-59e2-b61e-61310693cdd1/23739264-4f6d-59e2-b61e-61310693cdd1_image_9.jpg HTTP/1.1" 201 0
2026-01-29 06:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fa7%252Feda74badf47d0358e82583630100dd51%252Fpa%252FSA16378_cd7ecf7054331e6988ad779e3d6971e4.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_cd7ecf7054331e6988ad779e3d6971e4.jpg saved to cache
2026-01-29 06:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 23739264-4f6d-59e2-b61e-61310693cdd1
2026-01-29 06:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F93%252F2693cda41323c87cb0eb7c1c8c926a70%252Fpa%252FNS66111_ec7b11763f53f31a2dab3a2e7b5b033f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_ec7b11763f53f31a2dab3a2e7b5b033f.jpg not downloaded yet
2026-01-29 06:03:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_5d6ee3919a1c2b609f486abc52d084bb.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f52c2d0>
2026-01-29 06:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23739264-4f6d-59e2-b61e-61310693cdd1/23739264-4f6d-59e2-b61e-61310693cdd1_image_2.jpg HTTP/1.1" 201 0
2026-01-29 06:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fa7%252Feda74badf47d0358e82583630100dd51%252Fpa%252FSA16378_33fe3ac1771aa7ff2a9069ed4dd28d26.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_33fe3ac1771aa7ff2a9069ed4dd28d26.jpg saved to cache
2026-01-29 06:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 23739264-4f6d-59e2-b61e-61310693cdd1
2026-01-29 06:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f35bc90>
2026-01-29 06:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1d7377b-9af9-5c96-8031-2a907dc53a6a/c1d7377b-9af9-5c96-8031-2a907dc53a6a_image_0.jpg HTTP/1.1" 201 0
2026-01-29 06:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Ff0%252Fb1f07102e6b2523a36ff46d7b3fbd390%252Fpa%252FFV47029_68d2097e82d660cbfedc71bb9be8b4fa.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_68d2097e82d660cbfedc71bb9be8b4fa.jpg saved to cache
2026-01-29 06:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c1d7377b-9af9-5c96-8031-2a907dc53a6a
2026-01-29 06:03:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c1d7377b-9af9-5c96-8031-2a907dc53a6a, skipping ID generation
2026-01-29 06:03:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1d7377b-9af9-5c96-8031-2a907dc53a6a with scrape type 1
2026-01-29 06:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c1d7377b-9af9-5c96-8031-2a907dc53a6a from tracking dictionaries
2026-01-29 06:03:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c1d7377b-9af9-5c96-8031-2a907dc53a6a sending to next pipeline
2026-01-29 06:03:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c1d7377b-9af9-5c96-8031-2a907dc53a6a, identifier: FV47029
2026-01-29 06:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f4ca810>
2026-01-29 06:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23739264-4f6d-59e2-b61e-61310693cdd1/23739264-4f6d-59e2-b61e-61310693cdd1_image_5.jpg HTTP/1.1" 201 0
2026-01-29 06:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fa7%252Feda74badf47d0358e82583630100dd51%252Fpa%252FSA16378_bcc5ec32581de62097c45d4f76c30164.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_bcc5ec32581de62097c45d4f76c30164.jpg saved to cache
2026-01-29 06:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 23739264-4f6d-59e2-b61e-61310693cdd1
2026-01-29 06:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6fe6ded0>
2026-01-29 06:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23739264-4f6d-59e2-b61e-61310693cdd1/23739264-4f6d-59e2-b61e-61310693cdd1_image_0.jpg HTTP/1.1" 201 0
2026-01-29 06:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fa7%252Feda74badf47d0358e82583630100dd51%252Fpa%252FSA16378_e24f6d5689aec4e57cb7a4fa7938821d.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_e24f6d5689aec4e57cb7a4fa7938821d.jpg saved to cache
2026-01-29 06:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 23739264-4f6d-59e2-b61e-61310693cdd1
2026-01-29 06:03:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 23739264-4f6d-59e2-b61e-61310693cdd1, skipping ID generation
2026-01-29 06:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23739264-4f6d-59e2-b61e-61310693cdd1 with scrape type 1
2026-01-29 06:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 23739264-4f6d-59e2-b61e-61310693cdd1 from tracking dictionaries
2026-01-29 06:03:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 23739264-4f6d-59e2-b61e-61310693cdd1 sending to next pipeline
2026-01-29 06:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 23739264-4f6d-59e2-b61e-61310693cdd1, identifier: SA16378
2026-01-29 06:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F93%252F2693cda41323c87cb0eb7c1c8c926a70%252Fpa%252FNS66111_572c2e90ec122a8a05b7eaf6f71c5003.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_572c2e90ec122a8a05b7eaf6f71c5003.jpg not downloaded yet
2026-01-29 06:03:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c1d7377b-9af9-5c96-8031-2a907dc53a6a with identifier: FV47029
2026-01-29 06:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c1d7377b-9af9-5c96-8031-2a907dc53a6a with identifier: FV47029
2026-01-29 06:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 152344 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    152344
2026-01-29 06:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c1d7377b-9af9-5c96-8031-2a907dc53a6a spider: auto1.fr
2026-01-29 06:03:27 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: c1d7377b-9af9-5c96-8031-2a907dc53a6a due to rule: high_mileage_for_country.json, error: 152344 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    152344
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 160,
 'expiration_date': '2026-01-29T16:08:01Z',
 'fuel_type': 'diesel',
 'id': 'c1d7377b-9af9-5c96-8031-2a907dc53a6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV47029',
 'listing': 'auction',
 'location': 'FR, Marsannay-la-Côte',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 152344,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1d7377b-9af9-5c96-8031-2a907dc53a6a/c1d7377b-9af9-5c96-8031-2a907dc53a6a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_68d2097e82d660cbfedc71bb9be8b4fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1d7377b-9af9-5c96-8031-2a907dc53a6a/c1d7377b-9af9-5c96-8031-2a907dc53a6a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_b9ff03276bcf9941b3dc0fb57df7d39a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1d7377b-9af9-5c96-8031-2a907dc53a6a/c1d7377b-9af9-5c96-8031-2a907dc53a6a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_c9ae30db06576ecaa1805ffb727cf3fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1d7377b-9af9-5c96-8031-2a907dc53a6a/c1d7377b-9af9-5c96-8031-2a907dc53a6a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_a019acb068cb171700c7b12b5c32ee48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1d7377b-9af9-5c96-8031-2a907dc53a6a/c1d7377b-9af9-5c96-8031-2a907dc53a6a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_92adab970f19b7966893fc35f6504674.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1d7377b-9af9-5c96-8031-2a907dc53a6a/c1d7377b-9af9-5c96-8031-2a907dc53a6a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_e13338601d80d46d0c2097cb8aa45c67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1d7377b-9af9-5c96-8031-2a907dc53a6a/c1d7377b-9af9-5c96-8031-2a907dc53a6a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_25d22a409d85b1e3da9b2ea6c72c7a92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1d7377b-9af9-5c96-8031-2a907dc53a6a/c1d7377b-9af9-5c96-8031-2a907dc53a6a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_7f20bbdab0302477421a48959af0a4a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1d7377b-9af9-5c96-8031-2a907dc53a6a/c1d7377b-9af9-5c96-8031-2a907dc53a6a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65885,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_580fe17e316d0fc1e61a1f515ba9890c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1d7377b-9af9-5c96-8031-2a907dc53a6a/c1d7377b-9af9-5c96-8031-2a907dc53a6a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_28df8bfe9918753e6a85dbb9a57373a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1d7377b-9af9-5c96-8031-2a907dc53a6a/c1d7377b-9af9-5c96-8031-2a907dc53a6a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_5f5a4898992a6f405da9fd190565ebc2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1d7377b-9af9-5c96-8031-2a907dc53a6a/c1d7377b-9af9-5c96-8031-2a907dc53a6a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_31b82a9448ec3994921106aa79f6fb0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1d7377b-9af9-5c96-8031-2a907dc53a6a/c1d7377b-9af9-5c96-8031-2a907dc53a6a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_75bb57af1e8fa160133625f406826ece.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1d7377b-9af9-5c96-8031-2a907dc53a6a/c1d7377b-9af9-5c96-8031-2a907dc53a6a_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_0e8571629b67742f701429b59d9adf95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1d7377b-9af9-5c96-8031-2a907dc53a6a/c1d7377b-9af9-5c96-8031-2a907dc53a6a_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_05f8062a9da3b794be54ebb145f55ff1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1d7377b-9af9-5c96-8031-2a907dc53a6a/c1d7377b-9af9-5c96-8031-2a907dc53a6a_image_15.png',
             'Extension': 'png',
             'FileSizeInBytes': 111418,
             'Height': 525,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/f0/b1f07102e6b2523a36ff46d7b3fbd390/pa/FV47029_bc4f941be73b087fa295089e784af21a.png',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-19',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Renault Espace 1.6 dCi Energy Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2017}
2026-01-29 06:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV47029%27 HTTP/1.1" 200 None
2026-01-29 06:03:27 [auto1.fr] INFO: Saving data for FV47029: {'created_time': 1769666607.037516, 'last_price_update_time': 1769666607.037526, 'auction_closing_time': 1769702881.0}
2026-01-29 06:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FV47029') HTTP/1.1" 204 0
2026-01-29 06:03:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 23739264-4f6d-59e2-b61e-61310693cdd1 with identifier: SA16378
2026-01-29 06:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 23739264-4f6d-59e2-b61e-61310693cdd1 with identifier: SA16378
2026-01-29 06:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 103109 is greater than the maximum of 100000

Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
    {'maximum': 100000, 'type': 'integer'}

On instance['odometer_in_km']:
    103109
2026-01-29 06:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 23739264-4f6d-59e2-b61e-61310693cdd1 spider: auto1.fr
2026-01-29 06:03:27 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 23739264-4f6d-59e2-b61e-61310693cdd1 due to rule: high_mileage_for_make.json, error: 103109 is greater than the maximum of 100000

Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
    {'maximum': 100000, 'type': 'integer'}

On instance['odometer_in_km']:
    103109
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 299,
 'expiration_date': '2026-01-29T16:21:43Z',
 'fuel_type': 'electro',
 'id': '23739264-4f6d-59e2-b61e-61310693cdd1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA16378',
 'listing': 'auction',
 'location': 'FR, Evreux',
 'make': 'Tesla',
 'model': 'Model Y',
 'odometer': 103109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23739264-4f6d-59e2-b61e-61310693cdd1/23739264-4f6d-59e2-b61e-61310693cdd1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_e24f6d5689aec4e57cb7a4fa7938821d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23739264-4f6d-59e2-b61e-61310693cdd1/23739264-4f6d-59e2-b61e-61310693cdd1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62328,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_cbe3974f2c0f5193695e44693c9d4e75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23739264-4f6d-59e2-b61e-61310693cdd1/23739264-4f6d-59e2-b61e-61310693cdd1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58717,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_33fe3ac1771aa7ff2a9069ed4dd28d26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23739264-4f6d-59e2-b61e-61310693cdd1/23739264-4f6d-59e2-b61e-61310693cdd1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_7b815ce09937b0d5a664476ba1c85108.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23739264-4f6d-59e2-b61e-61310693cdd1/23739264-4f6d-59e2-b61e-61310693cdd1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62259,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_f81c83f7f4b142b178d69d48132d7abd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23739264-4f6d-59e2-b61e-61310693cdd1/23739264-4f6d-59e2-b61e-61310693cdd1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_bcc5ec32581de62097c45d4f76c30164.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23739264-4f6d-59e2-b61e-61310693cdd1/23739264-4f6d-59e2-b61e-61310693cdd1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_42f093a930c261a22addc324bd57d8c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23739264-4f6d-59e2-b61e-61310693cdd1/23739264-4f6d-59e2-b61e-61310693cdd1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_ebf814a8b00d19df365bc2e9c29d9f40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23739264-4f6d-59e2-b61e-61310693cdd1/23739264-4f6d-59e2-b61e-61310693cdd1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_292f7b1f84c3386ffddff463f9847576.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23739264-4f6d-59e2-b61e-61310693cdd1/23739264-4f6d-59e2-b61e-61310693cdd1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_cd7ecf7054331e6988ad779e3d6971e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23739264-4f6d-59e2-b61e-61310693cdd1/23739264-4f6d-59e2-b61e-61310693cdd1_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_c2ceda50e6e26e2fbda02f6e79f42340.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23739264-4f6d-59e2-b61e-61310693cdd1/23739264-4f6d-59e2-b61e-61310693cdd1_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_b3c1322d65f3278c7f6c5611c4201daa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23739264-4f6d-59e2-b61e-61310693cdd1/23739264-4f6d-59e2-b61e-61310693cdd1_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52824,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_524a1d715a1a2ab86c51a17041d9e2ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23739264-4f6d-59e2-b61e-61310693cdd1/23739264-4f6d-59e2-b61e-61310693cdd1_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_aa67fc451d0074f9068a0b5d83cbb2b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23739264-4f6d-59e2-b61e-61310693cdd1/23739264-4f6d-59e2-b61e-61310693cdd1_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40508,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_d5cc30b96d14d95f0530dd6d4f912aa5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23739264-4f6d-59e2-b61e-61310693cdd1/23739264-4f6d-59e2-b61e-61310693cdd1_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/a7/eda74badf47d0358e82583630100dd51/pa/SA16378_b3c671b436a01660c9b7dd29a61aa35b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-11-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Tesla Model Y Standard Range',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-01-29 06:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SA16378%27 HTTP/1.1" 200 None
2026-01-29 06:03:27 [auto1.fr] INFO: Saving data for SA16378: {'created_time': 1769666607.321617, 'last_price_update_time': 1769666607.321631, 'auction_closing_time': 1769703703.0}
2026-01-29 06:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SA16378') HTTP/1.1" 204 0
2026-01-29 06:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_4ebdf75f5e9027f4e4530a661e2369e4.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 886a1040-1c8a-5d43-ad11-b235b82e2a31 with identifier: UF99896
2026-01-29 06:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 886a1040-1c8a-5d43-ad11-b235b82e2a31 with scrape type 1
2026-01-29 06:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 886a1040-1c8a-5d43-ad11-b235b82e2a31
2026-01-29 06:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F49%252F60494679e96cf09efbf03a60ea089aa5%252Fpa%252FUF99896_2a01d39ca2ea53b9c6ba91440984395b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_2a01d39ca2ea53b9c6ba91440984395b.jpg not downloaded yet
2026-01-29 06:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F93%252F2693cda41323c87cb0eb7c1c8c926a70%252Fpa%252FNS66111_d5a85bcc3b9d9cc4094c7fbd7d6c5835.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_d5a85bcc3b9d9cc4094c7fbd7d6c5835.jpg not downloaded yet
2026-01-29 06:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff77b90>
2026-01-29 06:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcf229a0-4638-5196-9e49-efe252c9723f/dcf229a0-4638-5196-9e49-efe252c9723f_image_0.jpg HTTP/1.1" 201 0
2026-01-29 06:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F93%252F2693cda41323c87cb0eb7c1c8c926a70%252Fpa%252FNS66111_5d6ee3919a1c2b609f486abc52d084bb.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_5d6ee3919a1c2b609f486abc52d084bb.jpg saved to cache
2026-01-29 06:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dcf229a0-4638-5196-9e49-efe252c9723f
2026-01-29 06:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F49%252F60494679e96cf09efbf03a60ea089aa5%252Fpa%252FUF99896_dfae01e054a0fd74b87b9ce42b7862c5.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_dfae01e054a0fd74b87b9ce42b7862c5.jpg not downloaded yet
2026-01-29 06:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_ec7b11763f53f31a2dab3a2e7b5b033f.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F93%252F2693cda41323c87cb0eb7c1c8c926a70%252Fpa%252FNS66111_ec15123128259ba2b672c941b9ea67ec.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_ec15123128259ba2b672c941b9ea67ec.jpg not downloaded yet
2026-01-29 06:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_e28c990cbd09c320fb169122600bbcf9.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F49%252F60494679e96cf09efbf03a60ea089aa5%252Fpa%252FUF99896_1245176e5ae4820e219c9c614ff9db20.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_1245176e5ae4820e219c9c614ff9db20.jpg not downloaded yet
2026-01-29 06:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6fe48f90>
2026-01-29 06:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcf229a0-4638-5196-9e49-efe252c9723f/dcf229a0-4638-5196-9e49-efe252c9723f_image_1.jpg HTTP/1.1" 201 0
2026-01-29 06:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F93%252F2693cda41323c87cb0eb7c1c8c926a70%252Fpa%252FNS66111_4ebdf75f5e9027f4e4530a661e2369e4.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_4ebdf75f5e9027f4e4530a661e2369e4.jpg saved to cache
2026-01-29 06:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dcf229a0-4638-5196-9e49-efe252c9723f
2026-01-29 06:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F93%252F2693cda41323c87cb0eb7c1c8c926a70%252Fpa%252FNS66111_831279b899c455fc87b1ff708163b5a5.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_831279b899c455fc87b1ff708163b5a5.jpg not downloaded yet
2026-01-29 06:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_572c2e90ec122a8a05b7eaf6f71c5003.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F49%252F60494679e96cf09efbf03a60ea089aa5%252Fpa%252FUF99896_59d9e66f8f9c57996b2fb63e50abe0b7.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_59d9e66f8f9c57996b2fb63e50abe0b7.jpg not downloaded yet
2026-01-29 06:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F93%252F2693cda41323c87cb0eb7c1c8c926a70%252Fpa%252FNS66111_09f62f10301947bc277719d8749fda6f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_09f62f10301947bc277719d8749fda6f.jpg not downloaded yet
2026-01-29 06:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c0eb110>
2026-01-29 06:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcf229a0-4638-5196-9e49-efe252c9723f/dcf229a0-4638-5196-9e49-efe252c9723f_image_3.jpg HTTP/1.1" 201 0
2026-01-29 06:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F93%252F2693cda41323c87cb0eb7c1c8c926a70%252Fpa%252FNS66111_ec7b11763f53f31a2dab3a2e7b5b033f.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_ec7b11763f53f31a2dab3a2e7b5b033f.jpg saved to cache
2026-01-29 06:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dcf229a0-4638-5196-9e49-efe252c9723f
2026-01-29 06:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c27c590>
2026-01-29 06:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcf229a0-4638-5196-9e49-efe252c9723f/dcf229a0-4638-5196-9e49-efe252c9723f_image_2.jpg HTTP/1.1" 201 0
2026-01-29 06:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F93%252F2693cda41323c87cb0eb7c1c8c926a70%252Fpa%252FNS66111_e28c990cbd09c320fb169122600bbcf9.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_e28c990cbd09c320fb169122600bbcf9.jpg saved to cache
2026-01-29 06:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dcf229a0-4638-5196-9e49-efe252c9723f
2026-01-29 06:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F49%252F60494679e96cf09efbf03a60ea089aa5%252Fpa%252FUF99896_a9f1fb766f39e42d823f3910ea0d9e75.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_a9f1fb766f39e42d823f3910ea0d9e75.jpg not downloaded yet
2026-01-29 06:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_dfae01e054a0fd74b87b9ce42b7862c5.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F93%252F2693cda41323c87cb0eb7c1c8c926a70%252Fpa%252FNS66111_2a44c9b61af8f6756380e5da0fe3c771.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_2a44c9b61af8f6756380e5da0fe3c771.jpg not downloaded yet
2026-01-29 06:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WT08030/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_d5a85bcc3b9d9cc4094c7fbd7d6c5835.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F49%252F60494679e96cf09efbf03a60ea089aa5%252Fpa%252FUF99896_3a3b5bf9441fc78ddc8e6693dc5efc96.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_3a3b5bf9441fc78ddc8e6693dc5efc96.jpg not downloaded yet
2026-01-29 06:03:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BP20652/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PV20302/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YA10266/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DL43817/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6fe62810>
2026-01-29 06:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcf229a0-4638-5196-9e49-efe252c9723f/dcf229a0-4638-5196-9e49-efe252c9723f_image_4.jpg HTTP/1.1" 201 0
2026-01-29 06:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F93%252F2693cda41323c87cb0eb7c1c8c926a70%252Fpa%252FNS66111_572c2e90ec122a8a05b7eaf6f71c5003.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_572c2e90ec122a8a05b7eaf6f71c5003.jpg saved to cache
2026-01-29 06:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dcf229a0-4638-5196-9e49-efe252c9723f
2026-01-29 06:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F93%252F2693cda41323c87cb0eb7c1c8c926a70%252Fpa%252FNS66111_12538a5665b29b3153692b3fc72f0935.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_12538a5665b29b3153692b3fc72f0935.jpg not downloaded yet
2026-01-29 06:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F49%252F60494679e96cf09efbf03a60ea089aa5%252Fpa%252FUF99896_e239d3fe039fca857b9a717f6634c3c4.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_e239d3fe039fca857b9a717f6634c3c4.jpg not downloaded yet
2026-01-29 06:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NV25263> (referer: https://www.auto1.com/v1/car-details-view/NV25263/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_831279b899c455fc87b1ff708163b5a5.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F93%252F2693cda41323c87cb0eb7c1c8c926a70%252Fpa%252FNS66111_e4deb7f5721d5ccb19bb018c0659a107.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_e4deb7f5721d5ccb19bb018c0659a107.jpg not downloaded yet
2026-01-29 06:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EH94085> (referer: https://www.auto1.com/v1/car-details-view/EH94085/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f464090>
2026-01-29 06:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_1.jpg HTTP/1.1" 201 0
2026-01-29 06:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F49%252F60494679e96cf09efbf03a60ea089aa5%252Fpa%252FUF99896_dfae01e054a0fd74b87b9ce42b7862c5.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_dfae01e054a0fd74b87b9ce42b7862c5.jpg saved to cache
2026-01-29 06:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 886a1040-1c8a-5d43-ad11-b235b82e2a31
2026-01-29 06:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f316e10>
2026-01-29 06:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcf229a0-4638-5196-9e49-efe252c9723f/dcf229a0-4638-5196-9e49-efe252c9723f_image_5.jpg HTTP/1.1" 201 0
2026-01-29 06:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F93%252F2693cda41323c87cb0eb7c1c8c926a70%252Fpa%252FNS66111_d5a85bcc3b9d9cc4094c7fbd7d6c5835.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_d5a85bcc3b9d9cc4094c7fbd7d6c5835.jpg saved to cache
2026-01-29 06:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dcf229a0-4638-5196-9e49-efe252c9723f
2026-01-29 06:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_59d9e66f8f9c57996b2fb63e50abe0b7.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F49%252F60494679e96cf09efbf03a60ea089aa5%252Fpa%252FUF99896_7e858d31164096cab3c0acb6b3be6121.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_7e858d31164096cab3c0acb6b3be6121.jpg not downloaded yet
2026-01-29 06:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_2a44c9b61af8f6756380e5da0fe3c771.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_ec15123128259ba2b672c941b9ea67ec.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F93%252F2693cda41323c87cb0eb7c1c8c926a70%252Fpa%252FNS66111_443fe30f858f8b3a82e6e9e1038fc04b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_443fe30f858f8b3a82e6e9e1038fc04b.jpg not downloaded yet
2026-01-29 06:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_09f62f10301947bc277719d8749fda6f.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_a9f1fb766f39e42d823f3910ea0d9e75.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_1245176e5ae4820e219c9c614ff9db20.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_2a01d39ca2ea53b9c6ba91440984395b.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F49%252F60494679e96cf09efbf03a60ea089aa5%252Fpa%252FUF99896_8a64a48cbf17f26eb1c92bf775cf5631.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_8a64a48cbf17f26eb1c92bf775cf5631.jpg not downloaded yet
2026-01-29 06:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e51d426-0712-58db-a19d-f9290fa32bee with identifier: NV25263
2026-01-29 06:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e51d426-0712-58db-a19d-f9290fa32bee with scrape type 2
2026-01-29 06:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e51d426-0712-58db-a19d-f9290fa32bee with scrape type 2
2026-01-29 06:03:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5e51d426-0712-58db-a19d-f9290fa32bee, identifier: NV25263
2026-01-29 06:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f579090>
2026-01-29 06:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcf229a0-4638-5196-9e49-efe252c9723f/dcf229a0-4638-5196-9e49-efe252c9723f_image_7.jpg HTTP/1.1" 201 0
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F93%252F2693cda41323c87cb0eb7c1c8c926a70%252Fpa%252FNS66111_831279b899c455fc87b1ff708163b5a5.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_831279b899c455fc87b1ff708163b5a5.jpg saved to cache
2026-01-29 06:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dcf229a0-4638-5196-9e49-efe252c9723f
2026-01-29 06:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ffae67d-dbf9-5bd3-b8b1-d04d58332d19 with identifier: EH94085
2026-01-29 06:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ffae67d-dbf9-5bd3-b8b1-d04d58332d19 with scrape type 1
2026-01-29 06:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 6ffae67d-dbf9-5bd3-b8b1-d04d58332d19
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F5c%252F5b5c2190ff5e0b33bce9f83f3b682dd4%252Fpa%252FEH94085_8b46e5ad67e9531502e23d6819c0d700.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_8b46e5ad67e9531502e23d6819c0d700.jpg already downloaded
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F5c%252F5b5c2190ff5e0b33bce9f83f3b682dd4%252Fpa%252FEH94085_dd08f861ace1171b8db73e8d62625ad5.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_dd08f861ace1171b8db73e8d62625ad5.jpg already downloaded
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F5c%252F5b5c2190ff5e0b33bce9f83f3b682dd4%252Fpa%252FEH94085_27b81131010c7ad5753a555276946648.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_27b81131010c7ad5753a555276946648.jpg already downloaded
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F5c%252F5b5c2190ff5e0b33bce9f83f3b682dd4%252Fpa%252FEH94085_7cfb7d8846b407abe4521ee14d2d12f0.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_7cfb7d8846b407abe4521ee14d2d12f0.jpg already downloaded
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F5c%252F5b5c2190ff5e0b33bce9f83f3b682dd4%252Fpa%252FEH94085_3ea2ebf44a28a92c736668a5bf075cfc.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_3ea2ebf44a28a92c736668a5bf075cfc.jpg already downloaded
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F5c%252F5b5c2190ff5e0b33bce9f83f3b682dd4%252Fpa%252FEH94085_db6016a45a975bbdf80017cd473b742f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_db6016a45a975bbdf80017cd473b742f.jpg already downloaded
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F5c%252F5b5c2190ff5e0b33bce9f83f3b682dd4%252Fpa%252FEH94085_f6d54143f34313153fd3697c3f5b4775.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_f6d54143f34313153fd3697c3f5b4775.jpg already downloaded
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F5c%252F5b5c2190ff5e0b33bce9f83f3b682dd4%252Fpa%252FEH94085_b9ddd8296a5eb3df35b6c14482637b84.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_b9ddd8296a5eb3df35b6c14482637b84.jpg already downloaded
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F5c%252F5b5c2190ff5e0b33bce9f83f3b682dd4%252Fpa%252FEH94085_998b676ddc06d212d356c559c65a14f7.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_998b676ddc06d212d356c559c65a14f7.jpg already downloaded
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F5c%252F5b5c2190ff5e0b33bce9f83f3b682dd4%252Fpa%252FEH94085_2c8fd869ab84292fe437c1b63175e5b2.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_2c8fd869ab84292fe437c1b63175e5b2.jpg already downloaded
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F5c%252F5b5c2190ff5e0b33bce9f83f3b682dd4%252Fpa%252FEH94085_05e6b2d4940f129b78ca4f9297d7c8f8.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_05e6b2d4940f129b78ca4f9297d7c8f8.jpg already downloaded
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F5c%252F5b5c2190ff5e0b33bce9f83f3b682dd4%252Fpa%252FEH94085_9f50422bcbeb96c76d25c09044f7f5bb.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_9f50422bcbeb96c76d25c09044f7f5bb.jpg already downloaded
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F5c%252F5b5c2190ff5e0b33bce9f83f3b682dd4%252Fpa%252FEH94085_80e8b78bcb5f753c5170778100fbf9e5.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_80e8b78bcb5f753c5170778100fbf9e5.jpg already downloaded
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F5c%252F5b5c2190ff5e0b33bce9f83f3b682dd4%252Fpa%252FEH94085_ef50fcc5f38f727512e7ce7977babe63.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_ef50fcc5f38f727512e7ce7977babe63.jpg already downloaded
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F5c%252F5b5c2190ff5e0b33bce9f83f3b682dd4%252Fpa%252FEH94085_4edab5a061db0fc0a1c598c3c2c37fe4.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_4edab5a061db0fc0a1c598c3c2c37fe4.jpg already downloaded
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F5c%252F5b5c2190ff5e0b33bce9f83f3b682dd4%252Fpa%252FEH94085_0fb433491bb0bd00628795cfadae46de.png%27 HTTP/1.1" 200 None
2026-01-29 06:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_0fb433491bb0bd00628795cfadae46de.png already downloaded
2026-01-29 06:03:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6ffae67d-dbf9-5bd3-b8b1-d04d58332d19, identifier: EH94085
2026-01-29 06:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_3a3b5bf9441fc78ddc8e6693dc5efc96.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F93%252F2693cda41323c87cb0eb7c1c8c926a70%252Fpa%252FNS66111_35c496f14c939b66eb75448e8301c8ea.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_35c496f14c939b66eb75448e8301c8ea.jpg not downloaded yet
2026-01-29 06:03:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5e51d426-0712-58db-a19d-f9290fa32bee with identifier: NV25263
2026-01-29 06:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5e51d426-0712-58db-a19d-f9290fa32bee with identifier: NV25263
2026-01-29 06:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
2026-01-29 06:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 5e51d426-0712-58db-a19d-f9290fa32bee spider: auto1.fr
2026-01-29 06:03:31 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 5e51d426-0712-58db-a19d-f9290fa32bee due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:25:27Z',
 'fuel_type': 'diesel',
 'id': '5e51d426-0712-58db-a19d-f9290fa32bee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV25263',
 'listing': 'auction',
 'location': 'FR, Warluis',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 156646,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-08',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Peugeot Expert 1.5 Blue-HDi Asphalt L2',
 'transmission': 'manual',
 'trim': 'Asphalt L2',
 'year': 2021}
2026-01-29 06:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NV25263%27 HTTP/1.1" 200 None
2026-01-29 06:03:31 [auto1.fr] INFO: Saving data for NV25263: {'auction_closing_time': 1769703927.0, 'created_time': 1767953669.520498, 'last_price_update_time': 1769666611.44813}
2026-01-29 06:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NV25263') HTTP/1.1" 204 0
2026-01-29 06:03:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6ffae67d-dbf9-5bd3-b8b1-d04d58332d19 with identifier: EH94085
2026-01-29 06:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6ffae67d-dbf9-5bd3-b8b1-d04d58332d19 with identifier: EH94085
2026-01-29 06:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 175755 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    175755
2026-01-29 06:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 6ffae67d-dbf9-5bd3-b8b1-d04d58332d19 spider: auto1.fr
2026-01-29 06:03:31 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 6ffae67d-dbf9-5bd3-b8b1-d04d58332d19 due to rule: high_mileage_for_country.json, error: 175755 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    175755
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:57:05Z',
 'fuel_type': 'diesel',
 'id': '6ffae67d-dbf9-5bd3-b8b1-d04d58332d19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH94085',
 'listing': 'auction',
 'location': 'FR, Boé',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 175755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_8b46e5ad67e9531502e23d6819c0d700.jpg',
                'https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_dd08f861ace1171b8db73e8d62625ad5.jpg',
                'https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_27b81131010c7ad5753a555276946648.jpg',
                'https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_7cfb7d8846b407abe4521ee14d2d12f0.jpg',
                'https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_3ea2ebf44a28a92c736668a5bf075cfc.jpg',
                'https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_db6016a45a975bbdf80017cd473b742f.jpg',
                'https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_f6d54143f34313153fd3697c3f5b4775.jpg',
                'https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_b9ddd8296a5eb3df35b6c14482637b84.jpg',
                'https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_998b676ddc06d212d356c559c65a14f7.jpg',
                'https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_2c8fd869ab84292fe437c1b63175e5b2.jpg',
                'https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_05e6b2d4940f129b78ca4f9297d7c8f8.jpg',
                'https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_9f50422bcbeb96c76d25c09044f7f5bb.jpg',
                'https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_80e8b78bcb5f753c5170778100fbf9e5.jpg',
                'https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_ef50fcc5f38f727512e7ce7977babe63.jpg',
                'https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_4edab5a061db0fc0a1c598c3c2c37fe4.jpg',
                'https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_0fb433491bb0bd00628795cfadae46de.png'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ffae67d-dbf9-5bd3-b8b1-d04d58332d19/6ffae67d-dbf9-5bd3-b8b1-d04d58332d19_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108157,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_8b46e5ad67e9531502e23d6819c0d700.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ffae67d-dbf9-5bd3-b8b1-d04d58332d19/6ffae67d-dbf9-5bd3-b8b1-d04d58332d19_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_dd08f861ace1171b8db73e8d62625ad5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ffae67d-dbf9-5bd3-b8b1-d04d58332d19/6ffae67d-dbf9-5bd3-b8b1-d04d58332d19_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_27b81131010c7ad5753a555276946648.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ffae67d-dbf9-5bd3-b8b1-d04d58332d19/6ffae67d-dbf9-5bd3-b8b1-d04d58332d19_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80765,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_7cfb7d8846b407abe4521ee14d2d12f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ffae67d-dbf9-5bd3-b8b1-d04d58332d19/6ffae67d-dbf9-5bd3-b8b1-d04d58332d19_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_3ea2ebf44a28a92c736668a5bf075cfc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ffae67d-dbf9-5bd3-b8b1-d04d58332d19/6ffae67d-dbf9-5bd3-b8b1-d04d58332d19_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_db6016a45a975bbdf80017cd473b742f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ffae67d-dbf9-5bd3-b8b1-d04d58332d19/6ffae67d-dbf9-5bd3-b8b1-d04d58332d19_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87420,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_f6d54143f34313153fd3697c3f5b4775.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ffae67d-dbf9-5bd3-b8b1-d04d58332d19/6ffae67d-dbf9-5bd3-b8b1-d04d58332d19_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_b9ddd8296a5eb3df35b6c14482637b84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ffae67d-dbf9-5bd3-b8b1-d04d58332d19/6ffae67d-dbf9-5bd3-b8b1-d04d58332d19_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98271,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_998b676ddc06d212d356c559c65a14f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ffae67d-dbf9-5bd3-b8b1-d04d58332d19/6ffae67d-dbf9-5bd3-b8b1-d04d58332d19_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87342,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_2c8fd869ab84292fe437c1b63175e5b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ffae67d-dbf9-5bd3-b8b1-d04d58332d19/6ffae67d-dbf9-5bd3-b8b1-d04d58332d19_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_05e6b2d4940f129b78ca4f9297d7c8f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ffae67d-dbf9-5bd3-b8b1-d04d58332d19/6ffae67d-dbf9-5bd3-b8b1-d04d58332d19_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_9f50422bcbeb96c76d25c09044f7f5bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ffae67d-dbf9-5bd3-b8b1-d04d58332d19/6ffae67d-dbf9-5bd3-b8b1-d04d58332d19_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_80e8b78bcb5f753c5170778100fbf9e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ffae67d-dbf9-5bd3-b8b1-d04d58332d19/6ffae67d-dbf9-5bd3-b8b1-d04d58332d19_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_ef50fcc5f38f727512e7ce7977babe63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ffae67d-dbf9-5bd3-b8b1-d04d58332d19/6ffae67d-dbf9-5bd3-b8b1-d04d58332d19_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_4edab5a061db0fc0a1c598c3c2c37fe4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ffae67d-dbf9-5bd3-b8b1-d04d58332d19/6ffae67d-dbf9-5bd3-b8b1-d04d58332d19_image_15.png',
             'Extension': 'png',
             'FileSizeInBytes': 129686,
             'Height': 525,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/5c/5b5c2190ff5e0b33bce9f83f3b682dd4/pa/EH94085_0fb433491bb0bd00628795cfadae46de.png',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.6 CRDi Design 2WD',
 'transmission': 'automatic',
 'trim': 'Design 2WD',
 'year': 2019}
2026-01-29 06:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EH94085%27 HTTP/1.1" 200 None
2026-01-29 06:03:31 [auto1.fr] INFO: Saving data for EH94085: {'created_time': 1769666611.72516, 'last_price_update_time': 1769666611.725171, 'auction_closing_time': 1769705825.0}
2026-01-29 06:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EH94085') HTTP/1.1" 204 0
2026-01-29 06:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_12538a5665b29b3153692b3fc72f0935.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F49%252F60494679e96cf09efbf03a60ea089aa5%252Fpa%252FUF99896_98b816ce581ed7093a523bcf4d75ff14.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_98b816ce581ed7093a523bcf4d75ff14.jpg not downloaded yet
2026-01-29 06:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_e239d3fe039fca857b9a717f6634c3c4.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F93%252F2693cda41323c87cb0eb7c1c8c926a70%252Fpa%252FNS66111_1ee36c7c0b1925711e305beb2f0fd7b5.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_1ee36c7c0b1925711e305beb2f0fd7b5.jpg not downloaded yet
2026-01-29 06:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZW66039/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f3f2690>
2026-01-29 06:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_3.jpg HTTP/1.1" 201 0
2026-01-29 06:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F49%252F60494679e96cf09efbf03a60ea089aa5%252Fpa%252FUF99896_59d9e66f8f9c57996b2fb63e50abe0b7.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_59d9e66f8f9c57996b2fb63e50abe0b7.jpg saved to cache
2026-01-29 06:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 886a1040-1c8a-5d43-ad11-b235b82e2a31
2026-01-29 06:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f3a7b50>
2026-01-29 06:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcf229a0-4638-5196-9e49-efe252c9723f/dcf229a0-4638-5196-9e49-efe252c9723f_image_9.jpg HTTP/1.1" 201 0
2026-01-29 06:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F93%252F2693cda41323c87cb0eb7c1c8c926a70%252Fpa%252FNS66111_2a44c9b61af8f6756380e5da0fe3c771.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_2a44c9b61af8f6756380e5da0fe3c771.jpg saved to cache
2026-01-29 06:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dcf229a0-4638-5196-9e49-efe252c9723f
2026-01-29 06:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f3a5ed0>
2026-01-29 06:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcf229a0-4638-5196-9e49-efe252c9723f/dcf229a0-4638-5196-9e49-efe252c9723f_image_6.jpg HTTP/1.1" 201 0
2026-01-29 06:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F93%252F2693cda41323c87cb0eb7c1c8c926a70%252Fpa%252FNS66111_ec15123128259ba2b672c941b9ea67ec.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_ec15123128259ba2b672c941b9ea67ec.jpg saved to cache
2026-01-29 06:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dcf229a0-4638-5196-9e49-efe252c9723f
2026-01-29 06:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f556c90>
2026-01-29 06:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcf229a0-4638-5196-9e49-efe252c9723f/dcf229a0-4638-5196-9e49-efe252c9723f_image_8.jpg HTTP/1.1" 201 0
2026-01-29 06:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F93%252F2693cda41323c87cb0eb7c1c8c926a70%252Fpa%252FNS66111_09f62f10301947bc277719d8749fda6f.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_09f62f10301947bc277719d8749fda6f.jpg saved to cache
2026-01-29 06:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dcf229a0-4638-5196-9e49-efe252c9723f
2026-01-29 06:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c298ed0>
2026-01-29 06:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_4.jpg HTTP/1.1" 201 0
2026-01-29 06:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F49%252F60494679e96cf09efbf03a60ea089aa5%252Fpa%252FUF99896_a9f1fb766f39e42d823f3910ea0d9e75.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_a9f1fb766f39e42d823f3910ea0d9e75.jpg saved to cache
2026-01-29 06:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 886a1040-1c8a-5d43-ad11-b235b82e2a31
2026-01-29 06:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f444650>
2026-01-29 06:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_2.jpg HTTP/1.1" 201 0
2026-01-29 06:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F49%252F60494679e96cf09efbf03a60ea089aa5%252Fpa%252FUF99896_1245176e5ae4820e219c9c614ff9db20.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_1245176e5ae4820e219c9c614ff9db20.jpg saved to cache
2026-01-29 06:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 886a1040-1c8a-5d43-ad11-b235b82e2a31
2026-01-29 06:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f446690>
2026-01-29 06:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_0.jpg HTTP/1.1" 201 0
2026-01-29 06:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F49%252F60494679e96cf09efbf03a60ea089aa5%252Fpa%252FUF99896_2a01d39ca2ea53b9c6ba91440984395b.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_2a01d39ca2ea53b9c6ba91440984395b.jpg saved to cache
2026-01-29 06:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 886a1040-1c8a-5d43-ad11-b235b82e2a31
2026-01-29 06:03:33 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F49%252F60494679e96cf09efbf03a60ea089aa5%252Fpa%252FUF99896_62b3a5e8da081bf2e25e7920baa0ad8c.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_62b3a5e8da081bf2e25e7920baa0ad8c.jpg not downloaded yet
2026-01-29 06:03:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f58b890>
2026-01-29 06:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_5.jpg HTTP/1.1" 201 0
2026-01-29 06:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F49%252F60494679e96cf09efbf03a60ea089aa5%252Fpa%252FUF99896_3a3b5bf9441fc78ddc8e6693dc5efc96.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_3a3b5bf9441fc78ddc8e6693dc5efc96.jpg saved to cache
2026-01-29 06:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 886a1040-1c8a-5d43-ad11-b235b82e2a31
2026-01-29 06:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_7e858d31164096cab3c0acb6b3be6121.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_443fe30f858f8b3a82e6e9e1038fc04b.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F93%252F2693cda41323c87cb0eb7c1c8c926a70%252Fpa%252FNS66111_99abc9cf4a8aa49f8f4abe74692e990d.png%27 HTTP/1.1" 200 None
2026-01-29 06:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_99abc9cf4a8aa49f8f4abe74692e990d.png not downloaded yet
2026-01-29 06:03:34 [auto1.fr] INFO: Found listing with ID: GL72455
2026-01-29 06:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GL72455%27 HTTP/1.1" 200 None
2026-01-29 06:03:34 [auto1.fr] INFO: Scrape type for GL72455: 0
2026-01-29 06:03:34 [auto1.fr] INFO: Found listing with ID: KT34234
2026-01-29 06:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KT34234%27 HTTP/1.1" 200 None
2026-01-29 06:03:34 [auto1.fr] INFO: Scrape type for KT34234: 0
2026-01-29 06:03:34 [auto1.fr] INFO: Found listing with ID: TG88286
2026-01-29 06:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TG88286%27 HTTP/1.1" 200 None
2026-01-29 06:03:34 [auto1.fr] INFO: Scrape type for TG88286: 2
2026-01-29 06:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_e4deb7f5721d5ccb19bb018c0659a107.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F49%252F60494679e96cf09efbf03a60ea089aa5%252Fpa%252FUF99896_699f40976010cd02792b7078ea7232c6.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_699f40976010cd02792b7078ea7232c6.jpg not downloaded yet
2026-01-29 06:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PW30452/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XA49145> (referer: https://www.auto1.com/v1/car-details-view/XA49145/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RB75331/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MF46010> (referer: https://www.auto1.com/v1/car-details-view/MF46010/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c108150>
2026-01-29 06:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcf229a0-4638-5196-9e49-efe252c9723f/dcf229a0-4638-5196-9e49-efe252c9723f_image_10.jpg HTTP/1.1" 201 0
2026-01-29 06:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F93%252F2693cda41323c87cb0eb7c1c8c926a70%252Fpa%252FNS66111_12538a5665b29b3153692b3fc72f0935.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_12538a5665b29b3153692b3fc72f0935.jpg saved to cache
2026-01-29 06:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item dcf229a0-4638-5196-9e49-efe252c9723f
2026-01-29 06:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6fe8b950>
2026-01-29 06:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_6.jpg HTTP/1.1" 201 0
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F49%252F60494679e96cf09efbf03a60ea089aa5%252Fpa%252FUF99896_e239d3fe039fca857b9a717f6634c3c4.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_e239d3fe039fca857b9a717f6634c3c4.jpg saved to cache
2026-01-29 06:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 886a1040-1c8a-5d43-ad11-b235b82e2a31
2026-01-29 06:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_35c496f14c939b66eb75448e8301c8ea.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_8a64a48cbf17f26eb1c92bf775cf5631.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:35 [auto1.fr] INFO: Found listing with ID: CA74425
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA74425%27 HTTP/1.1" 200 None
2026-01-29 06:03:35 [auto1.fr] INFO: Scrape type for CA74425: 0
2026-01-29 06:03:35 [auto1.fr] INFO: Found listing with ID: UB06427
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UB06427%27 HTTP/1.1" 200 None
2026-01-29 06:03:35 [auto1.fr] INFO: Scrape type for UB06427: 0
2026-01-29 06:03:35 [auto1.fr] INFO: Found listing with ID: XD31780
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XD31780%27 HTTP/1.1" 200 None
2026-01-29 06:03:35 [auto1.fr] INFO: Scrape type for XD31780: 0
2026-01-29 06:03:35 [auto1.fr] INFO: Found listing with ID: ZZ60899
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZZ60899%27 HTTP/1.1" 200 None
2026-01-29 06:03:35 [auto1.fr] INFO: Scrape type for ZZ60899: 0
2026-01-29 06:03:35 [auto1.fr] INFO: Found listing with ID: FX04701
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX04701%27 HTTP/1.1" 200 None
2026-01-29 06:03:35 [auto1.fr] INFO: Scrape type for FX04701: 0
2026-01-29 06:03:35 [auto1.fr] INFO: Found listing with ID: PH21479
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH21479%27 HTTP/1.1" 200 None
2026-01-29 06:03:35 [auto1.fr] INFO: Scrape type for PH21479: 0
2026-01-29 06:03:35 [auto1.fr] INFO: Found listing with ID: GM65156
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GM65156%27 HTTP/1.1" 200 None
2026-01-29 06:03:35 [auto1.fr] INFO: Scrape type for GM65156: 2
2026-01-29 06:03:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_98b816ce581ed7093a523bcf4d75ff14.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F49%252F60494679e96cf09efbf03a60ea089aa5%252Fpa%252FUF99896_289d0f28e82a636f14420d3ca66f8d3e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_289d0f28e82a636f14420d3ca66f8d3e.jpg not downloaded yet
2026-01-29 06:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c062e50>
2026-01-29 06:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_7.jpg HTTP/1.1" 201 0
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F49%252F60494679e96cf09efbf03a60ea089aa5%252Fpa%252FUF99896_7e858d31164096cab3c0acb6b3be6121.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_7e858d31164096cab3c0acb6b3be6121.jpg saved to cache
2026-01-29 06:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 886a1040-1c8a-5d43-ad11-b235b82e2a31
2026-01-29 06:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f59e2d0>
2026-01-29 06:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcf229a0-4638-5196-9e49-efe252c9723f/dcf229a0-4638-5196-9e49-efe252c9723f_image_12.jpg HTTP/1.1" 201 0
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F93%252F2693cda41323c87cb0eb7c1c8c926a70%252Fpa%252FNS66111_443fe30f858f8b3a82e6e9e1038fc04b.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_443fe30f858f8b3a82e6e9e1038fc04b.jpg saved to cache
2026-01-29 06:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item dcf229a0-4638-5196-9e49-efe252c9723f
2026-01-29 06:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_1ee36c7c0b1925711e305beb2f0fd7b5.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:35 [auto1.fr] INFO: Found listing with ID: UV99262
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UV99262%27 HTTP/1.1" 200 None
2026-01-29 06:03:35 [auto1.fr] INFO: Scrape type for UV99262: 2
2026-01-29 06:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f3a8090>
2026-01-29 06:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcf229a0-4638-5196-9e49-efe252c9723f/dcf229a0-4638-5196-9e49-efe252c9723f_image_11.jpg HTTP/1.1" 201 0
2026-01-29 06:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F93%252F2693cda41323c87cb0eb7c1c8c926a70%252Fpa%252FNS66111_e4deb7f5721d5ccb19bb018c0659a107.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_e4deb7f5721d5ccb19bb018c0659a107.jpg saved to cache
2026-01-29 06:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item dcf229a0-4638-5196-9e49-efe252c9723f
2026-01-29 06:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2d7ca5a-8f66-565e-928c-b5ea65a557cd with identifier: XA49145
2026-01-29 06:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2d7ca5a-8f66-565e-928c-b5ea65a557cd with scrape type 1
2026-01-29 06:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item e2d7ca5a-8f66-565e-928c-b5ea65a557cd
2026-01-29 06:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F14%252Fef14cf0fc3f2d791fabb0a331665f04c%252Fpa%252FXA49145_9268d966b3de663fa68a9a4958e6e39b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_9268d966b3de663fa68a9a4958e6e39b.jpg not downloaded yet
2026-01-29 06:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e568ace-8955-5943-a54f-3b2b5d255c28 with identifier: MF46010
2026-01-29 06:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e568ace-8955-5943-a54f-3b2b5d255c28 with scrape type 1
2026-01-29 06:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 9e568ace-8955-5943-a54f-3b2b5d255c28
2026-01-29 06:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2a%252F3d2a4f42266c8b5b8dba15df9facba85%252Fpa%252FMF46010_e72a07a73f7d821f7f56b832adbcd0a5.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_e72a07a73f7d821f7f56b832adbcd0a5.jpg not downloaded yet
2026-01-29 06:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_62b3a5e8da081bf2e25e7920baa0ad8c.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F49%252F60494679e96cf09efbf03a60ea089aa5%252Fpa%252FUF99896_ea39f4ef6d210672f82a9aea048c5211.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_ea39f4ef6d210672f82a9aea048c5211.jpg not downloaded yet
2026-01-29 06:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WN92685> (referer: https://www.auto1.com/v1/car-details-view/WN92685/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DL43817> (referer: https://www.auto1.com/v1/car-details-view/DL43817/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c2fccd0>
2026-01-29 06:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcf229a0-4638-5196-9e49-efe252c9723f/dcf229a0-4638-5196-9e49-efe252c9723f_image_13.jpg HTTP/1.1" 201 0
2026-01-29 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F93%252F2693cda41323c87cb0eb7c1c8c926a70%252Fpa%252FNS66111_35c496f14c939b66eb75448e8301c8ea.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_35c496f14c939b66eb75448e8301c8ea.jpg saved to cache
2026-01-29 06:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item dcf229a0-4638-5196-9e49-efe252c9723f
2026-01-29 06:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c164a90>
2026-01-29 06:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_8.jpg HTTP/1.1" 201 0
2026-01-29 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F49%252F60494679e96cf09efbf03a60ea089aa5%252Fpa%252FUF99896_8a64a48cbf17f26eb1c92bf775cf5631.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_8a64a48cbf17f26eb1c92bf775cf5631.jpg saved to cache
2026-01-29 06:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 886a1040-1c8a-5d43-ad11-b235b82e2a31
2026-01-29 06:03:37 [auto1.fr] INFO: Found listing with ID: EV53921
2026-01-29 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EV53921%27 HTTP/1.1" 200 None
2026-01-29 06:03:37 [auto1.fr] INFO: Scrape type for EV53921: 0
2026-01-29 06:03:37 [auto1.fr] INFO: Found listing with ID: NF89230
2026-01-29 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NF89230%27 HTTP/1.1" 200 None
2026-01-29 06:03:37 [auto1.fr] INFO: Scrape type for NF89230: 0
2026-01-29 06:03:37 [auto1.fr] INFO: Found listing with ID: XL58203
2026-01-29 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XL58203%27 HTTP/1.1" 200 None
2026-01-29 06:03:37 [auto1.fr] INFO: Scrape type for XL58203: 0
2026-01-29 06:03:37 [auto1.fr] INFO: Found listing with ID: AG75749
2026-01-29 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AG75749%27 HTTP/1.1" 200 None
2026-01-29 06:03:37 [auto1.fr] INFO: Scrape type for AG75749: 0
2026-01-29 06:03:37 [auto1.fr] INFO: Found listing with ID: SJ18122
2026-01-29 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SJ18122%27 HTTP/1.1" 200 None
2026-01-29 06:03:37 [auto1.fr] INFO: Scrape type for SJ18122: 2
2026-01-29 06:03:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F14%252Fef14cf0fc3f2d791fabb0a331665f04c%252Fpa%252FXA49145_410bbcf532d8d19122275f8435c81af5.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_410bbcf532d8d19122275f8435c81af5.jpg not downloaded yet
2026-01-29 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2a%252F3d2a4f42266c8b5b8dba15df9facba85%252Fpa%252FMF46010_b62285ce2d95449417e776af84c40156.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_b62285ce2d95449417e776af84c40156.jpg not downloaded yet
2026-01-29 06:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ffdaad0>
2026-01-29 06:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_9.jpg HTTP/1.1" 201 0
2026-01-29 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F49%252F60494679e96cf09efbf03a60ea089aa5%252Fpa%252FUF99896_98b816ce581ed7093a523bcf4d75ff14.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_98b816ce581ed7093a523bcf4d75ff14.jpg saved to cache
2026-01-29 06:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 886a1040-1c8a-5d43-ad11-b235b82e2a31
2026-01-29 06:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_699f40976010cd02792b7078ea7232c6.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_99abc9cf4a8aa49f8f4abe74692e990d.png> (referer: https://www.auto1.com/)
2026-01-29 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F49%252F60494679e96cf09efbf03a60ea089aa5%252Fpa%252FUF99896_cb1f4a1d89a89d616bbb4bed29407840.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_cb1f4a1d89a89d616bbb4bed29407840.jpg not downloaded yet
2026-01-29 06:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YA10266> (referer: https://www.auto1.com/v1/car-details-view/YA10266/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f589590>
2026-01-29 06:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcf229a0-4638-5196-9e49-efe252c9723f/dcf229a0-4638-5196-9e49-efe252c9723f_image_14.jpg HTTP/1.1" 201 0
2026-01-29 06:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F93%252F2693cda41323c87cb0eb7c1c8c926a70%252Fpa%252FNS66111_1ee36c7c0b1925711e305beb2f0fd7b5.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_1ee36c7c0b1925711e305beb2f0fd7b5.jpg saved to cache
2026-01-29 06:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item dcf229a0-4638-5196-9e49-efe252c9723f
2026-01-29 06:03:38 [auto1.fr] INFO: Found listing with ID: WN63847
2026-01-29 06:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WN63847%27 HTTP/1.1" 200 None
2026-01-29 06:03:38 [auto1.fr] INFO: Scrape type for WN63847: 2
2026-01-29 06:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F14%252Fef14cf0fc3f2d791fabb0a331665f04c%252Fpa%252FXA49145_d4f7fe2aafa1a9bc7e3014632a0753ac.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_d4f7fe2aafa1a9bc7e3014632a0753ac.jpg not downloaded yet
2026-01-29 06:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2a%252F3d2a4f42266c8b5b8dba15df9facba85%252Fpa%252FMF46010_c7c249d5587e8cc1ff2c7ab22230c525.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_c7c249d5587e8cc1ff2c7ab22230c525.jpg not downloaded yet
2026-01-29 06:03:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c279a50>
2026-01-29 06:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_10.jpg HTTP/1.1" 201 0
2026-01-29 06:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F49%252F60494679e96cf09efbf03a60ea089aa5%252Fpa%252FUF99896_62b3a5e8da081bf2e25e7920baa0ad8c.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_62b3a5e8da081bf2e25e7920baa0ad8c.jpg saved to cache
2026-01-29 06:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 886a1040-1c8a-5d43-ad11-b235b82e2a31
2026-01-29 06:03:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61800098-de28-5752-8819-d6c923947982 with identifier: WN92685
2026-01-29 06:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61800098-de28-5752-8819-d6c923947982 with scrape type 2
2026-01-29 06:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61800098-de28-5752-8819-d6c923947982 with scrape type 2
2026-01-29 06:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 61800098-de28-5752-8819-d6c923947982, identifier: WN92685
2026-01-29 06:03:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36aa188a-d3b5-599e-ab11-9c4467b891aa with identifier: DL43817
2026-01-29 06:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36aa188a-d3b5-599e-ab11-9c4467b891aa with scrape type 2
2026-01-29 06:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36aa188a-d3b5-599e-ab11-9c4467b891aa with scrape type 2
2026-01-29 06:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 36aa188a-d3b5-599e-ab11-9c4467b891aa, identifier: DL43817
2026-01-29 06:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_289d0f28e82a636f14420d3ca66f8d3e.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F49%252F60494679e96cf09efbf03a60ea089aa5%252Fpa%252FUF99896_4f6d485a4dab9dec3beffcd0ca60eeb9.png%27 HTTP/1.1" 200 None
2026-01-29 06:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_4f6d485a4dab9dec3beffcd0ca60eeb9.png not downloaded yet
2026-01-29 06:03:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 61800098-de28-5752-8819-d6c923947982 with identifier: WN92685
2026-01-29 06:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 61800098-de28-5752-8819-d6c923947982 with identifier: WN92685
2026-01-29 06:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'ds automobiles ds3 crossback 1.2 puretech grand chic', 'price': 0, 'currency': 'eur', 'make': 'ds automobiles', 'model': 'ds3 crossback', 'transmission': 'automatic', 'odometer': 30160, 'odometer_reading_unit': 'km', 'registration_date': '2019-06-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wn92685', 'expiration_date': '2026-01-29t16:50:27z', 'origin_country_code': 'fr', 'trim': 'grand chic', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 155, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 121, 'id': '61800098-de28-5752-8819-d6c923947982', 'current_year_diff': 7, 'age_in_months': 79, 'make_model': 'ds automobiles ds3 crossback', 'sanitized_make': 'dsautomobiles', 'odometer_in_km': 30160}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 79,
     'auction_title': '',
     'c_o_2_emission_value': 121,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 155,
     'expiration_date': '2026-01-29t16:50:27z',
     'fuel_type': 'petrol',
     'id': '61800098-de28-5752-8819-d6c923947982',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wn92685',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'ds automobiles',
     'make_model': 'ds automobiles ds3 crossback',
     'model': 'ds3 crossback',
     'odometer': 30160,
     'odometer_in_km': 30160,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-06-26',
     'sanitized_make': 'dsautomobiles',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ds automobiles ds3 crossback 1.2 puretech grand chic',
     'transmission': 'automatic',
     'trim': 'grand chic',
     'year': 2019}
2026-01-29 06:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 61800098-de28-5752-8819-d6c923947982 spider: auto1.fr
2026-01-29 06:03:39 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 61800098-de28-5752-8819-d6c923947982 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'ds automobiles ds3 crossback 1.2 puretech grand chic', 'price': 0, 'currency': 'eur', 'make': 'ds automobiles', 'model': 'ds3 crossback', 'transmission': 'automatic', 'odometer': 30160, 'odometer_reading_unit': 'km', 'registration_date': '2019-06-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wn92685', 'expiration_date': '2026-01-29t16:50:27z', 'origin_country_code': 'fr', 'trim': 'grand chic', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 155, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 121, 'id': '61800098-de28-5752-8819-d6c923947982', 'current_year_diff': 7, 'age_in_months': 79, 'make_model': 'ds automobiles ds3 crossback', 'sanitized_make': 'dsautomobiles', 'odometer_in_km': 30160}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 79,
     'auction_title': '',
     'c_o_2_emission_value': 121,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 155,
     'expiration_date': '2026-01-29t16:50:27z',
     'fuel_type': 'petrol',
     'id': '61800098-de28-5752-8819-d6c923947982',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wn92685',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'ds automobiles',
     'make_model': 'ds automobiles ds3 crossback',
     'model': 'ds3 crossback',
     'odometer': 30160,
     'odometer_in_km': 30160,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-06-26',
     'sanitized_make': 'dsautomobiles',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ds automobiles ds3 crossback 1.2 puretech grand chic',
     'transmission': 'automatic',
     'trim': 'grand chic',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 155,
 'expiration_date': '2026-01-29T16:50:27Z',
 'fuel_type': 'petrol',
 'id': '61800098-de28-5752-8819-d6c923947982',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN92685',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'DS Automobiles',
 'model': 'DS3 Crossback',
 'odometer': 30160,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS Automobiles DS3 Crossback 1.2 PureTech Grand Chic',
 'transmission': 'automatic',
 'trim': 'Grand Chic',
 'year': 2019}
2026-01-29 06:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WN92685%27 HTTP/1.1" 200 None
2026-01-29 06:03:39 [auto1.fr] INFO: Saving data for WN92685: {'auction_closing_time': 1769705427.0, 'created_time': 1768413368.784632, 'last_price_update_time': 1769666619.119614}
2026-01-29 06:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WN92685') HTTP/1.1" 204 0
2026-01-29 06:03:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 36aa188a-d3b5-599e-ab11-9c4467b891aa with identifier: DL43817
2026-01-29 06:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 36aa188a-d3b5-599e-ab11-9c4467b891aa with identifier: DL43817
2026-01-29 06:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 193841 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    193841
2026-01-29 06:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 36aa188a-d3b5-599e-ab11-9c4467b891aa spider: auto1.fr
2026-01-29 06:03:39 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 36aa188a-d3b5-599e-ab11-9c4467b891aa due to rule: high_mileage_for_country.json, error: 193841 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    193841
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.7L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:41:11Z',
 'fuel_type': 'diesel',
 'id': '36aa188a-d3b5-599e-ab11-9c4467b891aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL43817',
 'listing': 'auction',
 'location': 'FR, LE HAVRE',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 193841,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan X-Trail 1.7 dCi Tekna',
 'transmission': 'automatic',
 'trim': 'Tekna',
 'year': 2019}
2026-01-29 06:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DL43817%27 HTTP/1.1" 200 None
2026-01-29 06:03:39 [auto1.fr] INFO: Saving data for DL43817: {'auction_closing_time': 1769704871.0, 'created_time': 1768990531.800861, 'last_price_update_time': 1769666619.470348}
2026-01-29 06:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DL43817') HTTP/1.1" 204 0
2026-01-29 06:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_9268d966b3de663fa68a9a4958e6e39b.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:39 [auto1.fr] INFO: Found listing with ID: KN01539
2026-01-29 06:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KN01539%27 HTTP/1.1" 200 None
2026-01-29 06:03:39 [auto1.fr] INFO: Scrape type for KN01539: 0
2026-01-29 06:03:39 [auto1.fr] INFO: Found listing with ID: AF43348
2026-01-29 06:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AF43348%27 HTTP/1.1" 200 None
2026-01-29 06:03:39 [auto1.fr] INFO: Scrape type for AF43348: 2
2026-01-29 06:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F14%252Fef14cf0fc3f2d791fabb0a331665f04c%252Fpa%252FXA49145_d34abb4d2b7aa5342a5a780723e26573.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_d34abb4d2b7aa5342a5a780723e26573.jpg not downloaded yet
2026-01-29 06:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2a%252F3d2a4f42266c8b5b8dba15df9facba85%252Fpa%252FMF46010_ddc5cd22f08e7f5c405b47eb07b3553b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_ddc5cd22f08e7f5c405b47eb07b3553b.jpg not downloaded yet
2026-01-29 06:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c191190>
2026-01-29 06:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_11.jpg HTTP/1.1" 201 0
2026-01-29 06:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F49%252F60494679e96cf09efbf03a60ea089aa5%252Fpa%252FUF99896_699f40976010cd02792b7078ea7232c6.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_699f40976010cd02792b7078ea7232c6.jpg saved to cache
2026-01-29 06:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 886a1040-1c8a-5d43-ad11-b235b82e2a31
2026-01-29 06:03:39 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-01-29 06:03:39 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2026-01-29 06:03:39 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2026-01-29 06:03:39 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2026-01-29 06:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff5b750>
2026-01-29 06:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcf229a0-4638-5196-9e49-efe252c9723f/dcf229a0-4638-5196-9e49-efe252c9723f_image_15.png HTTP/1.1" 201 0
2026-01-29 06:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F93%252F2693cda41323c87cb0eb7c1c8c926a70%252Fpa%252FNS66111_99abc9cf4a8aa49f8f4abe74692e990d.png') HTTP/1.1" 204 0
2026-01-29 06:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_99abc9cf4a8aa49f8f4abe74692e990d.png saved to cache
2026-01-29 06:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item dcf229a0-4638-5196-9e49-efe252c9723f
2026-01-29 06:03:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dcf229a0-4638-5196-9e49-efe252c9723f, skipping ID generation
2026-01-29 06:03:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcf229a0-4638-5196-9e49-efe252c9723f with scrape type 1
2026-01-29 06:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item dcf229a0-4638-5196-9e49-efe252c9723f from tracking dictionaries
2026-01-29 06:03:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dcf229a0-4638-5196-9e49-efe252c9723f sending to next pipeline
2026-01-29 06:03:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: dcf229a0-4638-5196-9e49-efe252c9723f, identifier: NS66111
2026-01-29 06:03:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebd556ab-5120-52f2-9fba-5871b84db0bf with identifier: YA10266
2026-01-29 06:03:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebd556ab-5120-52f2-9fba-5871b84db0bf with scrape type 1
2026-01-29 06:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item ebd556ab-5120-52f2-9fba-5871b84db0bf
2026-01-29 06:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F5c%252Fe55cba11dcb6db7c9220cfd537533033%252Fpa%252FYA10266_c94eff5489f6ec8c65acc91b209af087.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_c94eff5489f6ec8c65acc91b209af087.jpg not downloaded yet
2026-01-29 06:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_ea39f4ef6d210672f82a9aea048c5211.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_e72a07a73f7d821f7f56b832adbcd0a5.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WT08030> (referer: https://www.auto1.com/v1/car-details-view/WT08030/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dcf229a0-4638-5196-9e49-efe252c9723f with identifier: NS66111
2026-01-29 06:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dcf229a0-4638-5196-9e49-efe252c9723f with identifier: NS66111
2026-01-29 06:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 153412 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    153412
2026-01-29 06:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: dcf229a0-4638-5196-9e49-efe252c9723f spider: auto1.fr
2026-01-29 06:03:40 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: dcf229a0-4638-5196-9e49-efe252c9723f due to rule: high_mileage_for_country.json, error: 153412 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    153412
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:11:22Z',
 'fuel_type': 'diesel',
 'id': 'dcf229a0-4638-5196-9e49-efe252c9723f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS66111',
 'listing': 'auction',
 'location': 'FR, Maromme',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 153412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf229a0-4638-5196-9e49-efe252c9723f/dcf229a0-4638-5196-9e49-efe252c9723f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_5d6ee3919a1c2b609f486abc52d084bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf229a0-4638-5196-9e49-efe252c9723f/dcf229a0-4638-5196-9e49-efe252c9723f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_4ebdf75f5e9027f4e4530a661e2369e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf229a0-4638-5196-9e49-efe252c9723f/dcf229a0-4638-5196-9e49-efe252c9723f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_e28c990cbd09c320fb169122600bbcf9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf229a0-4638-5196-9e49-efe252c9723f/dcf229a0-4638-5196-9e49-efe252c9723f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63885,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_ec7b11763f53f31a2dab3a2e7b5b033f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf229a0-4638-5196-9e49-efe252c9723f/dcf229a0-4638-5196-9e49-efe252c9723f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_572c2e90ec122a8a05b7eaf6f71c5003.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf229a0-4638-5196-9e49-efe252c9723f/dcf229a0-4638-5196-9e49-efe252c9723f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_d5a85bcc3b9d9cc4094c7fbd7d6c5835.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf229a0-4638-5196-9e49-efe252c9723f/dcf229a0-4638-5196-9e49-efe252c9723f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_ec15123128259ba2b672c941b9ea67ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf229a0-4638-5196-9e49-efe252c9723f/dcf229a0-4638-5196-9e49-efe252c9723f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_831279b899c455fc87b1ff708163b5a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf229a0-4638-5196-9e49-efe252c9723f/dcf229a0-4638-5196-9e49-efe252c9723f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_09f62f10301947bc277719d8749fda6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf229a0-4638-5196-9e49-efe252c9723f/dcf229a0-4638-5196-9e49-efe252c9723f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_2a44c9b61af8f6756380e5da0fe3c771.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf229a0-4638-5196-9e49-efe252c9723f/dcf229a0-4638-5196-9e49-efe252c9723f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_12538a5665b29b3153692b3fc72f0935.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf229a0-4638-5196-9e49-efe252c9723f/dcf229a0-4638-5196-9e49-efe252c9723f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_e4deb7f5721d5ccb19bb018c0659a107.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf229a0-4638-5196-9e49-efe252c9723f/dcf229a0-4638-5196-9e49-efe252c9723f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_443fe30f858f8b3a82e6e9e1038fc04b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf229a0-4638-5196-9e49-efe252c9723f/dcf229a0-4638-5196-9e49-efe252c9723f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_35c496f14c939b66eb75448e8301c8ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf229a0-4638-5196-9e49-efe252c9723f/dcf229a0-4638-5196-9e49-efe252c9723f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_1ee36c7c0b1925711e305beb2f0fd7b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf229a0-4638-5196-9e49-efe252c9723f/dcf229a0-4638-5196-9e49-efe252c9723f_image_15.png',
             'Extension': 'png',
             'FileSizeInBytes': 112770,
             'Height': 525,
             'OriginUrl': 'https://img-pa.auto1.com/img26/93/2693cda41323c87cb0eb7c1c8c926a70/pa/NS66111_99abc9cf4a8aa49f8f4abe74692e990d.png',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.5 dCi Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2017}
2026-01-29 06:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NS66111%27 HTTP/1.1" 200 None
2026-01-29 06:03:40 [auto1.fr] INFO: Saving data for NS66111: {'created_time': 1769666620.516699, 'last_price_update_time': 1769666620.516711, 'auction_closing_time': 1769703082.0}
2026-01-29 06:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NS66111') HTTP/1.1" 204 0
2026-01-29 06:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_410bbcf532d8d19122275f8435c81af5.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:40 [auto1.fr] INFO: Found listing with ID: LV70017
2026-01-29 06:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LV70017%27 HTTP/1.1" 200 None
2026-01-29 06:03:40 [auto1.fr] INFO: Scrape type for LV70017: 2
2026-01-29 06:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F14%252Fef14cf0fc3f2d791fabb0a331665f04c%252Fpa%252FXA49145_c0b7ceece9aac2b78e686144a0aad9ed.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_c0b7ceece9aac2b78e686144a0aad9ed.jpg not downloaded yet
2026-01-29 06:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2a%252F3d2a4f42266c8b5b8dba15df9facba85%252Fpa%252FMF46010_f223c3135803b9eef571d54d06b95ac9.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_f223c3135803b9eef571d54d06b95ac9.jpg not downloaded yet
2026-01-29 06:03:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F5c%252Fe55cba11dcb6db7c9220cfd537533033%252Fpa%252FYA10266_4465fc3c6a68e3451ed8b1436133c496.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_4465fc3c6a68e3451ed8b1436133c496.jpg not downloaded yet
2026-01-29 06:03:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c199b50>
2026-01-29 06:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-29 06:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_12.jpg HTTP/1.1" 201 0
2026-01-29 06:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F49%252F60494679e96cf09efbf03a60ea089aa5%252Fpa%252FUF99896_289d0f28e82a636f14420d3ca66f8d3e.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_289d0f28e82a636f14420d3ca66f8d3e.jpg saved to cache
2026-01-29 06:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 886a1040-1c8a-5d43-ad11-b235b82e2a31
2026-01-29 06:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_cb1f4a1d89a89d616bbb4bed29407840.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_b62285ce2d95449417e776af84c40156.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TG88286/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BP20652> (referer: https://www.auto1.com/v1/car-details-view/BP20652/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f30cb10>
2026-01-29 06:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d7ca5a-8f66-565e-928c-b5ea65a557cd/e2d7ca5a-8f66-565e-928c-b5ea65a557cd_image_0.jpg HTTP/1.1" 201 0
2026-01-29 06:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F14%252Fef14cf0fc3f2d791fabb0a331665f04c%252Fpa%252FXA49145_9268d966b3de663fa68a9a4958e6e39b.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_9268d966b3de663fa68a9a4958e6e39b.jpg saved to cache
2026-01-29 06:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2d7ca5a-8f66-565e-928c-b5ea65a557cd
2026-01-29 06:03:41 [auto1.fr] INFO: Found listing with ID: DL84076
2026-01-29 06:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DL84076%27 HTTP/1.1" 200 None
2026-01-29 06:03:41 [auto1.fr] INFO: Scrape type for DL84076: 2
2026-01-29 06:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F14%252Fef14cf0fc3f2d791fabb0a331665f04c%252Fpa%252FXA49145_93c4653078ac23193363fa36b3920182.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_93c4653078ac23193363fa36b3920182.jpg not downloaded yet
2026-01-29 06:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2a%252F3d2a4f42266c8b5b8dba15df9facba85%252Fpa%252FMF46010_52a8d5cb4f1b3b526a4319aae4fc9595.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_52a8d5cb4f1b3b526a4319aae4fc9595.jpg not downloaded yet
2026-01-29 06:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F5c%252Fe55cba11dcb6db7c9220cfd537533033%252Fpa%252FYA10266_132e0e0ceceff592e39c9929f1cad2ab.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_132e0e0ceceff592e39c9929f1cad2ab.jpg not downloaded yet
2026-01-29 06:03:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PV20302> (referer: https://www.auto1.com/v1/car-details-view/PV20302/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7e0c6590>
2026-01-29 06:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_13.jpg HTTP/1.1" 201 0
2026-01-29 06:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F49%252F60494679e96cf09efbf03a60ea089aa5%252Fpa%252FUF99896_ea39f4ef6d210672f82a9aea048c5211.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_ea39f4ef6d210672f82a9aea048c5211.jpg saved to cache
2026-01-29 06:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 886a1040-1c8a-5d43-ad11-b235b82e2a31
2026-01-29 06:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff91450>
2026-01-29 06:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e568ace-8955-5943-a54f-3b2b5d255c28/9e568ace-8955-5943-a54f-3b2b5d255c28_image_0.jpg HTTP/1.1" 201 0
2026-01-29 06:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2a%252F3d2a4f42266c8b5b8dba15df9facba85%252Fpa%252FMF46010_e72a07a73f7d821f7f56b832adbcd0a5.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_e72a07a73f7d821f7f56b832adbcd0a5.jpg saved to cache
2026-01-29 06:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e568ace-8955-5943-a54f-3b2b5d255c28
2026-01-29 06:03:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f78f1cbf-ec23-5462-b8d7-ba78cfe7a146 with identifier: WT08030
2026-01-29 06:03:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f78f1cbf-ec23-5462-b8d7-ba78cfe7a146 with scrape type 2
2026-01-29 06:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f78f1cbf-ec23-5462-b8d7-ba78cfe7a146 with scrape type 2
2026-01-29 06:03:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f78f1cbf-ec23-5462-b8d7-ba78cfe7a146, identifier: WT08030
2026-01-29 06:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_d4f7fe2aafa1a9bc7e3014632a0753ac.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_c7c249d5587e8cc1ff2c7ab22230c525.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f78f1cbf-ec23-5462-b8d7-ba78cfe7a146 with identifier: WT08030
2026-01-29 06:03:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f78f1cbf-ec23-5462-b8d7-ba78cfe7a146 with identifier: WT08030
2026-01-29 06:03:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f78f1cbf-ec23-5462-b8d7-ba78cfe7a146 with identifier: WT08030 to the API
2026-01-29 06:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:03:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:03:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WT08030>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:00:45Z',
 'fuel_type': 'petrol',
 'id': 'f78f1cbf-ec23-5462-b8d7-ba78cfe7a146',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT08030',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'BMW',
 'model': '1er',
 'odometer': 57760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-01-29 06:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WT08030%27 HTTP/1.1" 200 None
2026-01-29 06:03:42 [auto1.fr] INFO: Saving data for WT08030: {'auction_closing_time': 1769702445.0, 'created_time': 1768413118.365376, 'last_price_update_time': 1769666622.472072}
2026-01-29 06:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WT08030') HTTP/1.1" 204 0
2026-01-29 06:03:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f4ba290>
2026-01-29 06:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d7ca5a-8f66-565e-928c-b5ea65a557cd/e2d7ca5a-8f66-565e-928c-b5ea65a557cd_image_1.jpg HTTP/1.1" 201 0
2026-01-29 06:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F14%252Fef14cf0fc3f2d791fabb0a331665f04c%252Fpa%252FXA49145_410bbcf532d8d19122275f8435c81af5.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_410bbcf532d8d19122275f8435c81af5.jpg saved to cache
2026-01-29 06:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e2d7ca5a-8f66-565e-928c-b5ea65a557cd
2026-01-29 06:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_ddc5cd22f08e7f5c405b47eb07b3553b.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_4f6d485a4dab9dec3beffcd0ca60eeb9.png> (referer: https://www.auto1.com/)
2026-01-29 06:03:42 [auto1.fr] INFO: Found listing with ID: NT78881
2026-01-29 06:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NT78881%27 HTTP/1.1" 200 None
2026-01-29 06:03:42 [auto1.fr] INFO: Scrape type for NT78881: 2
2026-01-29 06:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F14%252Fef14cf0fc3f2d791fabb0a331665f04c%252Fpa%252FXA49145_65e8ac6b29f8e599cb744c570bb0cc82.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_65e8ac6b29f8e599cb744c570bb0cc82.jpg not downloaded yet
2026-01-29 06:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2a%252F3d2a4f42266c8b5b8dba15df9facba85%252Fpa%252FMF46010_defb133bf5db620f85f2b32f2ff64d2e.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_defb133bf5db620f85f2b32f2ff64d2e.jpg not downloaded yet
2026-01-29 06:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F5c%252Fe55cba11dcb6db7c9220cfd537533033%252Fpa%252FYA10266_f075c4ec90f1da31ce94aa054b78c3f5.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_f075c4ec90f1da31ce94aa054b78c3f5.jpg not downloaded yet
2026-01-29 06:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RB75331> (referer: https://www.auto1.com/v1/car-details-view/RB75331/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GM65156/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZW66039> (referer: https://www.auto1.com/v1/car-details-view/ZW66039/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f530a90>
2026-01-29 06:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_14.jpg HTTP/1.1" 201 0
2026-01-29 06:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F49%252F60494679e96cf09efbf03a60ea089aa5%252Fpa%252FUF99896_cb1f4a1d89a89d616bbb4bed29407840.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_cb1f4a1d89a89d616bbb4bed29407840.jpg saved to cache
2026-01-29 06:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 886a1040-1c8a-5d43-ad11-b235b82e2a31
2026-01-29 06:03:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c2ff350>
2026-01-29 06:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e568ace-8955-5943-a54f-3b2b5d255c28/9e568ace-8955-5943-a54f-3b2b5d255c28_image_1.jpg HTTP/1.1" 201 0
2026-01-29 06:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2a%252F3d2a4f42266c8b5b8dba15df9facba85%252Fpa%252FMF46010_b62285ce2d95449417e776af84c40156.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_b62285ce2d95449417e776af84c40156.jpg saved to cache
2026-01-29 06:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9e568ace-8955-5943-a54f-3b2b5d255c28
2026-01-29 06:03:43 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 937be206-8155-5ddd-8336-77230dfffb18 with identifier: BP20652
2026-01-29 06:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 937be206-8155-5ddd-8336-77230dfffb18 with scrape type 1
2026-01-29 06:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 937be206-8155-5ddd-8336-77230dfffb18
2026-01-29 06:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc4%252Fb3c46a596f49e232dbd2970c0ca92ce0%252Fpa%252FBP20652_259b1aadc1fff742fb3164ed1b854dd8.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_259b1aadc1fff742fb3164ed1b854dd8.jpg not downloaded yet
2026-01-29 06:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_d34abb4d2b7aa5342a5a780723e26573.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_c94eff5489f6ec8c65acc91b209af087.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1fee2eb-16d2-5259-af51-fad6131568f2 with identifier: PV20302
2026-01-29 06:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1fee2eb-16d2-5259-af51-fad6131568f2 with scrape type 2
2026-01-29 06:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1fee2eb-16d2-5259-af51-fad6131568f2 with scrape type 2
2026-01-29 06:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e1fee2eb-16d2-5259-af51-fad6131568f2, identifier: PV20302
2026-01-29 06:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_c0b7ceece9aac2b78e686144a0aad9ed.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_4465fc3c6a68e3451ed8b1436133c496.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:43 [auto1.fr] INFO: Found listing with ID: RK40922
2026-01-29 06:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RK40922%27 HTTP/1.1" 200 None
2026-01-29 06:03:43 [auto1.fr] INFO: Scrape type for RK40922: 2
2026-01-29 06:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F14%252Fef14cf0fc3f2d791fabb0a331665f04c%252Fpa%252FXA49145_03e5d8837cc705e1f662ae2590754492.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_03e5d8837cc705e1f662ae2590754492.jpg not downloaded yet
2026-01-29 06:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2a%252F3d2a4f42266c8b5b8dba15df9facba85%252Fpa%252FMF46010_3cb8c49d815278b6c479b8fa9a391d1f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_3cb8c49d815278b6c479b8fa9a391d1f.jpg not downloaded yet
2026-01-29 06:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F5c%252Fe55cba11dcb6db7c9220cfd537533033%252Fpa%252FYA10266_4298da4a72c75675f99ec8be19207de9.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_4298da4a72c75675f99ec8be19207de9.jpg not downloaded yet
2026-01-29 06:03:43 [auto1.fr] INFO: Found listing with ID: KU11817
2026-01-29 06:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KU11817%27 HTTP/1.1" 200 None
2026-01-29 06:03:43 [auto1.fr] INFO: Scrape type for KU11817: 2
2026-01-29 06:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc4%252Fb3c46a596f49e232dbd2970c0ca92ce0%252Fpa%252FBP20652_c91d189f8c807b0691edcc71fac45e98.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_c91d189f8c807b0691edcc71fac45e98.jpg not downloaded yet
2026-01-29 06:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e1fee2eb-16d2-5259-af51-fad6131568f2 with identifier: PV20302
2026-01-29 06:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e1fee2eb-16d2-5259-af51-fad6131568f2 with identifier: PV20302
2026-01-29 06:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 160730 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    160730
2026-01-29 06:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: e1fee2eb-16d2-5259-af51-fad6131568f2 spider: auto1.fr
2026-01-29 06:03:43 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: e1fee2eb-16d2-5259-af51-fad6131568f2 due to rule: high_mileage_for_country.json, error: 160730 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    160730
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6A',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-01-29T16:09:49Z',
 'fuel_type': 'diesel',
 'id': 'e1fee2eb-16d2-5259-af51-fad6131568f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV20302',
 'listing': 'auction',
 'location': 'FR, Marly-la-ville',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 160730,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-26',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 2.0 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2019}
2026-01-29 06:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PV20302%27 HTTP/1.1" 200 None
2026-01-29 06:03:43 [auto1.fr] INFO: Saving data for PV20302: {'auction_closing_time': 1769702989.0, 'created_time': 1769015397.587573, 'last_price_update_time': 1769666623.990286}
2026-01-29 06:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PV20302') HTTP/1.1" 204 0
2026-01-29 06:03:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f394450>
2026-01-29 06:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d7ca5a-8f66-565e-928c-b5ea65a557cd/e2d7ca5a-8f66-565e-928c-b5ea65a557cd_image_2.jpg HTTP/1.1" 201 0
2026-01-29 06:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F14%252Fef14cf0fc3f2d791fabb0a331665f04c%252Fpa%252FXA49145_d4f7fe2aafa1a9bc7e3014632a0753ac.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_d4f7fe2aafa1a9bc7e3014632a0753ac.jpg saved to cache
2026-01-29 06:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e2d7ca5a-8f66-565e-928c-b5ea65a557cd
2026-01-29 06:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c135ed0>
2026-01-29 06:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e568ace-8955-5943-a54f-3b2b5d255c28/9e568ace-8955-5943-a54f-3b2b5d255c28_image_2.jpg HTTP/1.1" 201 0
2026-01-29 06:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2a%252F3d2a4f42266c8b5b8dba15df9facba85%252Fpa%252FMF46010_c7c249d5587e8cc1ff2c7ab22230c525.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_c7c249d5587e8cc1ff2c7ab22230c525.jpg saved to cache
2026-01-29 06:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9e568ace-8955-5943-a54f-3b2b5d255c28
2026-01-29 06:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_f223c3135803b9eef571d54d06b95ac9.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f24b650>
2026-01-29 06:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e568ace-8955-5943-a54f-3b2b5d255c28/9e568ace-8955-5943-a54f-3b2b5d255c28_image_3.jpg HTTP/1.1" 201 0
2026-01-29 06:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2a%252F3d2a4f42266c8b5b8dba15df9facba85%252Fpa%252FMF46010_ddc5cd22f08e7f5c405b47eb07b3553b.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_ddc5cd22f08e7f5c405b47eb07b3553b.jpg saved to cache
2026-01-29 06:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9e568ace-8955-5943-a54f-3b2b5d255c28
2026-01-29 06:03:44 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-01-29 06:03:44 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2026-01-29 06:03:44 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2026-01-29 06:03:44 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2026-01-29 06:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f2556d0>
2026-01-29 06:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_15.png HTTP/1.1" 201 0
2026-01-29 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F49%252F60494679e96cf09efbf03a60ea089aa5%252Fpa%252FUF99896_4f6d485a4dab9dec3beffcd0ca60eeb9.png') HTTP/1.1" 204 0
2026-01-29 06:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_4f6d485a4dab9dec3beffcd0ca60eeb9.png saved to cache
2026-01-29 06:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 886a1040-1c8a-5d43-ad11-b235b82e2a31
2026-01-29 06:03:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 886a1040-1c8a-5d43-ad11-b235b82e2a31, skipping ID generation
2026-01-29 06:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 886a1040-1c8a-5d43-ad11-b235b82e2a31 with scrape type 1
2026-01-29 06:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 886a1040-1c8a-5d43-ad11-b235b82e2a31 from tracking dictionaries
2026-01-29 06:03:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 886a1040-1c8a-5d43-ad11-b235b82e2a31 sending to next pipeline
2026-01-29 06:03:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 886a1040-1c8a-5d43-ad11-b235b82e2a31, identifier: UF99896
2026-01-29 06:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43bd3630-41e4-52a4-9947-26bad6894299 with identifier: RB75331
2026-01-29 06:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43bd3630-41e4-52a4-9947-26bad6894299 with scrape type 2
2026-01-29 06:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43bd3630-41e4-52a4-9947-26bad6894299 with scrape type 2
2026-01-29 06:03:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 43bd3630-41e4-52a4-9947-26bad6894299, identifier: RB75331
2026-01-29 06:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22e4a1a9-8e50-5bba-b1a7-8e02269d1d7e with identifier: ZW66039
2026-01-29 06:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22e4a1a9-8e50-5bba-b1a7-8e02269d1d7e with scrape type 2
2026-01-29 06:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22e4a1a9-8e50-5bba-b1a7-8e02269d1d7e with scrape type 2
2026-01-29 06:03:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 22e4a1a9-8e50-5bba-b1a7-8e02269d1d7e, identifier: ZW66039
2026-01-29 06:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_132e0e0ceceff592e39c9929f1cad2ab.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:45 [auto1.fr] INFO: Found listing with ID: BL97925
2026-01-29 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BL97925%27 HTTP/1.1" 200 None
2026-01-29 06:03:45 [auto1.fr] INFO: Scrape type for BL97925: 0
2026-01-29 06:03:45 [auto1.fr] INFO: Found listing with ID: DD59039
2026-01-29 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DD59039%27 HTTP/1.1" 200 None
2026-01-29 06:03:45 [auto1.fr] INFO: Scrape type for DD59039: 2
2026-01-29 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F14%252Fef14cf0fc3f2d791fabb0a331665f04c%252Fpa%252FXA49145_436c8bc78a6fd84a98f8e171532d8f35.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_436c8bc78a6fd84a98f8e171532d8f35.jpg not downloaded yet
2026-01-29 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2a%252F3d2a4f42266c8b5b8dba15df9facba85%252Fpa%252FMF46010_8a564e8148769b8c8d62edd0e7bd7b63.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_8a564e8148769b8c8d62edd0e7bd7b63.jpg not downloaded yet
2026-01-29 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F5c%252Fe55cba11dcb6db7c9220cfd537533033%252Fpa%252FYA10266_be677b1ae2fe6079841d951e49c17d09.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_be677b1ae2fe6079841d951e49c17d09.jpg not downloaded yet
2026-01-29 06:03:45 [auto1.fr] INFO: Found listing with ID: YP48058
2026-01-29 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP48058%27 HTTP/1.1" 200 None
2026-01-29 06:03:45 [auto1.fr] INFO: Scrape type for YP48058: 0
2026-01-29 06:03:45 [auto1.fr] INFO: Found listing with ID: HK10948
2026-01-29 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK10948%27 HTTP/1.1" 200 None
2026-01-29 06:03:45 [auto1.fr] INFO: Scrape type for HK10948: 2
2026-01-29 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc4%252Fb3c46a596f49e232dbd2970c0ca92ce0%252Fpa%252FBP20652_43cabfb4241ad6bcc3c7b9ae838464f3.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_43cabfb4241ad6bcc3c7b9ae838464f3.jpg not downloaded yet
2026-01-29 06:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PW30452> (referer: https://www.auto1.com/v1/car-details-view/PW30452/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 886a1040-1c8a-5d43-ad11-b235b82e2a31 with identifier: UF99896
2026-01-29 06:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 886a1040-1c8a-5d43-ad11-b235b82e2a31 with identifier: UF99896
2026-01-29 06:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c4 picasso 1.2 puretech live', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c4 picasso', 'transmission': 'manual', 'odometer': 131040, 'odometer_reading_unit': 'km', 'registration_date': '2018-02-01', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uf99896', 'expiration_date': '2026-01-29t16:42:04z', 'origin_country_code': 'fr', 'trim': 'live', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, toulouse', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 115, 'id': '886a1040-1c8a-5d43-ad11-b235b82e2a31', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_2a01d39ca2ea53b9c6ba91440984395b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 79966}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_dfae01e054a0fd74b87b9ce42b7862c5.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63516}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_1245176e5ae4820e219c9c614ff9db20.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65448}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_59d9e66f8f9c57996b2fb63e50abe0b7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57903}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_a9f1fb766f39e42d823f3910ea0d9e75.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 72446}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_3a3b5bf9441fc78ddc8e6693dc5efc96.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60331}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_e239d3fe039fca857b9a717f6634c3c4.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 50986}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_7e858d31164096cab3c0acb6b3be6121.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63019}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_8a64a48cbf17f26eb1c92bf775cf5631.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 75205}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_98b816ce581ed7093a523bcf4d75ff14.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 55185}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_62b3a5e8da081bf2e25e7920baa0ad8c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 37303}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_699f40976010cd02792b7078ea7232c6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 43123}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_289d0f28e82a636f14420d3ca66f8d3e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 39834}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_ea39f4ef6d210672f82a9aea048c5211.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 28051}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_cb1f4a1d89a89d616bbb4bed29407840.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 55141}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_4f6d485a4dab9dec3beffcd0ca60eeb9.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 118217}], 'current_year_diff': 8, 'age_in_months': 95, 'make_model': 'citroen c4 picasso', 'sanitized_make': 'citroen', 'odometer_in_km': 131040}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 95,
     'auction_title': '',
     'c_o_2_emission_value': 115,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:42:04z',
     'fuel_type': 'petrol',
     'id': '886a1040-1c8a-5d43-ad11-b235b82e2a31',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uf99896',
     'listing': 'auction',
     'location': 'fr, toulouse',
     'make': 'citroen',
     'make_model': 'citroen c4 picasso',
     'model': 'c4 picasso',
     'odometer': 131040,
     'odometer_in_km': 131040,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 16,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 79966,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_2a01d39ca2ea53b9c6ba91440984395b.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 63516,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_dfae01e054a0fd74b87b9ce42b7862c5.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 65448,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_1245176e5ae4820e219c9c614ff9db20.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57903,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_59d9e66f8f9c57996b2fb63e50abe0b7.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 72446,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_a9f1fb766f39e42d823f3910ea0d9e75.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 60331,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_3a3b5bf9441fc78ddc8e6693dc5efc96.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50986,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_e239d3fe039fca857b9a717f6634c3c4.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 63019,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_7e858d31164096cab3c0acb6b3be6121.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 75205,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_8a64a48cbf17f26eb1c92bf775cf5631.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 55185,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_98b816ce581ed7093a523bcf4d75ff14.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 37303,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_62b3a5e8da081bf2e25e7920baa0ad8c.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 43123,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_699f40976010cd02792b7078ea7232c6.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 39834,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_289d0f28e82a636f14420d3ca66f8d3e.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28051,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_ea39f4ef6d210672f82a9aea048c5211.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 55141,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_cb1f4a1d89a89d616bbb4bed29407840.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_15.png',
                 'Extension': 'png',
                 'FileSizeInBytes': 118217,
                 'Height': 525,
                 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_4f6d485a4dab9dec3beffcd0ca60eeb9.png',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-02-01',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c4 picasso 1.2 puretech live',
     'transmission': 'manual',
     'trim': 'live',
     'year': 2018}
2026-01-29 06:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 886a1040-1c8a-5d43-ad11-b235b82e2a31 spider: auto1.fr
2026-01-29 06:03:46 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 886a1040-1c8a-5d43-ad11-b235b82e2a31 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c4 picasso 1.2 puretech live', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c4 picasso', 'transmission': 'manual', 'odometer': 131040, 'odometer_reading_unit': 'km', 'registration_date': '2018-02-01', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uf99896', 'expiration_date': '2026-01-29t16:42:04z', 'origin_country_code': 'fr', 'trim': 'live', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, toulouse', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 115, 'id': '886a1040-1c8a-5d43-ad11-b235b82e2a31', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_2a01d39ca2ea53b9c6ba91440984395b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 79966}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_dfae01e054a0fd74b87b9ce42b7862c5.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63516}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_1245176e5ae4820e219c9c614ff9db20.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65448}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_59d9e66f8f9c57996b2fb63e50abe0b7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57903}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_a9f1fb766f39e42d823f3910ea0d9e75.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 72446}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_3a3b5bf9441fc78ddc8e6693dc5efc96.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60331}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_e239d3fe039fca857b9a717f6634c3c4.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 50986}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_7e858d31164096cab3c0acb6b3be6121.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63019}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_8a64a48cbf17f26eb1c92bf775cf5631.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 75205}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_98b816ce581ed7093a523bcf4d75ff14.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 55185}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_62b3a5e8da081bf2e25e7920baa0ad8c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 37303}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_699f40976010cd02792b7078ea7232c6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 43123}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_289d0f28e82a636f14420d3ca66f8d3e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 39834}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_ea39f4ef6d210672f82a9aea048c5211.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 28051}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_cb1f4a1d89a89d616bbb4bed29407840.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 55141}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_15.png', 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_4f6d485a4dab9dec3beffcd0ca60eeb9.png', 'Width': 800, 'Height': 525, 'Extension': 'png', 'FileSizeInBytes': 118217}], 'current_year_diff': 8, 'age_in_months': 95, 'make_model': 'citroen c4 picasso', 'sanitized_make': 'citroen', 'odometer_in_km': 131040}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 95,
     'auction_title': '',
     'c_o_2_emission_value': 115,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:42:04z',
     'fuel_type': 'petrol',
     'id': '886a1040-1c8a-5d43-ad11-b235b82e2a31',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uf99896',
     'listing': 'auction',
     'location': 'fr, toulouse',
     'make': 'citroen',
     'make_model': 'citroen c4 picasso',
     'model': 'c4 picasso',
     'odometer': 131040,
     'odometer_in_km': 131040,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 16,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 79966,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_2a01d39ca2ea53b9c6ba91440984395b.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 63516,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_dfae01e054a0fd74b87b9ce42b7862c5.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 65448,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_1245176e5ae4820e219c9c614ff9db20.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57903,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_59d9e66f8f9c57996b2fb63e50abe0b7.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 72446,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_a9f1fb766f39e42d823f3910ea0d9e75.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 60331,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_3a3b5bf9441fc78ddc8e6693dc5efc96.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50986,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_e239d3fe039fca857b9a717f6634c3c4.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 63019,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_7e858d31164096cab3c0acb6b3be6121.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 75205,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_8a64a48cbf17f26eb1c92bf775cf5631.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 55185,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_98b816ce581ed7093a523bcf4d75ff14.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 37303,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_62b3a5e8da081bf2e25e7920baa0ad8c.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 43123,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_699f40976010cd02792b7078ea7232c6.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 39834,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_289d0f28e82a636f14420d3ca66f8d3e.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28051,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_ea39f4ef6d210672f82a9aea048c5211.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 55141,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_cb1f4a1d89a89d616bbb4bed29407840.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_15.png',
                 'Extension': 'png',
                 'FileSizeInBytes': 118217,
                 'Height': 525,
                 'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_4f6d485a4dab9dec3beffcd0ca60eeb9.png',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-02-01',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c4 picasso 1.2 puretech live',
     'transmission': 'manual',
     'trim': 'live',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:42:04Z',
 'fuel_type': 'petrol',
 'id': '886a1040-1c8a-5d43-ad11-b235b82e2a31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF99896',
 'listing': 'auction',
 'location': 'FR, Toulouse',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 131040,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_2a01d39ca2ea53b9c6ba91440984395b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63516,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_dfae01e054a0fd74b87b9ce42b7862c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65448,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_1245176e5ae4820e219c9c614ff9db20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_59d9e66f8f9c57996b2fb63e50abe0b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_a9f1fb766f39e42d823f3910ea0d9e75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_3a3b5bf9441fc78ddc8e6693dc5efc96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_e239d3fe039fca857b9a717f6634c3c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_7e858d31164096cab3c0acb6b3be6121.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_8a64a48cbf17f26eb1c92bf775cf5631.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55185,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_98b816ce581ed7093a523bcf4d75ff14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37303,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_62b3a5e8da081bf2e25e7920baa0ad8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_699f40976010cd02792b7078ea7232c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_289d0f28e82a636f14420d3ca66f8d3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28051,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_ea39f4ef6d210672f82a9aea048c5211.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_cb1f4a1d89a89d616bbb4bed29407840.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886a1040-1c8a-5d43-ad11-b235b82e2a31/886a1040-1c8a-5d43-ad11-b235b82e2a31_image_15.png',
             'Extension': 'png',
             'FileSizeInBytes': 118217,
             'Height': 525,
             'OriginUrl': 'https://img-pa.auto1.com/img60/49/60494679e96cf09efbf03a60ea089aa5/pa/UF99896_4f6d485a4dab9dec3beffcd0ca60eeb9.png',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.2 PureTech Live',
 'transmission': 'manual',
 'trim': 'Live',
 'year': 2018}
2026-01-29 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UF99896%27 HTTP/1.1" 200 None
2026-01-29 06:03:46 [auto1.fr] INFO: Saving data for UF99896: {'created_time': 1769666626.065549, 'last_price_update_time': 1769666626.065558, 'auction_closing_time': 1769704924.0}
2026-01-29 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UF99896') HTTP/1.1" 204 0
2026-01-29 06:03:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 43bd3630-41e4-52a4-9947-26bad6894299 with identifier: RB75331
2026-01-29 06:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 43bd3630-41e4-52a4-9947-26bad6894299 with identifier: RB75331
2026-01-29 06:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel mokka x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'mokka x', 'transmission': 'automatic', 'odometer': 56310, 'odometer_reading_unit': 'km', 'registration_date': '2022-01-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/rb75331', 'expiration_date': '2026-01-29t16:22:52z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, saint aignan de grandlieu', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 134, 'id': '43bd3630-41e4-52a4-9947-26bad6894299', 'current_year_diff': 4, 'age_in_months': 47, 'make_model': 'opel mokka x', 'sanitized_make': 'opel', 'odometer_in_km': 56310}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 47,
     'auction_title': '',
     'c_o_2_emission_value': 134,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:22:52z',
     'fuel_type': 'petrol',
     'id': '43bd3630-41e4-52a4-9947-26bad6894299',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/rb75331',
     'listing': 'auction',
     'location': 'fr, saint aignan de grandlieu',
     'make': 'opel',
     'make_model': 'opel mokka x',
     'model': 'mokka x',
     'odometer': 56310,
     'odometer_in_km': 56310,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-01-30',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel mokka x 1.2 turbo business elegance',
     'transmission': 'automatic',
     'trim': 'business elegance',
     'year': 2022}
2026-01-29 06:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 43bd3630-41e4-52a4-9947-26bad6894299 spider: auto1.fr
2026-01-29 06:03:46 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 43bd3630-41e4-52a4-9947-26bad6894299 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel mokka x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'mokka x', 'transmission': 'automatic', 'odometer': 56310, 'odometer_reading_unit': 'km', 'registration_date': '2022-01-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/rb75331', 'expiration_date': '2026-01-29t16:22:52z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, saint aignan de grandlieu', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 134, 'id': '43bd3630-41e4-52a4-9947-26bad6894299', 'current_year_diff': 4, 'age_in_months': 47, 'make_model': 'opel mokka x', 'sanitized_make': 'opel', 'odometer_in_km': 56310}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 47,
     'auction_title': '',
     'c_o_2_emission_value': 134,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:22:52z',
     'fuel_type': 'petrol',
     'id': '43bd3630-41e4-52a4-9947-26bad6894299',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/rb75331',
     'listing': 'auction',
     'location': 'fr, saint aignan de grandlieu',
     'make': 'opel',
     'make_model': 'opel mokka x',
     'model': 'mokka x',
     'odometer': 56310,
     'odometer_in_km': 56310,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-01-30',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel mokka x 1.2 turbo business elegance',
     'transmission': 'automatic',
     'trim': 'business elegance',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:22:52Z',
 'fuel_type': 'petrol',
 'id': '43bd3630-41e4-52a4-9947-26bad6894299',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB75331',
 'listing': 'auction',
 'location': 'FR, Saint Aignan de Grandlieu',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 56310,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka X 1.2 Turbo Business Elegance',
 'transmission': 'automatic',
 'trim': 'Business Elegance',
 'year': 2022}
2026-01-29 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RB75331%27 HTTP/1.1" 200 None
2026-01-29 06:03:46 [auto1.fr] INFO: Saving data for RB75331: {'auction_closing_time': 1769703772.0, 'created_time': 1768819094.310757, 'last_price_update_time': 1769666626.404698}
2026-01-29 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RB75331') HTTP/1.1" 204 0
2026-01-29 06:03:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 22e4a1a9-8e50-5bba-b1a7-8e02269d1d7e with identifier: ZW66039
2026-01-29 06:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 22e4a1a9-8e50-5bba-b1a7-8e02269d1d7e with identifier: ZW66039
2026-01-29 06:03:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 22e4a1a9-8e50-5bba-b1a7-8e02269d1d7e with identifier: ZW66039 to the API
2026-01-29 06:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:03:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:03:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZW66039>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:26:16Z',
 'fuel_type': 'diesel',
 'id': '22e4a1a9-8e50-5bba-b1a7-8e02269d1d7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW66039',
 'listing': 'auction',
 'location': 'FR, Boé',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 124322,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.5 Blue-HDi Shine Business',
 'transmission': 'manual',
 'trim': 'Shine Business',
 'year': 2020}
2026-01-29 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZW66039%27 HTTP/1.1" 200 None
2026-01-29 06:03:46 [auto1.fr] INFO: Saving data for ZW66039: {'auction_closing_time': 1769703976.0, 'created_time': 1767866934.435362, 'last_price_update_time': 1769666626.774684}
2026-01-29 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZW66039') HTTP/1.1" 204 0
2026-01-29 06:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f304e10>
2026-01-29 06:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-29 06:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d7ca5a-8f66-565e-928c-b5ea65a557cd/e2d7ca5a-8f66-565e-928c-b5ea65a557cd_image_3.jpg HTTP/1.1" 201 0
2026-01-29 06:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F14%252Fef14cf0fc3f2d791fabb0a331665f04c%252Fpa%252FXA49145_d34abb4d2b7aa5342a5a780723e26573.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_d34abb4d2b7aa5342a5a780723e26573.jpg saved to cache
2026-01-29 06:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e2d7ca5a-8f66-565e-928c-b5ea65a557cd
2026-01-29 06:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6fe8ab90>
2026-01-29 06:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebd556ab-5120-52f2-9fba-5871b84db0bf/ebd556ab-5120-52f2-9fba-5871b84db0bf_image_0.jpg HTTP/1.1" 201 0
2026-01-29 06:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F5c%252Fe55cba11dcb6db7c9220cfd537533033%252Fpa%252FYA10266_c94eff5489f6ec8c65acc91b209af087.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_c94eff5489f6ec8c65acc91b209af087.jpg saved to cache
2026-01-29 06:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ebd556ab-5120-52f2-9fba-5871b84db0bf
2026-01-29 06:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_93c4653078ac23193363fa36b3920182.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_52a8d5cb4f1b3b526a4319aae4fc9595.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f3c0dd0>
2026-01-29 06:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d7ca5a-8f66-565e-928c-b5ea65a557cd/e2d7ca5a-8f66-565e-928c-b5ea65a557cd_image_4.jpg HTTP/1.1" 201 0
2026-01-29 06:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F14%252Fef14cf0fc3f2d791fabb0a331665f04c%252Fpa%252FXA49145_c0b7ceece9aac2b78e686144a0aad9ed.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_c0b7ceece9aac2b78e686144a0aad9ed.jpg saved to cache
2026-01-29 06:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e2d7ca5a-8f66-565e-928c-b5ea65a557cd
2026-01-29 06:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6feb5590>
2026-01-29 06:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebd556ab-5120-52f2-9fba-5871b84db0bf/ebd556ab-5120-52f2-9fba-5871b84db0bf_image_1.jpg HTTP/1.1" 201 0
2026-01-29 06:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F5c%252Fe55cba11dcb6db7c9220cfd537533033%252Fpa%252FYA10266_4465fc3c6a68e3451ed8b1436133c496.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_4465fc3c6a68e3451ed8b1436133c496.jpg saved to cache
2026-01-29 06:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ebd556ab-5120-52f2-9fba-5871b84db0bf
2026-01-29 06:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_defb133bf5db620f85f2b32f2ff64d2e.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:47 [auto1.fr] INFO: Found listing with ID: PT58377
2026-01-29 06:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PT58377%27 HTTP/1.1" 200 None
2026-01-29 06:03:47 [auto1.fr] INFO: Scrape type for PT58377: 0
2026-01-29 06:03:47 [auto1.fr] INFO: Found listing with ID: LN59630
2026-01-29 06:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LN59630%27 HTTP/1.1" 200 None
2026-01-29 06:03:48 [auto1.fr] INFO: Scrape type for LN59630: 0
2026-01-29 06:03:48 [auto1.fr] INFO: Found listing with ID: FK82779
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FK82779%27 HTTP/1.1" 200 None
2026-01-29 06:03:48 [auto1.fr] INFO: Scrape type for FK82779: 2
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F14%252Fef14cf0fc3f2d791fabb0a331665f04c%252Fpa%252FXA49145_76a05c29028b83677ed87507ce7f7326.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_76a05c29028b83677ed87507ce7f7326.jpg not downloaded yet
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2a%252F3d2a4f42266c8b5b8dba15df9facba85%252Fpa%252FMF46010_62eb0d2fdf3d2a58bad6d8b3a9c3ff1d.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_62eb0d2fdf3d2a58bad6d8b3a9c3ff1d.jpg not downloaded yet
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F5c%252Fe55cba11dcb6db7c9220cfd537533033%252Fpa%252FYA10266_b3d782766dcafad422977656a27581c7.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_b3d782766dcafad422977656a27581c7.jpg not downloaded yet
2026-01-29 06:03:48 [auto1.fr] INFO: Found listing with ID: ZB17169
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZB17169%27 HTTP/1.1" 200 None
2026-01-29 06:03:48 [auto1.fr] INFO: Scrape type for ZB17169: 2
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc4%252Fb3c46a596f49e232dbd2970c0ca92ce0%252Fpa%252FBP20652_30f1f74540f7950fd2272f938ecb238c.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_30f1f74540f7950fd2272f938ecb238c.jpg not downloaded yet
2026-01-29 06:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UV99262/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AF43348/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f3c2110>
2026-01-29 06:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e568ace-8955-5943-a54f-3b2b5d255c28/9e568ace-8955-5943-a54f-3b2b5d255c28_image_4.jpg HTTP/1.1" 201 0
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2a%252F3d2a4f42266c8b5b8dba15df9facba85%252Fpa%252FMF46010_f223c3135803b9eef571d54d06b95ac9.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_f223c3135803b9eef571d54d06b95ac9.jpg saved to cache
2026-01-29 06:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9e568ace-8955-5943-a54f-3b2b5d255c28
2026-01-29 06:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_65e8ac6b29f8e599cb744c570bb0cc82.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_f075c4ec90f1da31ce94aa054b78c3f5.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_259b1aadc1fff742fb3164ed1b854dd8.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WN63847/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f5b05d0>
2026-01-29 06:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebd556ab-5120-52f2-9fba-5871b84db0bf/ebd556ab-5120-52f2-9fba-5871b84db0bf_image_2.jpg HTTP/1.1" 201 0
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F5c%252Fe55cba11dcb6db7c9220cfd537533033%252Fpa%252FYA10266_132e0e0ceceff592e39c9929f1cad2ab.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_132e0e0ceceff592e39c9929f1cad2ab.jpg saved to cache
2026-01-29 06:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ebd556ab-5120-52f2-9fba-5871b84db0bf
2026-01-29 06:03:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbee8de8-e68c-57d4-a53e-b828bf51aa50 with identifier: PW30452
2026-01-29 06:03:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbee8de8-e68c-57d4-a53e-b828bf51aa50 with scrape type 2
2026-01-29 06:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbee8de8-e68c-57d4-a53e-b828bf51aa50 with scrape type 2
2026-01-29 06:03:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: dbee8de8-e68c-57d4-a53e-b828bf51aa50, identifier: PW30452
2026-01-29 06:03:48 [auto1.fr] INFO: Found listing with ID: VF92666
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VF92666%27 HTTP/1.1" 200 None
2026-01-29 06:03:48 [auto1.fr] INFO: Scrape type for VF92666: 0
2026-01-29 06:03:48 [auto1.fr] INFO: Found listing with ID: JK36366
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JK36366%27 HTTP/1.1" 200 None
2026-01-29 06:03:48 [auto1.fr] INFO: Scrape type for JK36366: 0
2026-01-29 06:03:48 [auto1.fr] INFO: Found listing with ID: YE55946
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YE55946%27 HTTP/1.1" 200 None
2026-01-29 06:03:48 [auto1.fr] INFO: Scrape type for YE55946: 0
2026-01-29 06:03:48 [auto1.fr] INFO: Found listing with ID: JD70507
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD70507%27 HTTP/1.1" 200 None
2026-01-29 06:03:48 [auto1.fr] INFO: Scrape type for JD70507: 2
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F14%252Fef14cf0fc3f2d791fabb0a331665f04c%252Fpa%252FXA49145_3dddb8f2a5236b2f779fd1d1356f0a79.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_3dddb8f2a5236b2f779fd1d1356f0a79.jpg not downloaded yet
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2a%252F3d2a4f42266c8b5b8dba15df9facba85%252Fpa%252FMF46010_0e22f8440fa54c741637f3f4854fcab4.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_0e22f8440fa54c741637f3f4854fcab4.jpg not downloaded yet
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F5c%252Fe55cba11dcb6db7c9220cfd537533033%252Fpa%252FYA10266_4a5644171f28a1d951b012ffb6121800.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_4a5644171f28a1d951b012ffb6121800.jpg not downloaded yet
2026-01-29 06:03:48 [auto1.fr] INFO: Found listing with ID: GK26515
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GK26515%27 HTTP/1.1" 200 None
2026-01-29 06:03:48 [auto1.fr] INFO: Scrape type for GK26515: 2
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc4%252Fb3c46a596f49e232dbd2970c0ca92ce0%252Fpa%252FBP20652_b1d1a6af57acdd34afa8933341c608e6.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_b1d1a6af57acdd34afa8933341c608e6.jpg not downloaded yet
2026-01-29 06:03:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dbee8de8-e68c-57d4-a53e-b828bf51aa50 with identifier: PW30452
2026-01-29 06:03:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dbee8de8-e68c-57d4-a53e-b828bf51aa50 with identifier: PW30452
2026-01-29 06:03:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: dbee8de8-e68c-57d4-a53e-b828bf51aa50 with identifier: PW30452 to the API
2026-01-29 06:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:03:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:03:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PW30452>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:14:55Z',
 'fuel_type': 'petrol',
 'id': 'dbee8de8-e68c-57d4-a53e-b828bf51aa50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW30452',
 'listing': 'auction',
 'location': 'FR, Saint-Saulve',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 77970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Juke 1.6 Visia',
 'transmission': 'manual',
 'trim': 'Visia',
 'year': 2017}
2026-01-29 06:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PW30452%27 HTTP/1.1" 200 None
2026-01-29 06:03:49 [auto1.fr] INFO: Saving data for PW30452: {'auction_closing_time': 1769703295.0, 'created_time': 1767609601.696858, 'last_price_update_time': 1769666629.37867}
2026-01-29 06:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PW30452') HTTP/1.1" 204 0
2026-01-29 06:03:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c2a28d0>
2026-01-29 06:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d7ca5a-8f66-565e-928c-b5ea65a557cd/e2d7ca5a-8f66-565e-928c-b5ea65a557cd_image_5.jpg HTTP/1.1" 201 0
2026-01-29 06:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F14%252Fef14cf0fc3f2d791fabb0a331665f04c%252Fpa%252FXA49145_93c4653078ac23193363fa36b3920182.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_93c4653078ac23193363fa36b3920182.jpg saved to cache
2026-01-29 06:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e2d7ca5a-8f66-565e-928c-b5ea65a557cd
2026-01-29 06:03:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c31f010>
2026-01-29 06:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e568ace-8955-5943-a54f-3b2b5d255c28/9e568ace-8955-5943-a54f-3b2b5d255c28_image_5.jpg HTTP/1.1" 201 0
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2a%252F3d2a4f42266c8b5b8dba15df9facba85%252Fpa%252FMF46010_52a8d5cb4f1b3b526a4319aae4fc9595.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_52a8d5cb4f1b3b526a4319aae4fc9595.jpg saved to cache
2026-01-29 06:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9e568ace-8955-5943-a54f-3b2b5d255c28
2026-01-29 06:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_4298da4a72c75675f99ec8be19207de9.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_c91d189f8c807b0691edcc71fac45e98.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LV70017/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c0eabd0>
2026-01-29 06:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e568ace-8955-5943-a54f-3b2b5d255c28/9e568ace-8955-5943-a54f-3b2b5d255c28_image_6.jpg HTTP/1.1" 201 0
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2a%252F3d2a4f42266c8b5b8dba15df9facba85%252Fpa%252FMF46010_defb133bf5db620f85f2b32f2ff64d2e.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_defb133bf5db620f85f2b32f2ff64d2e.jpg saved to cache
2026-01-29 06:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9e568ace-8955-5943-a54f-3b2b5d255c28
2026-01-29 06:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_43cabfb4241ad6bcc3c7b9ae838464f3.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:50 [auto1.fr] INFO: Found listing with ID: TY99778
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY99778%27 HTTP/1.1" 200 None
2026-01-29 06:03:50 [auto1.fr] INFO: Scrape type for TY99778: 0
2026-01-29 06:03:50 [auto1.fr] INFO: Found listing with ID: GY54357
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GY54357%27 HTTP/1.1" 200 None
2026-01-29 06:03:50 [auto1.fr] INFO: Scrape type for GY54357: 0
2026-01-29 06:03:50 [auto1.fr] INFO: Found listing with ID: JM20764
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JM20764%27 HTTP/1.1" 200 None
2026-01-29 06:03:50 [auto1.fr] INFO: Scrape type for JM20764: 0
2026-01-29 06:03:50 [auto1.fr] INFO: Found listing with ID: FE13802
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FE13802%27 HTTP/1.1" 200 None
2026-01-29 06:03:50 [auto1.fr] INFO: Scrape type for FE13802: 0
2026-01-29 06:03:50 [auto1.fr] INFO: Found listing with ID: XU26131
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XU26131%27 HTTP/1.1" 200 None
2026-01-29 06:03:50 [auto1.fr] INFO: Scrape type for XU26131: 2
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F14%252Fef14cf0fc3f2d791fabb0a331665f04c%252Fpa%252FXA49145_86b1f430b6a4a283c3f919c1a2441ddc.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_86b1f430b6a4a283c3f919c1a2441ddc.jpg not downloaded yet
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2a%252F3d2a4f42266c8b5b8dba15df9facba85%252Fpa%252FMF46010_519c432fa8d5867386bb79309de0a1f6.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_519c432fa8d5867386bb79309de0a1f6.jpg not downloaded yet
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F5c%252Fe55cba11dcb6db7c9220cfd537533033%252Fpa%252FYA10266_7f4a6e856ea6bd014622c63a3a2bca60.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_7f4a6e856ea6bd014622c63a3a2bca60.jpg not downloaded yet
2026-01-29 06:03:50 [auto1.fr] INFO: Found listing with ID: GJ30545
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GJ30545%27 HTTP/1.1" 200 None
2026-01-29 06:03:50 [auto1.fr] INFO: Scrape type for GJ30545: 2
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc4%252Fb3c46a596f49e232dbd2970c0ca92ce0%252Fpa%252FBP20652_4a2e50ca8d6c5318249f3dfc7004567f.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_4a2e50ca8d6c5318249f3dfc7004567f.jpg not downloaded yet
2026-01-29 06:03:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TG88286> (referer: https://www.auto1.com/v1/car-details-view/TG88286/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c1b1510>
2026-01-29 06:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d7ca5a-8f66-565e-928c-b5ea65a557cd/e2d7ca5a-8f66-565e-928c-b5ea65a557cd_image_6.jpg HTTP/1.1" 201 0
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F14%252Fef14cf0fc3f2d791fabb0a331665f04c%252Fpa%252FXA49145_65e8ac6b29f8e599cb744c570bb0cc82.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_65e8ac6b29f8e599cb744c570bb0cc82.jpg saved to cache
2026-01-29 06:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e2d7ca5a-8f66-565e-928c-b5ea65a557cd
2026-01-29 06:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c135310>
2026-01-29 06:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebd556ab-5120-52f2-9fba-5871b84db0bf/ebd556ab-5120-52f2-9fba-5871b84db0bf_image_3.jpg HTTP/1.1" 201 0
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F5c%252Fe55cba11dcb6db7c9220cfd537533033%252Fpa%252FYA10266_f075c4ec90f1da31ce94aa054b78c3f5.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_f075c4ec90f1da31ce94aa054b78c3f5.jpg saved to cache
2026-01-29 06:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ebd556ab-5120-52f2-9fba-5871b84db0bf
2026-01-29 06:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f585f10>
2026-01-29 06:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_937be206-8155-5ddd-8336-77230dfffb18/937be206-8155-5ddd-8336-77230dfffb18_image_0.jpg HTTP/1.1" 201 0
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc4%252Fb3c46a596f49e232dbd2970c0ca92ce0%252Fpa%252FBP20652_259b1aadc1fff742fb3164ed1b854dd8.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_259b1aadc1fff742fb3164ed1b854dd8.jpg saved to cache
2026-01-29 06:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 937be206-8155-5ddd-8336-77230dfffb18
2026-01-29 06:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_be677b1ae2fe6079841d951e49c17d09.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_436c8bc78a6fd84a98f8e171532d8f35.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SJ18122/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DL84076/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_30f1f74540f7950fd2272f938ecb238c.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_8a564e8148769b8c8d62edd0e7bd7b63.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:51 [auto1.fr] INFO: Found listing with ID: PF51056
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF51056%27 HTTP/1.1" 200 None
2026-01-29 06:03:51 [auto1.fr] INFO: Scrape type for PF51056: 0
2026-01-29 06:03:51 [auto1.fr] INFO: Found listing with ID: NR15792
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NR15792%27 HTTP/1.1" 200 None
2026-01-29 06:03:51 [auto1.fr] INFO: Scrape type for NR15792: 0
2026-01-29 06:03:51 [auto1.fr] INFO: Found listing with ID: VE10674
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VE10674%27 HTTP/1.1" 200 None
2026-01-29 06:03:51 [auto1.fr] INFO: Scrape type for VE10674: 0
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F14%252Fef14cf0fc3f2d791fabb0a331665f04c%252Fpa%252FXA49145_3df9134a3d2421768f875904d01cc6e1.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_3df9134a3d2421768f875904d01cc6e1.jpg not downloaded yet
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2a%252F3d2a4f42266c8b5b8dba15df9facba85%252Fpa%252FMF46010_1f836c2e1e0e435ca0e5e3006eb501f6.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_1f836c2e1e0e435ca0e5e3006eb501f6.jpg not downloaded yet
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F5c%252Fe55cba11dcb6db7c9220cfd537533033%252Fpa%252FYA10266_6347c3c711733e89f905555ef2072ae0.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_6347c3c711733e89f905555ef2072ae0.jpg not downloaded yet
2026-01-29 06:03:51 [auto1.fr] INFO: Found listing with ID: GP19694
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GP19694%27 HTTP/1.1" 200 None
2026-01-29 06:03:51 [auto1.fr] INFO: Scrape type for GP19694: 2
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc4%252Fb3c46a596f49e232dbd2970c0ca92ce0%252Fpa%252FBP20652_e38a262fefbb68e7b10ca9a0ca3ce40d.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_e38a262fefbb68e7b10ca9a0ca3ce40d.jpg not downloaded yet
2026-01-29 06:03:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f4df090>
2026-01-29 06:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebd556ab-5120-52f2-9fba-5871b84db0bf/ebd556ab-5120-52f2-9fba-5871b84db0bf_image_4.jpg HTTP/1.1" 201 0
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F5c%252Fe55cba11dcb6db7c9220cfd537533033%252Fpa%252FYA10266_4298da4a72c75675f99ec8be19207de9.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_4298da4a72c75675f99ec8be19207de9.jpg saved to cache
2026-01-29 06:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ebd556ab-5120-52f2-9fba-5871b84db0bf
2026-01-29 06:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f3f79d0>
2026-01-29 06:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_937be206-8155-5ddd-8336-77230dfffb18/937be206-8155-5ddd-8336-77230dfffb18_image_1.jpg HTTP/1.1" 201 0
2026-01-29 06:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc4%252Fb3c46a596f49e232dbd2970c0ca92ce0%252Fpa%252FBP20652_c91d189f8c807b0691edcc71fac45e98.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_c91d189f8c807b0691edcc71fac45e98.jpg saved to cache
2026-01-29 06:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 937be206-8155-5ddd-8336-77230dfffb18
2026-01-29 06:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff65350>
2026-01-29 06:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_937be206-8155-5ddd-8336-77230dfffb18/937be206-8155-5ddd-8336-77230dfffb18_image_2.jpg HTTP/1.1" 201 0
2026-01-29 06:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc4%252Fb3c46a596f49e232dbd2970c0ca92ce0%252Fpa%252FBP20652_43cabfb4241ad6bcc3c7b9ae838464f3.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_43cabfb4241ad6bcc3c7b9ae838464f3.jpg saved to cache
2026-01-29 06:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 937be206-8155-5ddd-8336-77230dfffb18
2026-01-29 06:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3185fdde-f8bb-55f3-b75f-8236b7d34b5b with identifier: TG88286
2026-01-29 06:03:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3185fdde-f8bb-55f3-b75f-8236b7d34b5b with scrape type 2
2026-01-29 06:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3185fdde-f8bb-55f3-b75f-8236b7d34b5b with scrape type 2
2026-01-29 06:03:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3185fdde-f8bb-55f3-b75f-8236b7d34b5b, identifier: TG88286
2026-01-29 06:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_b3d782766dcafad422977656a27581c7.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_b1d1a6af57acdd34afa8933341c608e6.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F14%252Fef14cf0fc3f2d791fabb0a331665f04c%252Fpa%252FXA49145_0cb86aaf0ef5d0b8215090166b9249b1.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_0cb86aaf0ef5d0b8215090166b9249b1.jpg not downloaded yet
2026-01-29 06:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2a%252F3d2a4f42266c8b5b8dba15df9facba85%252Fpa%252FMF46010_520cb2abd9626027f59360b7e46d5b23.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_520cb2abd9626027f59360b7e46d5b23.jpg not downloaded yet
2026-01-29 06:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F5c%252Fe55cba11dcb6db7c9220cfd537533033%252Fpa%252FYA10266_1b5aaa14e3e8dd21ae9ff9d2b9814227.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_1b5aaa14e3e8dd21ae9ff9d2b9814227.jpg not downloaded yet
2026-01-29 06:03:52 [auto1.fr] INFO: Found listing with ID: DM14339
2026-01-29 06:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DM14339%27 HTTP/1.1" 200 None
2026-01-29 06:03:52 [auto1.fr] INFO: Scrape type for DM14339: 0
2026-01-29 06:03:52 [auto1.fr] INFO: Found listing with ID: HW54822
2026-01-29 06:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HW54822%27 HTTP/1.1" 200 None
2026-01-29 06:03:52 [auto1.fr] INFO: Scrape type for HW54822: 2
2026-01-29 06:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc4%252Fb3c46a596f49e232dbd2970c0ca92ce0%252Fpa%252FBP20652_05c0447230ba4fb59aef5bbce5d3b41b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_05c0447230ba4fb59aef5bbce5d3b41b.jpg not downloaded yet
2026-01-29 06:03:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3185fdde-f8bb-55f3-b75f-8236b7d34b5b with identifier: TG88286
2026-01-29 06:03:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3185fdde-f8bb-55f3-b75f-8236b7d34b5b with identifier: TG88286
2026-01-29 06:03:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3185fdde-f8bb-55f3-b75f-8236b7d34b5b with identifier: TG88286 to the API
2026-01-29 06:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:03:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:03:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TG88286>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 218,
 'expiration_date': '2026-01-29T16:22:07Z',
 'fuel_type': 'hybrid',
 'id': '3185fdde-f8bb-55f3-b75f-8236b7d34b5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG88286',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 109500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-01-29 06:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TG88286%27 HTTP/1.1" 200 None
2026-01-29 06:03:53 [auto1.fr] INFO: Saving data for TG88286: {'auction_closing_time': 1769703727.0, 'created_time': 1769101805.451238, 'last_price_update_time': 1769666633.244596}
2026-01-29 06:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TG88286') HTTP/1.1" 204 0
2026-01-29 06:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_4a5644171f28a1d951b012ffb6121800.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f3f4210>
2026-01-29 06:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebd556ab-5120-52f2-9fba-5871b84db0bf/ebd556ab-5120-52f2-9fba-5871b84db0bf_image_5.jpg HTTP/1.1" 201 0
2026-01-29 06:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F5c%252Fe55cba11dcb6db7c9220cfd537533033%252Fpa%252FYA10266_be677b1ae2fe6079841d951e49c17d09.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_be677b1ae2fe6079841d951e49c17d09.jpg saved to cache
2026-01-29 06:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ebd556ab-5120-52f2-9fba-5871b84db0bf
2026-01-29 06:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f486690>
2026-01-29 06:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d7ca5a-8f66-565e-928c-b5ea65a557cd/e2d7ca5a-8f66-565e-928c-b5ea65a557cd_image_8.jpg HTTP/1.1" 201 0
2026-01-29 06:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F14%252Fef14cf0fc3f2d791fabb0a331665f04c%252Fpa%252FXA49145_436c8bc78a6fd84a98f8e171532d8f35.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_436c8bc78a6fd84a98f8e171532d8f35.jpg saved to cache
2026-01-29 06:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e2d7ca5a-8f66-565e-928c-b5ea65a557cd
2026-01-29 06:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f555c90>
2026-01-29 06:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_937be206-8155-5ddd-8336-77230dfffb18/937be206-8155-5ddd-8336-77230dfffb18_image_3.jpg HTTP/1.1" 201 0
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc4%252Fb3c46a596f49e232dbd2970c0ca92ce0%252Fpa%252FBP20652_30f1f74540f7950fd2272f938ecb238c.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_30f1f74540f7950fd2272f938ecb238c.jpg saved to cache
2026-01-29 06:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 937be206-8155-5ddd-8336-77230dfffb18
2026-01-29 06:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c2a03d0>
2026-01-29 06:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e568ace-8955-5943-a54f-3b2b5d255c28/9e568ace-8955-5943-a54f-3b2b5d255c28_image_8.jpg HTTP/1.1" 201 0
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2a%252F3d2a4f42266c8b5b8dba15df9facba85%252Fpa%252FMF46010_8a564e8148769b8c8d62edd0e7bd7b63.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_8a564e8148769b8c8d62edd0e7bd7b63.jpg saved to cache
2026-01-29 06:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9e568ace-8955-5943-a54f-3b2b5d255c28
2026-01-29 06:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_7f4a6e856ea6bd014622c63a3a2bca60.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F14%252Fef14cf0fc3f2d791fabb0a331665f04c%252Fpa%252FXA49145_f4ec9fa6bb9ac10f24bfac06f64a4e4d.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_f4ec9fa6bb9ac10f24bfac06f64a4e4d.jpg not downloaded yet
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2a%252F3d2a4f42266c8b5b8dba15df9facba85%252Fpa%252FMF46010_922f4d90c87fe863ebc2b4bf499f2f55.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_922f4d90c87fe863ebc2b4bf499f2f55.jpg not downloaded yet
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F5c%252Fe55cba11dcb6db7c9220cfd537533033%252Fpa%252FYA10266_34c2618888936959432db9dfaf35957a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_34c2618888936959432db9dfaf35957a.jpg not downloaded yet
2026-01-29 06:03:54 [auto1.fr] INFO: Found listing with ID: JW59951
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JW59951%27 HTTP/1.1" 200 None
2026-01-29 06:03:54 [auto1.fr] INFO: Scrape type for JW59951: 0
2026-01-29 06:03:54 [auto1.fr] INFO: Found listing with ID: MG51218
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG51218%27 HTTP/1.1" 200 None
2026-01-29 06:03:54 [auto1.fr] INFO: Scrape type for MG51218: 0
2026-01-29 06:03:54 [auto1.fr] INFO: Found listing with ID: ES79213
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ES79213%27 HTTP/1.1" 200 None
2026-01-29 06:03:54 [auto1.fr] INFO: Scrape type for ES79213: 0
2026-01-29 06:03:54 [auto1.fr] INFO: Found listing with ID: AJ28217
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AJ28217%27 HTTP/1.1" 200 None
2026-01-29 06:03:54 [auto1.fr] INFO: Scrape type for AJ28217: 0
2026-01-29 06:03:54 [auto1.fr] INFO: Found listing with ID: YC62546
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YC62546%27 HTTP/1.1" 200 None
2026-01-29 06:03:54 [auto1.fr] INFO: Scrape type for YC62546: 0
2026-01-29 06:03:54 [auto1.fr] INFO: Found listing with ID: UM56564
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UM56564%27 HTTP/1.1" 200 None
2026-01-29 06:03:54 [auto1.fr] INFO: Scrape type for UM56564: 2
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc4%252Fb3c46a596f49e232dbd2970c0ca92ce0%252Fpa%252FBP20652_7bebfa258593678385c92960d2b6f13a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_7bebfa258593678385c92960d2b6f13a.jpg not downloaded yet
2026-01-29 06:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_4a2e50ca8d6c5318249f3dfc7004567f.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6fef6910>
2026-01-29 06:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-29 06:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebd556ab-5120-52f2-9fba-5871b84db0bf/ebd556ab-5120-52f2-9fba-5871b84db0bf_image_6.jpg HTTP/1.1" 201 0
2026-01-29 06:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F5c%252Fe55cba11dcb6db7c9220cfd537533033%252Fpa%252FYA10266_b3d782766dcafad422977656a27581c7.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_b3d782766dcafad422977656a27581c7.jpg saved to cache
2026-01-29 06:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ebd556ab-5120-52f2-9fba-5871b84db0bf
2026-01-29 06:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f45cb10>
2026-01-29 06:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_937be206-8155-5ddd-8336-77230dfffb18/937be206-8155-5ddd-8336-77230dfffb18_image_4.jpg HTTP/1.1" 201 0
2026-01-29 06:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc4%252Fb3c46a596f49e232dbd2970c0ca92ce0%252Fpa%252FBP20652_b1d1a6af57acdd34afa8933341c608e6.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_b1d1a6af57acdd34afa8933341c608e6.jpg saved to cache
2026-01-29 06:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 937be206-8155-5ddd-8336-77230dfffb18
2026-01-29 06:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_e38a262fefbb68e7b10ca9a0ca3ce40d.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F14%252Fef14cf0fc3f2d791fabb0a331665f04c%252Fpa%252FXA49145_b002fad87fcbc027c037170b1f1e8863.png%27 HTTP/1.1" 200 None
2026-01-29 06:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_b002fad87fcbc027c037170b1f1e8863.png not downloaded yet
2026-01-29 06:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2a%252F3d2a4f42266c8b5b8dba15df9facba85%252Fpa%252FMF46010_f8a29b9462179dd5b88d0c4d78eaa299.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_f8a29b9462179dd5b88d0c4d78eaa299.jpg not downloaded yet
2026-01-29 06:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F5c%252Fe55cba11dcb6db7c9220cfd537533033%252Fpa%252FYA10266_35bbc9949e5881fd9ad8fb77ed8e005c.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_35bbc9949e5881fd9ad8fb77ed8e005c.jpg not downloaded yet
2026-01-29 06:03:55 [auto1.fr] INFO: Found listing with ID: KY52527
2026-01-29 06:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KY52527%27 HTTP/1.1" 200 None
2026-01-29 06:03:55 [auto1.fr] INFO: Scrape type for KY52527: 0
2026-01-29 06:03:55 [auto1.fr] INFO: Found listing with ID: DV70429
2026-01-29 06:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DV70429%27 HTTP/1.1" 200 None
2026-01-29 06:03:55 [auto1.fr] INFO: Scrape type for DV70429: 0
2026-01-29 06:03:55 [auto1.fr] INFO: Found listing with ID: YP23412
2026-01-29 06:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP23412%27 HTTP/1.1" 200 None
2026-01-29 06:03:55 [auto1.fr] INFO: Scrape type for YP23412: 2
2026-01-29 06:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc4%252Fb3c46a596f49e232dbd2970c0ca92ce0%252Fpa%252FBP20652_3d65b9c4458d6383ba881020ae36b5ef.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_3d65b9c4458d6383ba881020ae36b5ef.jpg not downloaded yet
2026-01-29 06:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f45e2d0>
2026-01-29 06:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebd556ab-5120-52f2-9fba-5871b84db0bf/ebd556ab-5120-52f2-9fba-5871b84db0bf_image_7.jpg HTTP/1.1" 201 0
2026-01-29 06:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F5c%252Fe55cba11dcb6db7c9220cfd537533033%252Fpa%252FYA10266_4a5644171f28a1d951b012ffb6121800.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_4a5644171f28a1d951b012ffb6121800.jpg saved to cache
2026-01-29 06:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ebd556ab-5120-52f2-9fba-5871b84db0bf
2026-01-29 06:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff6ea90>
2026-01-29 06:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebd556ab-5120-52f2-9fba-5871b84db0bf/ebd556ab-5120-52f2-9fba-5871b84db0bf_image_8.jpg HTTP/1.1" 201 0
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F5c%252Fe55cba11dcb6db7c9220cfd537533033%252Fpa%252FYA10266_7f4a6e856ea6bd014622c63a3a2bca60.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_7f4a6e856ea6bd014622c63a3a2bca60.jpg saved to cache
2026-01-29 06:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ebd556ab-5120-52f2-9fba-5871b84db0bf
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F5c%252Fe55cba11dcb6db7c9220cfd537533033%252Fpa%252FYA10266_610f17121f0c85e521c8e66a3ed8b308.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_610f17121f0c85e521c8e66a3ed8b308.jpg not downloaded yet
2026-01-29 06:03:56 [auto1.fr] INFO: Found listing with ID: CA62859
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA62859%27 HTTP/1.1" 200 None
2026-01-29 06:03:56 [auto1.fr] INFO: Scrape type for CA62859: 2
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc4%252Fb3c46a596f49e232dbd2970c0ca92ce0%252Fpa%252FBP20652_9a680e05659dbb083a3dfa61d41d6928.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_9a680e05659dbb083a3dfa61d41d6928.jpg not downloaded yet
2026-01-29 06:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c2bc250>
2026-01-29 06:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_937be206-8155-5ddd-8336-77230dfffb18/937be206-8155-5ddd-8336-77230dfffb18_image_5.jpg HTTP/1.1" 201 0
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc4%252Fb3c46a596f49e232dbd2970c0ca92ce0%252Fpa%252FBP20652_4a2e50ca8d6c5318249f3dfc7004567f.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_4a2e50ca8d6c5318249f3dfc7004567f.jpg saved to cache
2026-01-29 06:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 937be206-8155-5ddd-8336-77230dfffb18
2026-01-29 06:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_05c0447230ba4fb59aef5bbce5d3b41b.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f3c1e90>
2026-01-29 06:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_937be206-8155-5ddd-8336-77230dfffb18/937be206-8155-5ddd-8336-77230dfffb18_image_6.jpg HTTP/1.1" 201 0
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc4%252Fb3c46a596f49e232dbd2970c0ca92ce0%252Fpa%252FBP20652_e38a262fefbb68e7b10ca9a0ca3ce40d.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_e38a262fefbb68e7b10ca9a0ca3ce40d.jpg saved to cache
2026-01-29 06:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 937be206-8155-5ddd-8336-77230dfffb18
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F5c%252Fe55cba11dcb6db7c9220cfd537533033%252Fpa%252FYA10266_24899ed6265cbeede611ffe4b69cf75b.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_24899ed6265cbeede611ffe4b69cf75b.jpg not downloaded yet
2026-01-29 06:03:56 [auto1.fr] INFO: Found listing with ID: MM71659
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MM71659%27 HTTP/1.1" 200 None
2026-01-29 06:03:56 [auto1.fr] INFO: Scrape type for MM71659: 0
2026-01-29 06:03:56 [auto1.fr] INFO: Found listing with ID: PB63508
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PB63508%27 HTTP/1.1" 200 None
2026-01-29 06:03:56 [auto1.fr] INFO: Scrape type for PB63508: 0
2026-01-29 06:03:56 [auto1.fr] INFO: Found listing with ID: GJ51995
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GJ51995%27 HTTP/1.1" 200 None
2026-01-29 06:03:56 [auto1.fr] INFO: Scrape type for GJ51995: 0
2026-01-29 06:03:56 [auto1.fr] INFO: Found listing with ID: GZ68533
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GZ68533%27 HTTP/1.1" 200 None
2026-01-29 06:03:56 [auto1.fr] INFO: Scrape type for GZ68533: 0
2026-01-29 06:03:56 [auto1.fr] INFO: Found listing with ID: AK67158
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AK67158%27 HTTP/1.1" 200 None
2026-01-29 06:03:56 [auto1.fr] INFO: Scrape type for AK67158: 0
2026-01-29 06:03:56 [auto1.fr] INFO: Found listing with ID: HC62658
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC62658%27 HTTP/1.1" 200 None
2026-01-29 06:03:56 [auto1.fr] INFO: Scrape type for HC62658: 2
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc4%252Fb3c46a596f49e232dbd2970c0ca92ce0%252Fpa%252FBP20652_d8f0c44dcc99b060a6d217cb12431a25.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_d8f0c44dcc99b060a6d217cb12431a25.jpg not downloaded yet
2026-01-29 06:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KU11817/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZB17169/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AF43348> (referer: https://www.auto1.com/v1/car-details-view/AF43348/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GK26515/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_7bebfa258593678385c92960d2b6f13a.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GM65156> (referer: https://www.auto1.com/v1/car-details-view/GM65156/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:56 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F5c%252Fe55cba11dcb6db7c9220cfd537533033%252Fpa%252FYA10266_b9d89d41c39e9b49afd3beaace876f03.png%27 HTTP/1.1" 200 None
2026-01-29 06:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_b9d89d41c39e9b49afd3beaace876f03.png not downloaded yet
2026-01-29 06:03:56 [auto1.fr] INFO: Found listing with ID: UL00311
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL00311%27 HTTP/1.1" 200 None
2026-01-29 06:03:56 [auto1.fr] INFO: Scrape type for UL00311: 0
2026-01-29 06:03:56 [auto1.fr] INFO: Found listing with ID: VC39661
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VC39661%27 HTTP/1.1" 200 None
2026-01-29 06:03:56 [auto1.fr] INFO: Scrape type for VC39661: 0
2026-01-29 06:03:56 [auto1.fr] INFO: Found listing with ID: FZ39792
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FZ39792%27 HTTP/1.1" 200 None
2026-01-29 06:03:56 [auto1.fr] INFO: Scrape type for FZ39792: 0
2026-01-29 06:03:56 [auto1.fr] INFO: Found listing with ID: TX96155
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TX96155%27 HTTP/1.1" 200 None
2026-01-29 06:03:56 [auto1.fr] INFO: Scrape type for TX96155: 0
2026-01-29 06:03:56 [auto1.fr] INFO: Found listing with ID: UB61535
2026-01-29 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UB61535%27 HTTP/1.1" 200 None
2026-01-29 06:03:57 [auto1.fr] INFO: Scrape type for UB61535: 2
2026-01-29 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc4%252Fb3c46a596f49e232dbd2970c0ca92ce0%252Fpa%252FBP20652_d795e89d8018b211378727c09b2cd5ce.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_d795e89d8018b211378727c09b2cd5ce.jpg not downloaded yet
2026-01-29 06:03:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ffcb890>
2026-01-29 06:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_937be206-8155-5ddd-8336-77230dfffb18/937be206-8155-5ddd-8336-77230dfffb18_image_7.jpg HTTP/1.1" 201 0
2026-01-29 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc4%252Fb3c46a596f49e232dbd2970c0ca92ce0%252Fpa%252FBP20652_05c0447230ba4fb59aef5bbce5d3b41b.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_05c0447230ba4fb59aef5bbce5d3b41b.jpg saved to cache
2026-01-29 06:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 937be206-8155-5ddd-8336-77230dfffb18
2026-01-29 06:03:57 [auto1.fr] INFO: Found listing with ID: EK50405
2026-01-29 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EK50405%27 HTTP/1.1" 200 None
2026-01-29 06:03:57 [auto1.fr] INFO: Scrape type for EK50405: 2
2026-01-29 06:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HK10948/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_3d65b9c4458d6383ba881020ae36b5ef.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:57 [auto1.fr] INFO: Found listing with ID: MB18681
2026-01-29 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MB18681%27 HTTP/1.1" 200 None
2026-01-29 06:03:57 [auto1.fr] INFO: Scrape type for MB18681: 0
2026-01-29 06:03:57 [auto1.fr] INFO: Found listing with ID: JG92327
2026-01-29 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG92327%27 HTTP/1.1" 200 None
2026-01-29 06:03:57 [auto1.fr] INFO: Scrape type for JG92327: 2
2026-01-29 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc4%252Fb3c46a596f49e232dbd2970c0ca92ce0%252Fpa%252FBP20652_003e43e0cdc433a1b1d8f6a550af6ab3.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_003e43e0cdc433a1b1d8f6a550af6ab3.jpg not downloaded yet
2026-01-29 06:03:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:57 [auto1.fr] INFO: Found listing with ID: FH19990
2026-01-29 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FH19990%27 HTTP/1.1" 200 None
2026-01-29 06:03:57 [auto1.fr] INFO: Scrape type for FH19990: 0
2026-01-29 06:03:57 [auto1.fr] INFO: Found listing with ID: TZ78774
2026-01-29 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TZ78774%27 HTTP/1.1" 200 None
2026-01-29 06:03:57 [auto1.fr] INFO: Scrape type for TZ78774: 2
2026-01-29 06:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aedc146e-7aa3-518d-9f23-c46bb09efc19 with identifier: AF43348
2026-01-29 06:03:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aedc146e-7aa3-518d-9f23-c46bb09efc19 with scrape type 2
2026-01-29 06:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aedc146e-7aa3-518d-9f23-c46bb09efc19 with scrape type 2
2026-01-29 06:03:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: aedc146e-7aa3-518d-9f23-c46bb09efc19, identifier: AF43348
2026-01-29 06:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c0c15d0>
2026-01-29 06:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_937be206-8155-5ddd-8336-77230dfffb18/937be206-8155-5ddd-8336-77230dfffb18_image_8.jpg HTTP/1.1" 201 0
2026-01-29 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc4%252Fb3c46a596f49e232dbd2970c0ca92ce0%252Fpa%252FBP20652_7bebfa258593678385c92960d2b6f13a.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_7bebfa258593678385c92960d2b6f13a.jpg saved to cache
2026-01-29 06:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 937be206-8155-5ddd-8336-77230dfffb18
2026-01-29 06:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 127ff327-5e9a-54a6-9044-df819b35bf37 with identifier: GM65156
2026-01-29 06:03:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 127ff327-5e9a-54a6-9044-df819b35bf37 with scrape type 2
2026-01-29 06:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 127ff327-5e9a-54a6-9044-df819b35bf37 with scrape type 2
2026-01-29 06:03:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 127ff327-5e9a-54a6-9044-df819b35bf37, identifier: GM65156
2026-01-29 06:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_35bbc9949e5881fd9ad8fb77ed8e005c.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_9a680e05659dbb083a3dfa61d41d6928.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_610f17121f0c85e521c8e66a3ed8b308.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_d8f0c44dcc99b060a6d217cb12431a25.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:58 [auto1.fr] INFO: Found listing with ID: GF92974
2026-01-29 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF92974%27 HTTP/1.1" 200 None
2026-01-29 06:03:58 [auto1.fr] INFO: Scrape type for GF92974: 2
2026-01-29 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc4%252Fb3c46a596f49e232dbd2970c0ca92ce0%252Fpa%252FBP20652_a92b8ff51b0b57e3fd58fbd511dd769d.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_a92b8ff51b0b57e3fd58fbd511dd769d.jpg not downloaded yet
2026-01-29 06:03:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: aedc146e-7aa3-518d-9f23-c46bb09efc19 with identifier: AF43348
2026-01-29 06:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: aedc146e-7aa3-518d-9f23-c46bb09efc19 with identifier: AF43348
2026-01-29 06:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 190636 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    190636
2026-01-29 06:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: aedc146e-7aa3-518d-9f23-c46bb09efc19 spider: auto1.fr
2026-01-29 06:03:58 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: aedc146e-7aa3-518d-9f23-c46bb09efc19 due to rule: high_mileage_for_country.json, error: 190636 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    190636
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:10:02Z',
 'fuel_type': 'diesel',
 'id': 'aedc146e-7aa3-518d-9f23-c46bb09efc19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF43348',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 190636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X4 xDrive 20d Mild-Hybrid M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-01-29 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AF43348%27 HTTP/1.1" 200 None
2026-01-29 06:03:58 [auto1.fr] INFO: Saving data for AF43348: {'auction_closing_time': 1769703002.0, 'created_time': 1768891289.653623, 'last_price_update_time': 1769666638.330016}
2026-01-29 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AF43348') HTTP/1.1" 204 0
2026-01-29 06:03:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 127ff327-5e9a-54a6-9044-df819b35bf37 with identifier: GM65156
2026-01-29 06:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 127ff327-5e9a-54a6-9044-df819b35bf37 with identifier: GM65156
2026-01-29 06:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'renault austral 1.2 hybrid e-tech iconic esprit alpine', 'price': 0, 'currency': 'eur', 'make': 'renault', 'model': 'austral', 'transmission': 'automatic', 'odometer': 85575, 'odometer_reading_unit': 'km', 'registration_date': '2023-01-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gm65156', 'expiration_date': '2026-01-29t16:25:20z', 'origin_country_code': 'fr', 'trim': 'iconic esprit alpine', 'year': 2023, 'fuel_type': 'hybrid', 'listing': 'auction', 'engine_horse_power': 200, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'échirolles', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 106, 'id': '127ff327-5e9a-54a6-9044-df819b35bf37', 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'renault austral', 'sanitized_make': 'renault', 'odometer_in_km': 85575}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': 106,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 200,
     'expiration_date': '2026-01-29t16:25:20z',
     'fuel_type': 'hybrid',
     'id': '127ff327-5e9a-54a6-9044-df819b35bf37',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gm65156',
     'listing': 'auction',
     'location': 'échirolles',
     'make': 'renault',
     'make_model': 'renault austral',
     'model': 'austral',
     'odometer': 85575,
     'odometer_in_km': 85575,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-01-24',
     'sanitized_make': 'renault',
     'seats_number': 5,
     'seller_name': None,
     'title': 'renault austral 1.2 hybrid e-tech iconic esprit alpine',
     'transmission': 'automatic',
     'trim': 'iconic esprit alpine',
     'year': 2023}
2026-01-29 06:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 127ff327-5e9a-54a6-9044-df819b35bf37 spider: auto1.fr
2026-01-29 06:03:58 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 127ff327-5e9a-54a6-9044-df819b35bf37 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'renault austral 1.2 hybrid e-tech iconic esprit alpine', 'price': 0, 'currency': 'eur', 'make': 'renault', 'model': 'austral', 'transmission': 'automatic', 'odometer': 85575, 'odometer_reading_unit': 'km', 'registration_date': '2023-01-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gm65156', 'expiration_date': '2026-01-29t16:25:20z', 'origin_country_code': 'fr', 'trim': 'iconic esprit alpine', 'year': 2023, 'fuel_type': 'hybrid', 'listing': 'auction', 'engine_horse_power': 200, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'échirolles', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 106, 'id': '127ff327-5e9a-54a6-9044-df819b35bf37', 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'renault austral', 'sanitized_make': 'renault', 'odometer_in_km': 85575}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': 106,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 200,
     'expiration_date': '2026-01-29t16:25:20z',
     'fuel_type': 'hybrid',
     'id': '127ff327-5e9a-54a6-9044-df819b35bf37',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gm65156',
     'listing': 'auction',
     'location': 'échirolles',
     'make': 'renault',
     'make_model': 'renault austral',
     'model': 'austral',
     'odometer': 85575,
     'odometer_in_km': 85575,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-01-24',
     'sanitized_make': 'renault',
     'seats_number': 5,
     'seller_name': None,
     'title': 'renault austral 1.2 hybrid e-tech iconic esprit alpine',
     'transmission': 'automatic',
     'trim': 'iconic esprit alpine',
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 200,
 'expiration_date': '2026-01-29T16:25:20Z',
 'fuel_type': 'hybrid',
 'id': '127ff327-5e9a-54a6-9044-df819b35bf37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM65156',
 'listing': 'auction',
 'location': 'Échirolles',
 'make': 'Renault',
 'model': 'Austral',
 'odometer': 85575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-01-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Austral 1.2 Hybrid E-Tech Iconic Esprit Alpine',
 'transmission': 'automatic',
 'trim': 'Iconic Esprit Alpine',
 'year': 2023}
2026-01-29 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GM65156%27 HTTP/1.1" 200 None
2026-01-29 06:03:58 [auto1.fr] INFO: Saving data for GM65156: {'auction_closing_time': 1769703920.0, 'created_time': 1769534398.773381, 'last_price_update_time': 1769666638.660884}
2026-01-29 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GM65156') HTTP/1.1" 204 0
2026-01-29 06:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_f8a29b9462179dd5b88d0c4d78eaa299.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:58 [auto1.fr] INFO: Found listing with ID: PY32143
2026-01-29 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY32143%27 HTTP/1.1" 200 None
2026-01-29 06:03:58 [auto1.fr] INFO: Scrape type for PY32143: 2
2026-01-29 06:03:58 [auto1.fr] INFO: Found listing with ID: RA36744
2026-01-29 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RA36744%27 HTTP/1.1" 200 None
2026-01-29 06:03:58 [auto1.fr] INFO: Scrape type for RA36744: 2
2026-01-29 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc4%252Fb3c46a596f49e232dbd2970c0ca92ce0%252Fpa%252FBP20652_4db067d2a627e372f2cb75a858e1c9e3.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_4db067d2a627e372f2cb75a858e1c9e3.jpg not downloaded yet
2026-01-29 06:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UV99262> (referer: https://www.auto1.com/v1/car-details-view/UV99262/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c136050>
2026-01-29 06:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_937be206-8155-5ddd-8336-77230dfffb18/937be206-8155-5ddd-8336-77230dfffb18_image_9.jpg HTTP/1.1" 201 0
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc4%252Fb3c46a596f49e232dbd2970c0ca92ce0%252Fpa%252FBP20652_3d65b9c4458d6383ba881020ae36b5ef.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_3d65b9c4458d6383ba881020ae36b5ef.jpg saved to cache
2026-01-29 06:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 937be206-8155-5ddd-8336-77230dfffb18
2026-01-29 06:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_d795e89d8018b211378727c09b2cd5ce.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:59 [auto1.fr] INFO: Found listing with ID: WM56948
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM56948%27 HTTP/1.1" 200 None
2026-01-29 06:03:59 [auto1.fr] INFO: Scrape type for WM56948: 0
2026-01-29 06:03:59 [auto1.fr] INFO: Found listing with ID: SS85522
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SS85522%27 HTTP/1.1" 200 None
2026-01-29 06:03:59 [auto1.fr] INFO: Scrape type for SS85522: 0
2026-01-29 06:03:59 [auto1.fr] INFO: Found listing with ID: TU49063
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU49063%27 HTTP/1.1" 200 None
2026-01-29 06:03:59 [auto1.fr] INFO: Scrape type for TU49063: 0
2026-01-29 06:03:59 [auto1.fr] INFO: Found listing with ID: DE46790
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DE46790%27 HTTP/1.1" 200 None
2026-01-29 06:03:59 [auto1.fr] INFO: Scrape type for DE46790: 0
2026-01-29 06:03:59 [auto1.fr] INFO: Found listing with ID: YU43817
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YU43817%27 HTTP/1.1" 200 None
2026-01-29 06:03:59 [auto1.fr] INFO: Scrape type for YU43817: 0
2026-01-29 06:03:59 [auto1.fr] INFO: Found listing with ID: NN79994
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NN79994%27 HTTP/1.1" 200 None
2026-01-29 06:03:59 [auto1.fr] INFO: Scrape type for NN79994: 0
2026-01-29 06:03:59 [auto1.fr] INFO: Found listing with ID: JF37678
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JF37678%27 HTTP/1.1" 200 None
2026-01-29 06:03:59 [auto1.fr] INFO: Scrape type for JF37678: 2
2026-01-29 06:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_003e43e0cdc433a1b1d8f6a550af6ab3.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:03:59 [auto1.fr] INFO: Found listing with ID: NN71970
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NN71970%27 HTTP/1.1" 200 None
2026-01-29 06:03:59 [auto1.fr] INFO: Scrape type for NN71970: 2
2026-01-29 06:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c04f3d0>
2026-01-29 06:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebd556ab-5120-52f2-9fba-5871b84db0bf/ebd556ab-5120-52f2-9fba-5871b84db0bf_image_12.jpg HTTP/1.1" 201 0
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F5c%252Fe55cba11dcb6db7c9220cfd537533033%252Fpa%252FYA10266_35bbc9949e5881fd9ad8fb77ed8e005c.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_35bbc9949e5881fd9ad8fb77ed8e005c.jpg saved to cache
2026-01-29 06:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ebd556ab-5120-52f2-9fba-5871b84db0bf
2026-01-29 06:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c1ea090>
2026-01-29 06:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_937be206-8155-5ddd-8336-77230dfffb18/937be206-8155-5ddd-8336-77230dfffb18_image_10.jpg HTTP/1.1" 201 0
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc4%252Fb3c46a596f49e232dbd2970c0ca92ce0%252Fpa%252FBP20652_9a680e05659dbb083a3dfa61d41d6928.jpg') HTTP/1.1" 204 0
2026-01-29 06:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_9a680e05659dbb083a3dfa61d41d6928.jpg saved to cache
2026-01-29 06:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 937be206-8155-5ddd-8336-77230dfffb18
2026-01-29 06:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c07b7d0>
2026-01-29 06:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebd556ab-5120-52f2-9fba-5871b84db0bf/ebd556ab-5120-52f2-9fba-5871b84db0bf_image_13.jpg HTTP/1.1" 201 0
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F5c%252Fe55cba11dcb6db7c9220cfd537533033%252Fpa%252FYA10266_610f17121f0c85e521c8e66a3ed8b308.jpg') HTTP/1.1" 204 0
2026-01-29 06:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_610f17121f0c85e521c8e66a3ed8b308.jpg saved to cache
2026-01-29 06:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item ebd556ab-5120-52f2-9fba-5871b84db0bf
2026-01-29 06:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c08bd50>
2026-01-29 06:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_937be206-8155-5ddd-8336-77230dfffb18/937be206-8155-5ddd-8336-77230dfffb18_image_11.jpg HTTP/1.1" 201 0
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc4%252Fb3c46a596f49e232dbd2970c0ca92ce0%252Fpa%252FBP20652_d8f0c44dcc99b060a6d217cb12431a25.jpg') HTTP/1.1" 204 0
2026-01-29 06:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_d8f0c44dcc99b060a6d217cb12431a25.jpg saved to cache
2026-01-29 06:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 937be206-8155-5ddd-8336-77230dfffb18
2026-01-29 06:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_b9d89d41c39e9b49afd3beaace876f03.png> (referer: https://www.auto1.com/)
2026-01-29 06:04:00 [auto1.fr] INFO: Found listing with ID: BC03829
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BC03829%27 HTTP/1.1" 200 None
2026-01-29 06:04:00 [auto1.fr] INFO: Scrape type for BC03829: 0
2026-01-29 06:04:00 [auto1.fr] INFO: Found listing with ID: KD68471
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KD68471%27 HTTP/1.1" 200 None
2026-01-29 06:04:00 [auto1.fr] INFO: Scrape type for KD68471: 0
2026-01-29 06:04:00 [auto1.fr] INFO: Found listing with ID: UZ43677
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UZ43677%27 HTTP/1.1" 200 None
2026-01-29 06:04:00 [auto1.fr] INFO: Scrape type for UZ43677: 0
2026-01-29 06:04:00 [auto1.fr] INFO: Found listing with ID: XN57936
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XN57936%27 HTTP/1.1" 200 None
2026-01-29 06:04:00 [auto1.fr] INFO: Scrape type for XN57936: 0
2026-01-29 06:04:00 [auto1.fr] INFO: Found listing with ID: LB85234
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LB85234%27 HTTP/1.1" 200 None
2026-01-29 06:04:00 [auto1.fr] INFO: Scrape type for LB85234: 2
2026-01-29 06:04:00 [auto1.fr] INFO: Found listing with ID: XV80427
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XV80427%27 HTTP/1.1" 200 None
2026-01-29 06:04:00 [auto1.fr] INFO: Scrape type for XV80427: 0
2026-01-29 06:04:00 [auto1.fr] INFO: Found listing with ID: AW18878
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW18878%27 HTTP/1.1" 200 None
2026-01-29 06:04:00 [auto1.fr] INFO: Scrape type for AW18878: 0
2026-01-29 06:04:00 [auto1.fr] INFO: Found listing with ID: UF55910
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UF55910%27 HTTP/1.1" 200 None
2026-01-29 06:04:00 [auto1.fr] INFO: Scrape type for UF55910: 0
2026-01-29 06:04:00 [auto1.fr] INFO: Found listing with ID: EV02167
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EV02167%27 HTTP/1.1" 200 None
2026-01-29 06:04:00 [auto1.fr] INFO: Scrape type for EV02167: 2
2026-01-29 06:04:00 [auto1.fr] INFO: Found listing with ID: DX37776
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DX37776%27 HTTP/1.1" 200 None
2026-01-29 06:04:00 [auto1.fr] INFO: Scrape type for DX37776: 0
2026-01-29 06:04:00 [auto1.fr] INFO: Found listing with ID: CN88621
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN88621%27 HTTP/1.1" 200 None
2026-01-29 06:04:00 [auto1.fr] INFO: Scrape type for CN88621: 0
2026-01-29 06:04:00 [auto1.fr] INFO: Found listing with ID: HN91878
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HN91878%27 HTTP/1.1" 200 None
2026-01-29 06:04:00 [auto1.fr] INFO: Scrape type for HN91878: 0
2026-01-29 06:04:00 [auto1.fr] INFO: Found listing with ID: KF78110
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KF78110%27 HTTP/1.1" 200 None
2026-01-29 06:04:00 [auto1.fr] INFO: Scrape type for KF78110: 0
2026-01-29 06:04:00 [auto1.fr] INFO: Found listing with ID: NL05632
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NL05632%27 HTTP/1.1" 200 None
2026-01-29 06:04:00 [auto1.fr] INFO: Scrape type for NL05632: 0
2026-01-29 06:04:00 [auto1.fr] INFO: Found listing with ID: YA75245
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YA75245%27 HTTP/1.1" 200 None
2026-01-29 06:04:00 [auto1.fr] INFO: Scrape type for YA75245: 0
2026-01-29 06:04:00 [auto1.fr] INFO: Found listing with ID: YY09741
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YY09741%27 HTTP/1.1" 200 None
2026-01-29 06:04:00 [auto1.fr] INFO: Scrape type for YY09741: 2
2026-01-29 06:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GJ30545/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GP19694/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DL84076> (referer: https://www.auto1.com/v1/car-details-view/DL84076/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WN63847> (referer: https://www.auto1.com/v1/car-details-view/WN63847/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LV70017> (referer: https://www.auto1.com/v1/car-details-view/LV70017/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f5b3e90>
2026-01-29 06:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e568ace-8955-5943-a54f-3b2b5d255c28/9e568ace-8955-5943-a54f-3b2b5d255c28_image_15.jpg HTTP/1.1" 201 0
2026-01-29 06:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2a%252F3d2a4f42266c8b5b8dba15df9facba85%252Fpa%252FMF46010_f8a29b9462179dd5b88d0c4d78eaa299.jpg') HTTP/1.1" 204 0
2026-01-29 06:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_f8a29b9462179dd5b88d0c4d78eaa299.jpg saved to cache
2026-01-29 06:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 9e568ace-8955-5943-a54f-3b2b5d255c28
2026-01-29 06:04:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c9ab1cf-d06a-5a2b-8901-bd529cbf987d with identifier: UV99262
2026-01-29 06:04:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c9ab1cf-d06a-5a2b-8901-bd529cbf987d with scrape type 2
2026-01-29 06:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c9ab1cf-d06a-5a2b-8901-bd529cbf987d with scrape type 2
2026-01-29 06:04:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8c9ab1cf-d06a-5a2b-8901-bd529cbf987d, identifier: UV99262
2026-01-29 06:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f42ded0>
2026-01-29 06:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_937be206-8155-5ddd-8336-77230dfffb18/937be206-8155-5ddd-8336-77230dfffb18_image_12.jpg HTTP/1.1" 201 0
2026-01-29 06:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc4%252Fb3c46a596f49e232dbd2970c0ca92ce0%252Fpa%252FBP20652_d795e89d8018b211378727c09b2cd5ce.jpg') HTTP/1.1" 204 0
2026-01-29 06:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_d795e89d8018b211378727c09b2cd5ce.jpg saved to cache
2026-01-29 06:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 937be206-8155-5ddd-8336-77230dfffb18
2026-01-29 06:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f399f50>
2026-01-29 06:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_937be206-8155-5ddd-8336-77230dfffb18/937be206-8155-5ddd-8336-77230dfffb18_image_13.jpg HTTP/1.1" 201 0
2026-01-29 06:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc4%252Fb3c46a596f49e232dbd2970c0ca92ce0%252Fpa%252FBP20652_003e43e0cdc433a1b1d8f6a550af6ab3.jpg') HTTP/1.1" 204 0
2026-01-29 06:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_003e43e0cdc433a1b1d8f6a550af6ab3.jpg saved to cache
2026-01-29 06:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 937be206-8155-5ddd-8336-77230dfffb18
2026-01-29 06:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_4db067d2a627e372f2cb75a858e1c9e3.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:04:02 [auto1.fr] INFO: Found listing with ID: CT68237
2026-01-29 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CT68237%27 HTTP/1.1" 200 None
2026-01-29 06:04:02 [auto1.fr] INFO: Scrape type for CT68237: 0
2026-01-29 06:04:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8c9ab1cf-d06a-5a2b-8901-bd529cbf987d with identifier: UV99262
2026-01-29 06:04:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8c9ab1cf-d06a-5a2b-8901-bd529cbf987d with identifier: UV99262
2026-01-29 06:04:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'orange', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 51069, 'odometer_reading_unit': 'km', 'registration_date': '2020-02-17', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uv99262', 'expiration_date': '2026-01-29t16:16:35z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 102, 'id': '8c9ab1cf-d06a-5a2b-8901-bd529cbf987d', 'current_year_diff': 6, 'age_in_months': 71, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 51069}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 71,
     'auction_title': '',
     'c_o_2_emission_value': 102,
     'category': None,
     'color': 'orange',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:16:35z',
     'fuel_type': 'petrol',
     'id': '8c9ab1cf-d06a-5a2b-8901-bd529cbf987d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uv99262',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 51069,
     'odometer_in_km': 51069,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-02-17',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2020}
2026-01-29 06:04:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 8c9ab1cf-d06a-5a2b-8901-bd529cbf987d spider: auto1.fr
2026-01-29 06:04:02 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 8c9ab1cf-d06a-5a2b-8901-bd529cbf987d due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'orange', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 51069, 'odometer_reading_unit': 'km', 'registration_date': '2020-02-17', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uv99262', 'expiration_date': '2026-01-29t16:16:35z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 102, 'id': '8c9ab1cf-d06a-5a2b-8901-bd529cbf987d', 'current_year_diff': 6, 'age_in_months': 71, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 51069}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 71,
     'auction_title': '',
     'c_o_2_emission_value': 102,
     'category': None,
     'color': 'orange',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:16:35z',
     'fuel_type': 'petrol',
     'id': '8c9ab1cf-d06a-5a2b-8901-bd529cbf987d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uv99262',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 51069,
     'odometer_in_km': 51069,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-02-17',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:16:35Z',
 'fuel_type': 'petrol',
 'id': '8c9ab1cf-d06a-5a2b-8901-bd529cbf987d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV99262',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 51069,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-01-29 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UV99262%27 HTTP/1.1" 200 None
2026-01-29 06:04:02 [auto1.fr] INFO: Saving data for UV99262: {'auction_closing_time': 1769703395.0, 'created_time': 1769534166.487131, 'last_price_update_time': 1769666642.253851}
2026-01-29 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UV99262') HTTP/1.1" 204 0
2026-01-29 06:04:02 [auto1.fr] INFO: Found listing with ID: AZ84868
2026-01-29 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AZ84868%27 HTTP/1.1" 200 None
2026-01-29 06:04:02 [auto1.fr] INFO: Scrape type for AZ84868: 2
2026-01-29 06:04:02 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-01-29 06:04:02 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2026-01-29 06:04:02 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2026-01-29 06:04:02 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2026-01-29 06:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f300510>
2026-01-29 06:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebd556ab-5120-52f2-9fba-5871b84db0bf/ebd556ab-5120-52f2-9fba-5871b84db0bf_image_15.png HTTP/1.1" 201 0
2026-01-29 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F5c%252Fe55cba11dcb6db7c9220cfd537533033%252Fpa%252FYA10266_b9d89d41c39e9b49afd3beaace876f03.png') HTTP/1.1" 204 0
2026-01-29 06:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_b9d89d41c39e9b49afd3beaace876f03.png saved to cache
2026-01-29 06:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item ebd556ab-5120-52f2-9fba-5871b84db0bf
2026-01-29 06:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YP23412/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ce0cf5c-a3c2-591d-a5b5-07a17a0d7ff5 with identifier: DL84076
2026-01-29 06:04:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ce0cf5c-a3c2-591d-a5b5-07a17a0d7ff5 with scrape type 2
2026-01-29 06:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ce0cf5c-a3c2-591d-a5b5-07a17a0d7ff5 with scrape type 2
2026-01-29 06:04:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2ce0cf5c-a3c2-591d-a5b5-07a17a0d7ff5, identifier: DL84076
2026-01-29 06:04:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8eea424-6a92-5e56-9705-1e87a5504cd8 with identifier: WN63847
2026-01-29 06:04:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8eea424-6a92-5e56-9705-1e87a5504cd8 with scrape type 2
2026-01-29 06:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8eea424-6a92-5e56-9705-1e87a5504cd8 with scrape type 2
2026-01-29 06:04:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f8eea424-6a92-5e56-9705-1e87a5504cd8, identifier: WN63847
2026-01-29 06:04:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc288279-8078-5f96-ac14-6ae4ca071016 with identifier: LV70017
2026-01-29 06:04:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc288279-8078-5f96-ac14-6ae4ca071016 with scrape type 2
2026-01-29 06:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc288279-8078-5f96-ac14-6ae4ca071016 with scrape type 2
2026-01-29 06:04:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cc288279-8078-5f96-ac14-6ae4ca071016, identifier: LV70017
2026-01-29 06:04:03 [auto1.fr] INFO: Found listing with ID: CB66177
2026-01-29 06:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CB66177%27 HTTP/1.1" 200 None
2026-01-29 06:04:03 [auto1.fr] INFO: Scrape type for CB66177: 0
2026-01-29 06:04:03 [auto1.fr] INFO: Found listing with ID: SM82475
2026-01-29 06:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SM82475%27 HTTP/1.1" 200 None
2026-01-29 06:04:03 [auto1.fr] INFO: Scrape type for SM82475: 0
2026-01-29 06:04:03 [auto1.fr] INFO: Found listing with ID: JJ43249
2026-01-29 06:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ43249%27 HTTP/1.1" 200 None
2026-01-29 06:04:03 [auto1.fr] INFO: Scrape type for JJ43249: 2
2026-01-29 06:04:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2ce0cf5c-a3c2-591d-a5b5-07a17a0d7ff5 with identifier: DL84076
2026-01-29 06:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2ce0cf5c-a3c2-591d-a5b5-07a17a0d7ff5 with identifier: DL84076
2026-01-29 06:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 508 1.2 puretech active pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '508', 'transmission': 'automatic', 'odometer': 60858, 'odometer_reading_unit': 'km', 'registration_date': '2021-03-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dl84076', 'expiration_date': '2026-01-29t16:33:21z', 'origin_country_code': 'fr', 'trim': 'active pack', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, allennes-les-marais', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 143, 'id': '2ce0cf5c-a3c2-591d-a5b5-07a17a0d7ff5', 'current_year_diff': 5, 'age_in_months': 58, 'make_model': 'peugeot 508', 'sanitized_make': 'peugeot', 'odometer_in_km': 60858}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 58,
     'auction_title': '',
     'c_o_2_emission_value': 143,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:33:21z',
     'fuel_type': 'petrol',
     'id': '2ce0cf5c-a3c2-591d-a5b5-07a17a0d7ff5',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dl84076',
     'listing': 'auction',
     'location': 'fr, allennes-les-marais',
     'make': 'peugeot',
     'make_model': 'peugeot 508',
     'model': '508',
     'odometer': 60858,
     'odometer_in_km': 60858,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-03-28',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 508 1.2 puretech active pack',
     'transmission': 'automatic',
     'trim': 'active pack',
     'year': 2021}
2026-01-29 06:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 2ce0cf5c-a3c2-591d-a5b5-07a17a0d7ff5 spider: auto1.fr
2026-01-29 06:04:03 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 2ce0cf5c-a3c2-591d-a5b5-07a17a0d7ff5 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 508 1.2 puretech active pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '508', 'transmission': 'automatic', 'odometer': 60858, 'odometer_reading_unit': 'km', 'registration_date': '2021-03-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dl84076', 'expiration_date': '2026-01-29t16:33:21z', 'origin_country_code': 'fr', 'trim': 'active pack', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, allennes-les-marais', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 143, 'id': '2ce0cf5c-a3c2-591d-a5b5-07a17a0d7ff5', 'current_year_diff': 5, 'age_in_months': 58, 'make_model': 'peugeot 508', 'sanitized_make': 'peugeot', 'odometer_in_km': 60858}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 58,
     'auction_title': '',
     'c_o_2_emission_value': 143,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:33:21z',
     'fuel_type': 'petrol',
     'id': '2ce0cf5c-a3c2-591d-a5b5-07a17a0d7ff5',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dl84076',
     'listing': 'auction',
     'location': 'fr, allennes-les-marais',
     'make': 'peugeot',
     'make_model': 'peugeot 508',
     'model': '508',
     'odometer': 60858,
     'odometer_in_km': 60858,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-03-28',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 508 1.2 puretech active pack',
     'transmission': 'automatic',
     'trim': 'active pack',
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:33:21Z',
 'fuel_type': 'petrol',
 'id': '2ce0cf5c-a3c2-591d-a5b5-07a17a0d7ff5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL84076',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 60858,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 508 1.2 PureTech Active Pack',
 'transmission': 'automatic',
 'trim': 'Active Pack',
 'year': 2021}
2026-01-29 06:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DL84076%27 HTTP/1.1" 200 None
2026-01-29 06:04:03 [auto1.fr] INFO: Saving data for DL84076: {'auction_closing_time': 1769704401.0, 'created_time': 1769533811.170941, 'last_price_update_time': 1769666643.36462}
2026-01-29 06:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DL84076') HTTP/1.1" 204 0
2026-01-29 06:04:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f8eea424-6a92-5e56-9705-1e87a5504cd8 with identifier: WN63847
2026-01-29 06:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f8eea424-6a92-5e56-9705-1e87a5504cd8 with identifier: WN63847
2026-01-29 06:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 puretech allure pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 7511, 'odometer_reading_unit': 'km', 'registration_date': '2022-04-05', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wn63847', 'expiration_date': '2026-01-29t16:01:10z', 'origin_country_code': 'fr', 'trim': 'allure pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ingrandes sur vienne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 129, 'id': 'f8eea424-6a92-5e56-9705-1e87a5504cd8', 'current_year_diff': 4, 'age_in_months': 45, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 7511}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 45,
     'auction_title': '',
     'c_o_2_emission_value': 129,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:01:10z',
     'fuel_type': 'petrol',
     'id': 'f8eea424-6a92-5e56-9705-1e87a5504cd8',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wn63847',
     'listing': 'auction',
     'location': 'fr, ingrandes sur vienne',
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 7511,
     'odometer_in_km': 7511,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-04-05',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 1.2 puretech allure pack',
     'transmission': 'automatic',
     'trim': 'allure pack',
     'year': 2022}
2026-01-29 06:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: f8eea424-6a92-5e56-9705-1e87a5504cd8 spider: auto1.fr
2026-01-29 06:04:03 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: f8eea424-6a92-5e56-9705-1e87a5504cd8 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 puretech allure pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 7511, 'odometer_reading_unit': 'km', 'registration_date': '2022-04-05', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wn63847', 'expiration_date': '2026-01-29t16:01:10z', 'origin_country_code': 'fr', 'trim': 'allure pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ingrandes sur vienne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 129, 'id': 'f8eea424-6a92-5e56-9705-1e87a5504cd8', 'current_year_diff': 4, 'age_in_months': 45, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 7511}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 45,
     'auction_title': '',
     'c_o_2_emission_value': 129,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:01:10z',
     'fuel_type': 'petrol',
     'id': 'f8eea424-6a92-5e56-9705-1e87a5504cd8',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wn63847',
     'listing': 'auction',
     'location': 'fr, ingrandes sur vienne',
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 7511,
     'odometer_in_km': 7511,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-04-05',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 1.2 puretech allure pack',
     'transmission': 'automatic',
     'trim': 'allure pack',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:01:10Z',
 'fuel_type': 'petrol',
 'id': 'f8eea424-6a92-5e56-9705-1e87a5504cd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN63847',
 'listing': 'auction',
 'location': 'FR, Ingrandes sur Vienne',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 7511,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.2 PureTech Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2022}
2026-01-29 06:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WN63847%27 HTTP/1.1" 200 None
2026-01-29 06:04:03 [auto1.fr] INFO: Saving data for WN63847: {'auction_closing_time': 1769702470.0, 'created_time': 1769190378.768968, 'last_price_update_time': 1769666643.597316}
2026-01-29 06:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WN63847') HTTP/1.1" 204 0
2026-01-29 06:04:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cc288279-8078-5f96-ac14-6ae4ca071016 with identifier: LV70017
2026-01-29 06:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cc288279-8078-5f96-ac14-6ae4ca071016 with identifier: LV70017
2026-01-29 06:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech tech edition', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'automatic', 'odometer': 40441, 'odometer_reading_unit': 'km', 'registration_date': '2018-05-31', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lv70017', 'expiration_date': '2026-01-29t16:59:37z', 'origin_country_code': 'fr', 'trim': 'tech edition', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 104, 'id': 'cc288279-8078-5f96-ac14-6ae4ca071016', 'current_year_diff': 8, 'age_in_months': 91, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 40441}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 91,
     'auction_title': '',
     'c_o_2_emission_value': 104,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:59:37z',
     'fuel_type': 'petrol',
     'id': 'cc288279-8078-5f96-ac14-6ae4ca071016',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lv70017',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 40441,
     'odometer_in_km': 40441,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-05-31',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech tech edition',
     'transmission': 'automatic',
     'trim': 'tech edition',
     'year': 2018}
2026-01-29 06:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: cc288279-8078-5f96-ac14-6ae4ca071016 spider: auto1.fr
2026-01-29 06:04:03 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: cc288279-8078-5f96-ac14-6ae4ca071016 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech tech edition', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'automatic', 'odometer': 40441, 'odometer_reading_unit': 'km', 'registration_date': '2018-05-31', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lv70017', 'expiration_date': '2026-01-29t16:59:37z', 'origin_country_code': 'fr', 'trim': 'tech edition', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 104, 'id': 'cc288279-8078-5f96-ac14-6ae4ca071016', 'current_year_diff': 8, 'age_in_months': 91, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 40441}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 91,
     'auction_title': '',
     'c_o_2_emission_value': 104,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:59:37z',
     'fuel_type': 'petrol',
     'id': 'cc288279-8078-5f96-ac14-6ae4ca071016',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lv70017',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 40441,
     'odometer_in_km': 40441,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-05-31',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech tech edition',
     'transmission': 'automatic',
     'trim': 'tech edition',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:59:37Z',
 'fuel_type': 'petrol',
 'id': 'cc288279-8078-5f96-ac14-6ae4ca071016',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV70017',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 40441,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Tech Edition',
 'transmission': 'automatic',
 'trim': 'Tech Edition',
 'year': 2018}
2026-01-29 06:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LV70017%27 HTTP/1.1" 200 None
2026-01-29 06:04:03 [auto1.fr] INFO: Saving data for LV70017: {'auction_closing_time': 1769705977.0, 'created_time': 1768669426.697184, 'last_price_update_time': 1769666643.83158}
2026-01-29 06:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LV70017') HTTP/1.1" 204 0
2026-01-29 06:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f3d4610>
2026-01-29 06:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_937be206-8155-5ddd-8336-77230dfffb18/937be206-8155-5ddd-8336-77230dfffb18_image_15.jpg HTTP/1.1" 201 0
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc4%252Fb3c46a596f49e232dbd2970c0ca92ce0%252Fpa%252FBP20652_4db067d2a627e372f2cb75a858e1c9e3.jpg') HTTP/1.1" 204 0
2026-01-29 06:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_4db067d2a627e372f2cb75a858e1c9e3.jpg saved to cache
2026-01-29 06:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 937be206-8155-5ddd-8336-77230dfffb18
2026-01-29 06:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DD59039/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_a92b8ff51b0b57e3fd58fbd511dd769d.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:04:04 [auto1.fr] INFO: Found listing with ID: PT47578
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PT47578%27 HTTP/1.1" 200 None
2026-01-29 06:04:04 [auto1.fr] INFO: Scrape type for PT47578: 0
2026-01-29 06:04:04 [auto1.fr] INFO: Found listing with ID: EV06332
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EV06332%27 HTTP/1.1" 200 None
2026-01-29 06:04:04 [auto1.fr] INFO: Scrape type for EV06332: 2
2026-01-29 06:04:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CA62859/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:04 [auto1.fr] INFO: Found listing with ID: PK43542
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PK43542%27 HTTP/1.1" 200 None
2026-01-29 06:04:04 [auto1.fr] INFO: Scrape type for PK43542: 0
2026-01-29 06:04:04 [auto1.fr] INFO: Found listing with ID: SX08978
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SX08978%27 HTTP/1.1" 200 None
2026-01-29 06:04:04 [auto1.fr] INFO: Scrape type for SX08978: 0
2026-01-29 06:04:04 [auto1.fr] INFO: Found listing with ID: PV49045
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PV49045%27 HTTP/1.1" 200 None
2026-01-29 06:04:04 [auto1.fr] INFO: Scrape type for PV49045: 0
2026-01-29 06:04:04 [auto1.fr] INFO: Found listing with ID: EJ76169
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EJ76169%27 HTTP/1.1" 200 None
2026-01-29 06:04:04 [auto1.fr] INFO: Scrape type for EJ76169: 2
2026-01-29 06:04:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:04 [auto1.fr] INFO: Found listing with ID: ES59699
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ES59699%27 HTTP/1.1" 200 None
2026-01-29 06:04:04 [auto1.fr] INFO: Scrape type for ES59699: 0
2026-01-29 06:04:04 [auto1.fr] INFO: Found listing with ID: YF69984
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YF69984%27 HTTP/1.1" 200 None
2026-01-29 06:04:04 [auto1.fr] INFO: Scrape type for YF69984: 0
2026-01-29 06:04:04 [auto1.fr] INFO: Found listing with ID: GN42324
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN42324%27 HTTP/1.1" 200 None
2026-01-29 06:04:04 [auto1.fr] INFO: Scrape type for GN42324: 2
2026-01-29 06:04:04 [auto1.fr] INFO: Found listing with ID: PN94606
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PN94606%27 HTTP/1.1" 200 None
2026-01-29 06:04:04 [auto1.fr] INFO: Scrape type for PN94606: 0
2026-01-29 06:04:04 [auto1.fr] INFO: Found listing with ID: JY47910
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JY47910%27 HTTP/1.1" 200 None
2026-01-29 06:04:04 [auto1.fr] INFO: Scrape type for JY47910: 2
2026-01-29 06:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff44c50>
2026-01-29 06:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_937be206-8155-5ddd-8336-77230dfffb18/937be206-8155-5ddd-8336-77230dfffb18_image_14.jpg HTTP/1.1" 201 0
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc4%252Fb3c46a596f49e232dbd2970c0ca92ce0%252Fpa%252FBP20652_a92b8ff51b0b57e3fd58fbd511dd769d.jpg') HTTP/1.1" 204 0
2026-01-29 06:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_a92b8ff51b0b57e3fd58fbd511dd769d.jpg saved to cache
2026-01-29 06:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 937be206-8155-5ddd-8336-77230dfffb18
2026-01-29 06:04:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 937be206-8155-5ddd-8336-77230dfffb18, skipping ID generation
2026-01-29 06:04:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 937be206-8155-5ddd-8336-77230dfffb18 with scrape type 1
2026-01-29 06:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 937be206-8155-5ddd-8336-77230dfffb18 from tracking dictionaries
2026-01-29 06:04:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 937be206-8155-5ddd-8336-77230dfffb18 sending to next pipeline
2026-01-29 06:04:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 937be206-8155-5ddd-8336-77230dfffb18, identifier: BP20652
2026-01-29 06:04:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 937be206-8155-5ddd-8336-77230dfffb18 with identifier: BP20652
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:04:04 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-01-29 06:04:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 937be206-8155-5ddd-8336-77230dfffb18 with identifier: BP20652
2026-01-29 06:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 169716 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169716
2026-01-29 06:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 937be206-8155-5ddd-8336-77230dfffb18 spider: auto1.fr
2026-01-29 06:04:05 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 937be206-8155-5ddd-8336-77230dfffb18 due to rule: high_mileage_for_country.json, error: 169716 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169716
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'category': 'Taxi',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 179,
 'expiration_date': '2026-01-29T16:34:22Z',
 'fuel_type': 'hybrid',
 'id': '937be206-8155-5ddd-8336-77230dfffb18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP20652',
 'listing': 'auction',
 'location': 'FR, Herblay',
 'make': 'Toyota',
 'model': 'Corolla',
 'odometer': 169716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_937be206-8155-5ddd-8336-77230dfffb18/937be206-8155-5ddd-8336-77230dfffb18_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_259b1aadc1fff742fb3164ed1b854dd8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_937be206-8155-5ddd-8336-77230dfffb18/937be206-8155-5ddd-8336-77230dfffb18_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_c91d189f8c807b0691edcc71fac45e98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_937be206-8155-5ddd-8336-77230dfffb18/937be206-8155-5ddd-8336-77230dfffb18_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_43cabfb4241ad6bcc3c7b9ae838464f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_937be206-8155-5ddd-8336-77230dfffb18/937be206-8155-5ddd-8336-77230dfffb18_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_30f1f74540f7950fd2272f938ecb238c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_937be206-8155-5ddd-8336-77230dfffb18/937be206-8155-5ddd-8336-77230dfffb18_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_b1d1a6af57acdd34afa8933341c608e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_937be206-8155-5ddd-8336-77230dfffb18/937be206-8155-5ddd-8336-77230dfffb18_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_4a2e50ca8d6c5318249f3dfc7004567f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_937be206-8155-5ddd-8336-77230dfffb18/937be206-8155-5ddd-8336-77230dfffb18_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_e38a262fefbb68e7b10ca9a0ca3ce40d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_937be206-8155-5ddd-8336-77230dfffb18/937be206-8155-5ddd-8336-77230dfffb18_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_05c0447230ba4fb59aef5bbce5d3b41b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_937be206-8155-5ddd-8336-77230dfffb18/937be206-8155-5ddd-8336-77230dfffb18_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_7bebfa258593678385c92960d2b6f13a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_937be206-8155-5ddd-8336-77230dfffb18/937be206-8155-5ddd-8336-77230dfffb18_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_3d65b9c4458d6383ba881020ae36b5ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_937be206-8155-5ddd-8336-77230dfffb18/937be206-8155-5ddd-8336-77230dfffb18_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_9a680e05659dbb083a3dfa61d41d6928.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_937be206-8155-5ddd-8336-77230dfffb18/937be206-8155-5ddd-8336-77230dfffb18_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_d8f0c44dcc99b060a6d217cb12431a25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_937be206-8155-5ddd-8336-77230dfffb18/937be206-8155-5ddd-8336-77230dfffb18_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41842,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_d795e89d8018b211378727c09b2cd5ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_937be206-8155-5ddd-8336-77230dfffb18/937be206-8155-5ddd-8336-77230dfffb18_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_003e43e0cdc433a1b1d8f6a550af6ab3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_937be206-8155-5ddd-8336-77230dfffb18/937be206-8155-5ddd-8336-77230dfffb18_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_a92b8ff51b0b57e3fd58fbd511dd769d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_937be206-8155-5ddd-8336-77230dfffb18/937be206-8155-5ddd-8336-77230dfffb18_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/c4/b3c46a596f49e232dbd2970c0ca92ce0/pa/BP20652_4db067d2a627e372f2cb75a858e1c9e3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Corolla 2.0 Hybrid Collection',
 'transmission': 'automatic',
 'trim': 'Collection',
 'year': 2019}
2026-01-29 06:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BP20652%27 HTTP/1.1" 200 None
2026-01-29 06:04:05 [auto1.fr] INFO: Saving data for BP20652: {'created_time': 1769666645.248838, 'last_price_update_time': 1769666645.248847, 'auction_closing_time': 1769704462.0}
2026-01-29 06:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BP20652') HTTP/1.1" 204 0
2026-01-29 06:04:05 [auto1.fr] INFO: Found listing with ID: WD38934
2026-01-29 06:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD38934%27 HTTP/1.1" 200 None
2026-01-29 06:04:05 [auto1.fr] INFO: Scrape type for WD38934: 2
2026-01-29 06:04:05 [auto1.fr] INFO: Found listing with ID: NM72906
2026-01-29 06:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NM72906%27 HTTP/1.1" 200 None
2026-01-29 06:04:05 [auto1.fr] INFO: Scrape type for NM72906: 2
2026-01-29 06:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UB61535/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JF37678/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EK50405/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JG92327/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RA36744/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HK10948> (referer: https://www.auto1.com/v1/car-details-view/HK10948/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EV02167/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a72c9880-93fa-5529-a221-129cb53f77eb with identifier: HK10948
2026-01-29 06:04:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a72c9880-93fa-5529-a221-129cb53f77eb with scrape type 2
2026-01-29 06:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a72c9880-93fa-5529-a221-129cb53f77eb with scrape type 2
2026-01-29 06:04:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a72c9880-93fa-5529-a221-129cb53f77eb, identifier: HK10948
2026-01-29 06:04:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a72c9880-93fa-5529-a221-129cb53f77eb with identifier: HK10948
2026-01-29 06:04:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a72c9880-93fa-5529-a221-129cb53f77eb with identifier: HK10948
2026-01-29 06:04:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a72c9880-93fa-5529-a221-129cb53f77eb with identifier: HK10948 to the API
2026-01-29 06:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:04:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:04:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HK10948>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:18:48Z',
 'fuel_type': 'diesel',
 'id': 'a72c9880-93fa-5529-a221-129cb53f77eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK10948',
 'listing': 'auction',
 'location': 'FR, LA CHAPELLE LONGUEVILLE',
 'make': 'BMW',
 'model': '5er',
 'odometer': 97671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 520d xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2018}
2026-01-29 06:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK10948%27 HTTP/1.1" 200 None
2026-01-29 06:04:06 [auto1.fr] INFO: Saving data for HK10948: {'auction_closing_time': 1769703528.0, 'created_time': 1769446956.626892, 'last_price_update_time': 1769666646.787997}
2026-01-29 06:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HK10948') HTTP/1.1" 204 0
2026-01-29 06:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GK26515> (referer: https://www.auto1.com/v1/car-details-view/GK26515/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NN71970/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LB85234/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e419aff-d2ac-5434-8090-fb4f14545f1e with identifier: GK26515
2026-01-29 06:04:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e419aff-d2ac-5434-8090-fb4f14545f1e with scrape type 2
2026-01-29 06:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e419aff-d2ac-5434-8090-fb4f14545f1e with scrape type 2
2026-01-29 06:04:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4e419aff-d2ac-5434-8090-fb4f14545f1e, identifier: GK26515
2026-01-29 06:04:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4e419aff-d2ac-5434-8090-fb4f14545f1e with identifier: GK26515
2026-01-29 06:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4e419aff-d2ac-5434-8090-fb4f14545f1e with identifier: GK26515
2026-01-29 06:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c4 cactus 1.2 e-thp shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c4 cactus', 'transmission': 'automatic', 'odometer': 90632, 'odometer_reading_unit': 'km', 'registration_date': '2017-11-07', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gk26515', 'expiration_date': '2026-01-29t16:49:44z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 105, 'id': '4e419aff-d2ac-5434-8090-fb4f14545f1e', 'current_year_diff': 9, 'age_in_months': 98, 'make_model': 'citroen c4 cactus', 'sanitized_make': 'citroen', 'odometer_in_km': 90632}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 98,
     'auction_title': '',
     'c_o_2_emission_value': 105,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:49:44z',
     'fuel_type': 'petrol',
     'id': '4e419aff-d2ac-5434-8090-fb4f14545f1e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gk26515',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'citroen',
     'make_model': 'citroen c4 cactus',
     'model': 'c4 cactus',
     'odometer': 90632,
     'odometer_in_km': 90632,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-11-07',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c4 cactus 1.2 e-thp shine',
     'transmission': 'automatic',
     'trim': 'shine',
     'year': 2017}
2026-01-29 06:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 4e419aff-d2ac-5434-8090-fb4f14545f1e spider: auto1.fr
2026-01-29 06:04:07 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 4e419aff-d2ac-5434-8090-fb4f14545f1e due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c4 cactus 1.2 e-thp shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c4 cactus', 'transmission': 'automatic', 'odometer': 90632, 'odometer_reading_unit': 'km', 'registration_date': '2017-11-07', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gk26515', 'expiration_date': '2026-01-29t16:49:44z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 105, 'id': '4e419aff-d2ac-5434-8090-fb4f14545f1e', 'current_year_diff': 9, 'age_in_months': 98, 'make_model': 'citroen c4 cactus', 'sanitized_make': 'citroen', 'odometer_in_km': 90632}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 98,
     'auction_title': '',
     'c_o_2_emission_value': 105,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:49:44z',
     'fuel_type': 'petrol',
     'id': '4e419aff-d2ac-5434-8090-fb4f14545f1e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gk26515',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'citroen',
     'make_model': 'citroen c4 cactus',
     'model': 'c4 cactus',
     'odometer': 90632,
     'odometer_in_km': 90632,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-11-07',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c4 cactus 1.2 e-thp shine',
     'transmission': 'automatic',
     'trim': 'shine',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:49:44Z',
 'fuel_type': 'petrol',
 'id': '4e419aff-d2ac-5434-8090-fb4f14545f1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK26515',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 90632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 e-THP Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2017}
2026-01-29 06:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GK26515%27 HTTP/1.1" 200 None
2026-01-29 06:04:07 [auto1.fr] INFO: Saving data for GK26515: {'auction_closing_time': 1769705384.0, 'created_time': 1768543331.881867, 'last_price_update_time': 1769666647.305488}
2026-01-29 06:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GK26515') HTTP/1.1" 204 0
2026-01-29 06:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GF92974/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PY32143/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AZ84868/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GP19694> (referer: https://www.auto1.com/v1/car-details-view/GP19694/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JJ43249/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EV06332/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fcc1d7b-9a20-5fb9-aa23-04d9ba94e065 with identifier: GP19694
2026-01-29 06:04:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fcc1d7b-9a20-5fb9-aa23-04d9ba94e065 with scrape type 2
2026-01-29 06:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fcc1d7b-9a20-5fb9-aa23-04d9ba94e065 with scrape type 2
2026-01-29 06:04:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7fcc1d7b-9a20-5fb9-aa23-04d9ba94e065, identifier: GP19694
2026-01-29 06:04:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7fcc1d7b-9a20-5fb9-aa23-04d9ba94e065 with identifier: GP19694
2026-01-29 06:04:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7fcc1d7b-9a20-5fb9-aa23-04d9ba94e065 with identifier: GP19694
2026-01-29 06:04:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7fcc1d7b-9a20-5fb9-aa23-04d9ba94e065 with identifier: GP19694 to the API
2026-01-29 06:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:04:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:04:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GP19694>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:54:53Z',
 'fuel_type': 'diesel',
 'id': '7fcc1d7b-9a20-5fb9-aa23-04d9ba94e065',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP19694',
 'listing': 'auction',
 'location': 'FR, Saint Aignan de Grandlieu',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 90939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.5 BLUE dCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2020}
2026-01-29 06:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GP19694%27 HTTP/1.1" 200 None
2026-01-29 06:04:08 [auto1.fr] INFO: Saving data for GP19694: {'auction_closing_time': 1769705693.0, 'created_time': 1768891224.854585, 'last_price_update_time': 1769666648.568856}
2026-01-29 06:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GP19694') HTTP/1.1" 204 0
2026-01-29 06:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NM72906/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JF37678> (referer: https://www.auto1.com/v1/car-details-view/JF37678/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CA62859> (referer: https://www.auto1.com/v1/car-details-view/CA62859/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WD38934/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EK50405> (referer: https://www.auto1.com/v1/car-details-view/EK50405/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46148633-d355-5b4c-94a1-443dcb346e92 with identifier: JF37678
2026-01-29 06:04:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46148633-d355-5b4c-94a1-443dcb346e92 with scrape type 2
2026-01-29 06:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46148633-d355-5b4c-94a1-443dcb346e92 with scrape type 2
2026-01-29 06:04:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 46148633-d355-5b4c-94a1-443dcb346e92, identifier: JF37678
2026-01-29 06:04:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 46148633-d355-5b4c-94a1-443dcb346e92 with identifier: JF37678
2026-01-29 06:04:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 46148633-d355-5b4c-94a1-443dcb346e92 with identifier: JF37678
2026-01-29 06:04:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 46148633-d355-5b4c-94a1-443dcb346e92 with identifier: JF37678 to the API
2026-01-29 06:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:04:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:04:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JF37678>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:46:00Z',
 'fuel_type': 'diesel',
 'id': '46148633-d355-5b4c-94a1-443dcb346e92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF37678',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'make': 'BMW',
 'model': '2er',
 'odometer': 80517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2er 218d Gran Coupe M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2022}
2026-01-29 06:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JF37678%27 HTTP/1.1" 200 None
2026-01-29 06:04:09 [auto1.fr] INFO: Saving data for JF37678: {'auction_closing_time': 1769705160.0, 'created_time': 1768471390.259156, 'last_price_update_time': 1769666649.177216}
2026-01-29 06:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JF37678') HTTP/1.1" 204 0
2026-01-29 06:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 260efb08-f71d-5517-a613-01b863fcff0c with identifier: CA62859
2026-01-29 06:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 260efb08-f71d-5517-a613-01b863fcff0c with scrape type 2
2026-01-29 06:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 260efb08-f71d-5517-a613-01b863fcff0c with scrape type 2
2026-01-29 06:04:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 260efb08-f71d-5517-a613-01b863fcff0c, identifier: CA62859
2026-01-29 06:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f70b0132-0fa2-566c-8d55-280a4e5fb62f with identifier: EK50405
2026-01-29 06:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f70b0132-0fa2-566c-8d55-280a4e5fb62f with scrape type 2
2026-01-29 06:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f70b0132-0fa2-566c-8d55-280a4e5fb62f with scrape type 2
2026-01-29 06:04:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f70b0132-0fa2-566c-8d55-280a4e5fb62f, identifier: EK50405
2026-01-29 06:04:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 260efb08-f71d-5517-a613-01b863fcff0c with identifier: CA62859
2026-01-29 06:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 260efb08-f71d-5517-a613-01b863fcff0c with identifier: CA62859
2026-01-29 06:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 194561 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    194561
2026-01-29 06:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 260efb08-f71d-5517-a613-01b863fcff0c spider: auto1.fr
2026-01-29 06:04:09 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 260efb08-f71d-5517-a613-01b863fcff0c due to rule: high_mileage_for_country.json, error: 194561 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    194561
{'auction_title': '',
 'c_o_2_emission_value': 86,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'engine_horse_power': 122,
 'expiration_date': '2026-01-29T16:11:39Z',
 'fuel_type': 'hybrid',
 'id': '260efb08-f71d-5517-a613-01b863fcff0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA62859',
 'listing': 'auction',
 'location': 'FR, Nanterre',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 194561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota C-HR 1.8 Hybrid Design',
 'transmission': 'automatic',
 'trim': 'Design',
 'year': 2019}
2026-01-29 06:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA62859%27 HTTP/1.1" 200 None
2026-01-29 06:04:09 [auto1.fr] INFO: Saving data for CA62859: {'auction_closing_time': 1769703099.0, 'created_time': 1769533621.393852, 'last_price_update_time': 1769666649.695891}
2026-01-29 06:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CA62859') HTTP/1.1" 204 0
2026-01-29 06:04:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f70b0132-0fa2-566c-8d55-280a4e5fb62f with identifier: EK50405
2026-01-29 06:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:04:09 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-01-29 06:04:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f70b0132-0fa2-566c-8d55-280a4e5fb62f with identifier: EK50405
2026-01-29 06:04:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f70b0132-0fa2-566c-8d55-280a4e5fb62f with identifier: EK50405 to the API
2026-01-29 06:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:04:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:04:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EK50405>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:28:43Z',
 'fuel_type': 'gas',
 'id': 'f70b0132-0fa2-566c-8d55-280a4e5fb62f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK50405',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 70863,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe LPG Essential',
 'transmission': 'manual',
 'trim': 'Essential',
 'year': 2021}
2026-01-29 06:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EK50405%27 HTTP/1.1" 200 None
2026-01-29 06:04:10 [auto1.fr] INFO: Saving data for EK50405: {'auction_closing_time': 1769704123.0, 'created_time': 1768496918.353687, 'last_price_update_time': 1769666650.144779}
2026-01-29 06:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EK50405') HTTP/1.1" 204 0
2026-01-29 06:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UB61535> (referer: https://www.auto1.com/v1/car-details-view/UB61535/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JG92327> (referer: https://www.auto1.com/v1/car-details-view/JG92327/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RA36744> (referer: https://www.auto1.com/v1/car-details-view/RA36744/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6229354e-751c-581c-8e09-95b2e474464d with identifier: UB61535
2026-01-29 06:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6229354e-751c-581c-8e09-95b2e474464d with scrape type 2
2026-01-29 06:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6229354e-751c-581c-8e09-95b2e474464d with scrape type 2
2026-01-29 06:04:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6229354e-751c-581c-8e09-95b2e474464d, identifier: UB61535
2026-01-29 06:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 717cd3d9-07e7-57d4-90ce-5b29fcf7f0d0 with identifier: JG92327
2026-01-29 06:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 717cd3d9-07e7-57d4-90ce-5b29fcf7f0d0 with scrape type 2
2026-01-29 06:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 717cd3d9-07e7-57d4-90ce-5b29fcf7f0d0 with scrape type 2
2026-01-29 06:04:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 717cd3d9-07e7-57d4-90ce-5b29fcf7f0d0, identifier: JG92327
2026-01-29 06:04:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6229354e-751c-581c-8e09-95b2e474464d with identifier: UB61535
2026-01-29 06:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6229354e-751c-581c-8e09-95b2e474464d with identifier: UB61535
2026-01-29 06:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech graphic', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 96120, 'odometer_reading_unit': 'km', 'registration_date': '2018-06-05', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ub61535', 'expiration_date': '2026-01-29t16:11:29z', 'origin_country_code': 'fr', 'trim': 'graphic', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ambarès-et-lagrave', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': '6229354e-751c-581c-8e09-95b2e474464d', 'current_year_diff': 8, 'age_in_months': 91, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 96120}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 91,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:11:29z',
     'fuel_type': 'petrol',
     'id': '6229354e-751c-581c-8e09-95b2e474464d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ub61535',
     'listing': 'auction',
     'location': 'fr, ambarès-et-lagrave',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 96120,
     'odometer_in_km': 96120,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-06-05',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech graphic',
     'transmission': 'manual',
     'trim': 'graphic',
     'year': 2018}
2026-01-29 06:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 6229354e-751c-581c-8e09-95b2e474464d spider: auto1.fr
2026-01-29 06:04:10 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 6229354e-751c-581c-8e09-95b2e474464d due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech graphic', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 96120, 'odometer_reading_unit': 'km', 'registration_date': '2018-06-05', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ub61535', 'expiration_date': '2026-01-29t16:11:29z', 'origin_country_code': 'fr', 'trim': 'graphic', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ambarès-et-lagrave', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': '6229354e-751c-581c-8e09-95b2e474464d', 'current_year_diff': 8, 'age_in_months': 91, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 96120}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 91,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:11:29z',
     'fuel_type': 'petrol',
     'id': '6229354e-751c-581c-8e09-95b2e474464d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ub61535',
     'listing': 'auction',
     'location': 'fr, ambarès-et-lagrave',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 96120,
     'odometer_in_km': 96120,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-06-05',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech graphic',
     'transmission': 'manual',
     'trim': 'graphic',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:11:29Z',
 'fuel_type': 'petrol',
 'id': '6229354e-751c-581c-8e09-95b2e474464d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB61535',
 'listing': 'auction',
 'location': 'FR, Ambarès-et-Lagrave',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 96120,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Graphic',
 'transmission': 'manual',
 'trim': 'Graphic',
 'year': 2018}
2026-01-29 06:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UB61535%27 HTTP/1.1" 200 None
2026-01-29 06:04:10 [auto1.fr] INFO: Saving data for UB61535: {'auction_closing_time': 1769703089.0, 'created_time': 1769534653.377845, 'last_price_update_time': 1769666650.72282}
2026-01-29 06:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UB61535') HTTP/1.1" 204 0
2026-01-29 06:04:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 717cd3d9-07e7-57d4-90ce-5b29fcf7f0d0 with identifier: JG92327
2026-01-29 06:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 717cd3d9-07e7-57d4-90ce-5b29fcf7f0d0 with identifier: JG92327
2026-01-29 06:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'orange', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 105118, 'odometer_reading_unit': 'km', 'registration_date': '2019-06-25', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jg92327', 'expiration_date': '2026-01-29t16:05:56z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ingrandes sur vienne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 106, 'id': '717cd3d9-07e7-57d4-90ce-5b29fcf7f0d0', 'current_year_diff': 7, 'age_in_months': 79, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 105118}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 79,
     'auction_title': '',
     'c_o_2_emission_value': 106,
     'category': None,
     'color': 'orange',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:05:56z',
     'fuel_type': 'petrol',
     'id': '717cd3d9-07e7-57d4-90ce-5b29fcf7f0d0',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jg92327',
     'listing': 'auction',
     'location': 'fr, ingrandes sur vienne',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 105118,
     'odometer_in_km': 105118,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-06-25',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2019}
2026-01-29 06:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 717cd3d9-07e7-57d4-90ce-5b29fcf7f0d0 spider: auto1.fr
2026-01-29 06:04:10 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 717cd3d9-07e7-57d4-90ce-5b29fcf7f0d0 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'orange', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 105118, 'odometer_reading_unit': 'km', 'registration_date': '2019-06-25', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jg92327', 'expiration_date': '2026-01-29t16:05:56z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ingrandes sur vienne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 106, 'id': '717cd3d9-07e7-57d4-90ce-5b29fcf7f0d0', 'current_year_diff': 7, 'age_in_months': 79, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 105118}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 79,
     'auction_title': '',
     'c_o_2_emission_value': 106,
     'category': None,
     'color': 'orange',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:05:56z',
     'fuel_type': 'petrol',
     'id': '717cd3d9-07e7-57d4-90ce-5b29fcf7f0d0',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jg92327',
     'listing': 'auction',
     'location': 'fr, ingrandes sur vienne',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 105118,
     'odometer_in_km': 105118,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-06-25',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:05:56Z',
 'fuel_type': 'petrol',
 'id': '717cd3d9-07e7-57d4-90ce-5b29fcf7f0d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG92327',
 'listing': 'auction',
 'location': 'FR, Ingrandes sur Vienne',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 105118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2019}
2026-01-29 06:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG92327%27 HTTP/1.1" 200 None
2026-01-29 06:04:10 [auto1.fr] INFO: Saving data for JG92327: {'auction_closing_time': 1769702756.0, 'created_time': 1766995265.37718, 'last_price_update_time': 1769666650.982008}
2026-01-29 06:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JG92327') HTTP/1.1" 204 0
2026-01-29 06:04:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fa146f5-0591-5e24-a4e3-d9fc9b547ac2 with identifier: RA36744
2026-01-29 06:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fa146f5-0591-5e24-a4e3-d9fc9b547ac2 with scrape type 2
2026-01-29 06:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fa146f5-0591-5e24-a4e3-d9fc9b547ac2 with scrape type 2
2026-01-29 06:04:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0fa146f5-0591-5e24-a4e3-d9fc9b547ac2, identifier: RA36744
2026-01-29 06:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DD59039> (referer: https://www.auto1.com/v1/car-details-view/DD59039/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GF92974> (referer: https://www.auto1.com/v1/car-details-view/GF92974/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EV02167> (referer: https://www.auto1.com/v1/car-details-view/EV02167/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0fa146f5-0591-5e24-a4e3-d9fc9b547ac2 with identifier: RA36744
2026-01-29 06:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:04:11 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-01-29 06:04:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0fa146f5-0591-5e24-a4e3-d9fc9b547ac2 with identifier: RA36744
2026-01-29 06:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'yellow', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'automatic', 'odometer': 70496, 'odometer_reading_unit': 'km', 'registration_date': '2020-05-14', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ra36744', 'expiration_date': '2026-01-29t16:01:01z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'labege', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 128, 'id': '0fa146f5-0591-5e24-a4e3-d9fc9b547ac2', 'current_year_diff': 6, 'age_in_months': 68, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 70496}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 68,
     'auction_title': '',
     'c_o_2_emission_value': 128,
     'category': None,
     'color': 'yellow',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:01:01z',
     'fuel_type': 'petrol',
     'id': '0fa146f5-0591-5e24-a4e3-d9fc9b547ac2',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ra36744',
     'listing': 'auction',
     'location': 'labege',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 70496,
     'odometer_in_km': 70496,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-05-14',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech gt line',
     'transmission': 'automatic',
     'trim': 'gt line',
     'year': 2020}
2026-01-29 06:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 0fa146f5-0591-5e24-a4e3-d9fc9b547ac2 spider: auto1.fr
2026-01-29 06:04:11 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 0fa146f5-0591-5e24-a4e3-d9fc9b547ac2 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'yellow', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'automatic', 'odometer': 70496, 'odometer_reading_unit': 'km', 'registration_date': '2020-05-14', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ra36744', 'expiration_date': '2026-01-29t16:01:01z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'labege', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 128, 'id': '0fa146f5-0591-5e24-a4e3-d9fc9b547ac2', 'current_year_diff': 6, 'age_in_months': 68, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 70496}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 68,
     'auction_title': '',
     'c_o_2_emission_value': 128,
     'category': None,
     'color': 'yellow',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:01:01z',
     'fuel_type': 'petrol',
     'id': '0fa146f5-0591-5e24-a4e3-d9fc9b547ac2',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ra36744',
     'listing': 'auction',
     'location': 'labege',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 70496,
     'odometer_in_km': 70496,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-05-14',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech gt line',
     'transmission': 'automatic',
     'trim': 'gt line',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:01:01Z',
 'fuel_type': 'petrol',
 'id': '0fa146f5-0591-5e24-a4e3-d9fc9b547ac2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA36744',
 'listing': 'auction',
 'location': 'LABEGE',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 70496,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-05-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2020}
2026-01-29 06:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RA36744%27 HTTP/1.1" 200 None
2026-01-29 06:04:11 [auto1.fr] INFO: Saving data for RA36744: {'auction_closing_time': 1769702461.0, 'created_time': 1769061854.855391, 'last_price_update_time': 1769666651.674004}
2026-01-29 06:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RA36744') HTTP/1.1" 204 0
2026-01-29 06:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JY47910/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LB85234> (referer: https://www.auto1.com/v1/car-details-view/LB85234/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 170f4c99-226c-568b-bed6-0cda94d6e9df with identifier: DD59039
2026-01-29 06:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 170f4c99-226c-568b-bed6-0cda94d6e9df with scrape type 2
2026-01-29 06:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 170f4c99-226c-568b-bed6-0cda94d6e9df with scrape type 2
2026-01-29 06:04:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 170f4c99-226c-568b-bed6-0cda94d6e9df, identifier: DD59039
2026-01-29 06:04:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aacf7292-9526-5232-804a-2db192f1e5ee with identifier: GF92974
2026-01-29 06:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aacf7292-9526-5232-804a-2db192f1e5ee with scrape type 2
2026-01-29 06:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aacf7292-9526-5232-804a-2db192f1e5ee with scrape type 2
2026-01-29 06:04:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: aacf7292-9526-5232-804a-2db192f1e5ee, identifier: GF92974
2026-01-29 06:04:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea6fe30b-b566-5e50-bb11-8d8b20de3b01 with identifier: EV02167
2026-01-29 06:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea6fe30b-b566-5e50-bb11-8d8b20de3b01 with scrape type 2
2026-01-29 06:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea6fe30b-b566-5e50-bb11-8d8b20de3b01 with scrape type 2
2026-01-29 06:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ea6fe30b-b566-5e50-bb11-8d8b20de3b01, identifier: EV02167
2026-01-29 06:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 170f4c99-226c-568b-bed6-0cda94d6e9df with identifier: DD59039
2026-01-29 06:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 170f4c99-226c-568b-bed6-0cda94d6e9df with identifier: DD59039
2026-01-29 06:04:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 170f4c99-226c-568b-bed6-0cda94d6e9df with identifier: DD59039 to the API
2026-01-29 06:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:04:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:04:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DD59039>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:01:59Z',
 'fuel_type': 'hybrid',
 'id': '170f4c99-226c-568b-bed6-0cda94d6e9df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD59039',
 'listing': 'auction',
 'location': 'FR, Saint Herblain',
 'make': 'Mazda',
 'model': '2',
 'odometer': 23661,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 2 1.5 Hybrid Agile',
 'transmission': 'automatic',
 'trim': 'Agile',
 'year': 2023}
2026-01-29 06:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DD59039%27 HTTP/1.1" 200 None
2026-01-29 06:04:12 [auto1.fr] INFO: Saving data for DD59039: {'auction_closing_time': 1769702519.0, 'created_time': 1768889054.78601, 'last_price_update_time': 1769666652.363408}
2026-01-29 06:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DD59039') HTTP/1.1" 204 0
2026-01-29 06:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: aacf7292-9526-5232-804a-2db192f1e5ee with identifier: GF92974
2026-01-29 06:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: aacf7292-9526-5232-804a-2db192f1e5ee with identifier: GF92974
2026-01-29 06:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech graphic', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 22284, 'odometer_reading_unit': 'km', 'registration_date': '2019-06-04', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gf92974', 'expiration_date': '2026-01-29t16:55:20z', 'origin_country_code': 'fr', 'trim': 'graphic', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 96, 'id': 'aacf7292-9526-5232-804a-2db192f1e5ee', 'current_year_diff': 7, 'age_in_months': 79, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 22284}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 79,
     'auction_title': '',
     'c_o_2_emission_value': 96,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:55:20z',
     'fuel_type': 'petrol',
     'id': 'aacf7292-9526-5232-804a-2db192f1e5ee',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gf92974',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 22284,
     'odometer_in_km': 22284,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-06-04',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech graphic',
     'transmission': 'manual',
     'trim': 'graphic',
     'year': 2019}
2026-01-29 06:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: aacf7292-9526-5232-804a-2db192f1e5ee spider: auto1.fr
2026-01-29 06:04:12 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: aacf7292-9526-5232-804a-2db192f1e5ee due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech graphic', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 22284, 'odometer_reading_unit': 'km', 'registration_date': '2019-06-04', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gf92974', 'expiration_date': '2026-01-29t16:55:20z', 'origin_country_code': 'fr', 'trim': 'graphic', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 96, 'id': 'aacf7292-9526-5232-804a-2db192f1e5ee', 'current_year_diff': 7, 'age_in_months': 79, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 22284}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 79,
     'auction_title': '',
     'c_o_2_emission_value': 96,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:55:20z',
     'fuel_type': 'petrol',
     'id': 'aacf7292-9526-5232-804a-2db192f1e5ee',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gf92974',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 22284,
     'odometer_in_km': 22284,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-06-04',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech graphic',
     'transmission': 'manual',
     'trim': 'graphic',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:55:20Z',
 'fuel_type': 'petrol',
 'id': 'aacf7292-9526-5232-804a-2db192f1e5ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF92974',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 22284,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Graphic',
 'transmission': 'manual',
 'trim': 'Graphic',
 'year': 2019}
2026-01-29 06:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF92974%27 HTTP/1.1" 200 None
2026-01-29 06:04:12 [auto1.fr] INFO: Saving data for GF92974: {'auction_closing_time': 1769705720.0, 'created_time': 1769580107.967628, 'last_price_update_time': 1769666652.587568}
2026-01-29 06:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GF92974') HTTP/1.1" 204 0
2026-01-29 06:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ea6fe30b-b566-5e50-bb11-8d8b20de3b01 with identifier: EV02167
2026-01-29 06:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ea6fe30b-b566-5e50-bb11-8d8b20de3b01 with identifier: EV02167
2026-01-29 06:04:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ea6fe30b-b566-5e50-bb11-8d8b20de3b01 with identifier: EV02167 to the API
2026-01-29 06:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:04:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:04:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EV02167>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 165,
 'expiration_date': '2026-01-29T16:58:53Z',
 'fuel_type': 'petrol',
 'id': 'ea6fe30b-b566-5e50-bb11-8d8b20de3b01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV02167',
 'listing': 'auction',
 'location': 'FR, Nanteuil-le-Haudouin',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 89894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 THP GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2018}
2026-01-29 06:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EV02167%27 HTTP/1.1" 200 None
2026-01-29 06:04:12 [auto1.fr] INFO: Saving data for EV02167: {'auction_closing_time': 1769705933.0, 'created_time': 1769533722.220596, 'last_price_update_time': 1769666652.961367}
2026-01-29 06:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EV02167') HTTP/1.1" 204 0
2026-01-29 06:04:12 [scrapy.extensions.logstats] INFO: Crawled 255 pages (at 82 pages/min), scraped 51 items (at 13 items/min)
2026-01-29 06:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AZ84868> (referer: https://www.auto1.com/v1/car-details-view/AZ84868/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PY32143> (referer: https://www.auto1.com/v1/car-details-view/PY32143/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NN71970> (referer: https://www.auto1.com/v1/car-details-view/NN71970/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 625d80c4-9c1c-5cd1-96b3-b0890db47bdc with identifier: LB85234
2026-01-29 06:04:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 625d80c4-9c1c-5cd1-96b3-b0890db47bdc with scrape type 2
2026-01-29 06:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 625d80c4-9c1c-5cd1-96b3-b0890db47bdc with scrape type 2
2026-01-29 06:04:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 625d80c4-9c1c-5cd1-96b3-b0890db47bdc, identifier: LB85234
2026-01-29 06:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 625d80c4-9c1c-5cd1-96b3-b0890db47bdc with identifier: LB85234
2026-01-29 06:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 625d80c4-9c1c-5cd1-96b3-b0890db47bdc with identifier: LB85234
2026-01-29 06:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 141446 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    141446
2026-01-29 06:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 625d80c4-9c1c-5cd1-96b3-b0890db47bdc spider: auto1.fr
2026-01-29 06:04:13 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 625d80c4-9c1c-5cd1-96b3-b0890db47bdc due to rule: high_mileage_for_make.json, error: 141446 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    141446
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:29:58Z',
 'fuel_type': 'diesel',
 'id': '625d80c4-9c1c-5cd1-96b3-b0890db47bdc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB85234',
 'listing': 'auction',
 'location': 'FR, Marckolsheim',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 141446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Blue-HDi Allure Business',
 'transmission': 'manual',
 'trim': 'Allure Business',
 'year': 2017}
2026-01-29 06:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LB85234%27 HTTP/1.1" 200 None
2026-01-29 06:04:13 [auto1.fr] INFO: Saving data for LB85234: {'auction_closing_time': 1769704198.0, 'created_time': 1769533538.086342, 'last_price_update_time': 1769666653.316262}
2026-01-29 06:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LB85234') HTTP/1.1" 204 0
2026-01-29 06:04:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7a9d468-5ba2-56c7-9b8f-868f371b5421 with identifier: AZ84868
2026-01-29 06:04:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7a9d468-5ba2-56c7-9b8f-868f371b5421 with scrape type 2
2026-01-29 06:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7a9d468-5ba2-56c7-9b8f-868f371b5421 with scrape type 2
2026-01-29 06:04:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c7a9d468-5ba2-56c7-9b8f-868f371b5421, identifier: AZ84868
2026-01-29 06:04:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90bd01d5-a0e6-5d31-b4ee-8c83949e6cb9 with identifier: PY32143
2026-01-29 06:04:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90bd01d5-a0e6-5d31-b4ee-8c83949e6cb9 with scrape type 2
2026-01-29 06:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90bd01d5-a0e6-5d31-b4ee-8c83949e6cb9 with scrape type 2
2026-01-29 06:04:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 90bd01d5-a0e6-5d31-b4ee-8c83949e6cb9, identifier: PY32143
2026-01-29 06:04:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17c5b32c-d3fe-5248-b4b7-2094c52d02fd with identifier: NN71970
2026-01-29 06:04:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17c5b32c-d3fe-5248-b4b7-2094c52d02fd with scrape type 2
2026-01-29 06:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17c5b32c-d3fe-5248-b4b7-2094c52d02fd with scrape type 2
2026-01-29 06:04:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 17c5b32c-d3fe-5248-b4b7-2094c52d02fd, identifier: NN71970
2026-01-29 06:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c7a9d468-5ba2-56c7-9b8f-868f371b5421 with identifier: AZ84868
2026-01-29 06:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c7a9d468-5ba2-56c7-9b8f-868f371b5421 with identifier: AZ84868
2026-01-29 06:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 172031 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    172031
2026-01-29 06:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c7a9d468-5ba2-56c7-9b8f-868f371b5421 spider: auto1.fr
2026-01-29 06:04:13 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: c7a9d468-5ba2-56c7-9b8f-868f371b5421 due to rule: high_mileage_for_country.json, error: 172031 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    172031
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:50:25Z',
 'fuel_type': 'diesel',
 'id': 'c7a9d468-5ba2-56c7-9b8f-868f371b5421',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ84868',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 172031,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2018}
2026-01-29 06:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AZ84868%27 HTTP/1.1" 200 None
2026-01-29 06:04:13 [auto1.fr] INFO: Saving data for AZ84868: {'auction_closing_time': 1769705425.0, 'created_time': 1769534372.781772, 'last_price_update_time': 1769666653.999407}
2026-01-29 06:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AZ84868') HTTP/1.1" 204 0
2026-01-29 06:04:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 90bd01d5-a0e6-5d31-b4ee-8c83949e6cb9 with identifier: PY32143
2026-01-29 06:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 90bd01d5-a0e6-5d31-b4ee-8c83949e6cb9 with identifier: PY32143
2026-01-29 06:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel corsa 1.2 edition', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'corsa', 'transmission': 'manual', 'odometer': 7185, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/py32143', 'expiration_date': '2026-01-29t16:37:01z', 'origin_country_code': 'fr', 'trim': 'edition', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, reims', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 119, 'id': '90bd01d5-a0e6-5d31-b4ee-8c83949e6cb9', 'current_year_diff': 3, 'age_in_months': 28, 'make_model': 'opel corsa', 'sanitized_make': 'opel', 'odometer_in_km': 7185}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 28,
     'auction_title': '',
     'c_o_2_emission_value': 119,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 75,
     'expiration_date': '2026-01-29t16:37:01z',
     'fuel_type': 'petrol',
     'id': '90bd01d5-a0e6-5d31-b4ee-8c83949e6cb9',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/py32143',
     'listing': 'auction',
     'location': 'fr, reims',
     'make': 'opel',
     'make_model': 'opel corsa',
     'model': 'corsa',
     'odometer': 7185,
     'odometer_in_km': 7185,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-08-30',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel corsa 1.2 edition',
     'transmission': 'manual',
     'trim': 'edition',
     'year': 2023}
2026-01-29 06:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 90bd01d5-a0e6-5d31-b4ee-8c83949e6cb9 spider: auto1.fr
2026-01-29 06:04:14 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 90bd01d5-a0e6-5d31-b4ee-8c83949e6cb9 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel corsa 1.2 edition', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'corsa', 'transmission': 'manual', 'odometer': 7185, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/py32143', 'expiration_date': '2026-01-29t16:37:01z', 'origin_country_code': 'fr', 'trim': 'edition', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, reims', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 119, 'id': '90bd01d5-a0e6-5d31-b4ee-8c83949e6cb9', 'current_year_diff': 3, 'age_in_months': 28, 'make_model': 'opel corsa', 'sanitized_make': 'opel', 'odometer_in_km': 7185}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 28,
     'auction_title': '',
     'c_o_2_emission_value': 119,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 75,
     'expiration_date': '2026-01-29t16:37:01z',
     'fuel_type': 'petrol',
     'id': '90bd01d5-a0e6-5d31-b4ee-8c83949e6cb9',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/py32143',
     'listing': 'auction',
     'location': 'fr, reims',
     'make': 'opel',
     'make_model': 'opel corsa',
     'model': 'corsa',
     'odometer': 7185,
     'odometer_in_km': 7185,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-08-30',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel corsa 1.2 edition',
     'transmission': 'manual',
     'trim': 'edition',
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:37:01Z',
 'fuel_type': 'petrol',
 'id': '90bd01d5-a0e6-5d31-b4ee-8c83949e6cb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY32143',
 'listing': 'auction',
 'location': 'FR, Reims',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 7185,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2023}
2026-01-29 06:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY32143%27 HTTP/1.1" 200 None
2026-01-29 06:04:14 [auto1.fr] INFO: Saving data for PY32143: {'auction_closing_time': 1769704621.0, 'created_time': 1769533391.425101, 'last_price_update_time': 1769666654.268006}
2026-01-29 06:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PY32143') HTTP/1.1" 204 0
2026-01-29 06:04:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 17c5b32c-d3fe-5248-b4b7-2094c52d02fd with identifier: NN71970
2026-01-29 06:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 17c5b32c-d3fe-5248-b4b7-2094c52d02fd with identifier: NN71970
2026-01-29 06:04:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 17c5b32c-d3fe-5248-b4b7-2094c52d02fd with identifier: NN71970 to the API
2026-01-29 06:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:04:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:04:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NN71970>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 230,
 'expiration_date': '2026-01-29T16:40:04Z',
 'fuel_type': 'hybrid',
 'id': '17c5b32c-d3fe-5248-b4b7-2094c52d02fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN71970',
 'listing': 'auction',
 'location': 'FR, TARNOS',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 32192,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Hybrid N Line Executive 2WD',
 'transmission': 'automatic',
 'trim': 'N Line Executive 2WD',
 'year': 2024}
2026-01-29 06:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NN71970%27 HTTP/1.1" 200 None
2026-01-29 06:04:14 [auto1.fr] INFO: Saving data for NN71970: {'auction_closing_time': 1769704804.0, 'created_time': 1769533532.593232, 'last_price_update_time': 1769666654.62056}
2026-01-29 06:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NN71970') HTTP/1.1" 204 0
2026-01-29 06:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_24899ed6265cbeede611ffe4b69cf75b.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_b002fad87fcbc027c037170b1f1e8863.png> (referer: https://www.auto1.com/)
2026-01-29 06:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YP23412> (referer: https://www.auto1.com/v1/car-details-view/YP23412/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GN42324/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GJ30545> (referer: https://www.auto1.com/v1/car-details-view/GJ30545/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EV06332> (referer: https://www.auto1.com/v1/car-details-view/EV06332/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EJ76169/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_922f4d90c87fe863ebc2b4bf499f2f55.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_f4ec9fa6bb9ac10f24bfac06f64a4e4d.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_34c2618888936959432db9dfaf35957a.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:04:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:04:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c28abd0>
2026-01-29 06:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebd556ab-5120-52f2-9fba-5871b84db0bf/ebd556ab-5120-52f2-9fba-5871b84db0bf_image_14.jpg HTTP/1.1" 201 0
2026-01-29 06:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F5c%252Fe55cba11dcb6db7c9220cfd537533033%252Fpa%252FYA10266_24899ed6265cbeede611ffe4b69cf75b.jpg') HTTP/1.1" 204 0
2026-01-29 06:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_24899ed6265cbeede611ffe4b69cf75b.jpg saved to cache
2026-01-29 06:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item ebd556ab-5120-52f2-9fba-5871b84db0bf
2026-01-29 06:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_520cb2abd9626027f59360b7e46d5b23.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_1b5aaa14e3e8dd21ae9ff9d2b9814227.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_0cb86aaf0ef5d0b8215090166b9249b1.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:04:15 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-01-29 06:04:15 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2026-01-29 06:04:15 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2026-01-29 06:04:15 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2026-01-29 06:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ffd10d0>
2026-01-29 06:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d7ca5a-8f66-565e-928c-b5ea65a557cd/e2d7ca5a-8f66-565e-928c-b5ea65a557cd_image_15.png HTTP/1.1" 201 0
2026-01-29 06:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F14%252Fef14cf0fc3f2d791fabb0a331665f04c%252Fpa%252FXA49145_b002fad87fcbc027c037170b1f1e8863.png') HTTP/1.1" 204 0
2026-01-29 06:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_b002fad87fcbc027c037170b1f1e8863.png saved to cache
2026-01-29 06:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item e2d7ca5a-8f66-565e-928c-b5ea65a557cd
2026-01-29 06:04:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a261cec6-07d7-523f-8094-ee53053950d2 with identifier: YP23412
2026-01-29 06:04:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a261cec6-07d7-523f-8094-ee53053950d2 with scrape type 2
2026-01-29 06:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a261cec6-07d7-523f-8094-ee53053950d2 with scrape type 2
2026-01-29 06:04:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a261cec6-07d7-523f-8094-ee53053950d2, identifier: YP23412
2026-01-29 06:04:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70b4a04d-fb9f-5dbc-863e-bce50ab9b7ee with identifier: GJ30545
2026-01-29 06:04:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70b4a04d-fb9f-5dbc-863e-bce50ab9b7ee with scrape type 2
2026-01-29 06:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70b4a04d-fb9f-5dbc-863e-bce50ab9b7ee with scrape type 2
2026-01-29 06:04:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 70b4a04d-fb9f-5dbc-863e-bce50ab9b7ee, identifier: GJ30545
2026-01-29 06:04:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3b4449c-7c33-5aa3-82e6-738c424b88a1 with identifier: EV06332
2026-01-29 06:04:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3b4449c-7c33-5aa3-82e6-738c424b88a1 with scrape type 2
2026-01-29 06:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3b4449c-7c33-5aa3-82e6-738c424b88a1 with scrape type 2
2026-01-29 06:04:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f3b4449c-7c33-5aa3-82e6-738c424b88a1, identifier: EV06332
2026-01-29 06:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff81a10>
2026-01-29 06:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e568ace-8955-5943-a54f-3b2b5d255c28/9e568ace-8955-5943-a54f-3b2b5d255c28_image_14.jpg HTTP/1.1" 201 0
2026-01-29 06:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2a%252F3d2a4f42266c8b5b8dba15df9facba85%252Fpa%252FMF46010_922f4d90c87fe863ebc2b4bf499f2f55.jpg') HTTP/1.1" 204 0
2026-01-29 06:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_922f4d90c87fe863ebc2b4bf499f2f55.jpg saved to cache
2026-01-29 06:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 9e568ace-8955-5943-a54f-3b2b5d255c28
2026-01-29 06:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c296d50>
2026-01-29 06:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:04:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d7ca5a-8f66-565e-928c-b5ea65a557cd/e2d7ca5a-8f66-565e-928c-b5ea65a557cd_image_14.jpg HTTP/1.1" 201 0
2026-01-29 06:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F14%252Fef14cf0fc3f2d791fabb0a331665f04c%252Fpa%252FXA49145_f4ec9fa6bb9ac10f24bfac06f64a4e4d.jpg') HTTP/1.1" 204 0
2026-01-29 06:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_f4ec9fa6bb9ac10f24bfac06f64a4e4d.jpg saved to cache
2026-01-29 06:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item e2d7ca5a-8f66-565e-928c-b5ea65a557cd
2026-01-29 06:04:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:04:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f3bee90>
2026-01-29 06:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:04:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebd556ab-5120-52f2-9fba-5871b84db0bf/ebd556ab-5120-52f2-9fba-5871b84db0bf_image_11.jpg HTTP/1.1" 201 0
2026-01-29 06:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F5c%252Fe55cba11dcb6db7c9220cfd537533033%252Fpa%252FYA10266_34c2618888936959432db9dfaf35957a.jpg') HTTP/1.1" 204 0
2026-01-29 06:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_34c2618888936959432db9dfaf35957a.jpg saved to cache
2026-01-29 06:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ebd556ab-5120-52f2-9fba-5871b84db0bf
2026-01-29 06:04:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a261cec6-07d7-523f-8094-ee53053950d2 with identifier: YP23412
2026-01-29 06:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a261cec6-07d7-523f-8094-ee53053950d2 with identifier: YP23412
2026-01-29 06:04:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a261cec6-07d7-523f-8094-ee53053950d2 with identifier: YP23412 to the API
2026-01-29 06:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:04:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:04:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YP23412>
{'auction_title': '',
 'c_o_2_emission_value': 43,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 258,
 'expiration_date': '2026-01-29T16:59:34Z',
 'fuel_type': 'hybrid',
 'id': 'a261cec6-07d7-523f-8094-ee53053950d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP23412',
 'listing': 'auction',
 'location': 'FR, Villenoy',
 'make': 'MG',
 'model': 'EHS',
 'odometer': 111661,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MG EHS 1.5 T-GDI Plug-in Hybrid Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2021}
2026-01-29 06:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP23412%27 HTTP/1.1" 200 None
2026-01-29 06:04:16 [auto1.fr] INFO: Saving data for YP23412: {'auction_closing_time': 1769705974.0, 'created_time': 1769015743.336874, 'last_price_update_time': 1769666656.842654}
2026-01-29 06:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YP23412') HTTP/1.1" 204 0
2026-01-29 06:04:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 70b4a04d-fb9f-5dbc-863e-bce50ab9b7ee with identifier: GJ30545
2026-01-29 06:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 70b4a04d-fb9f-5dbc-863e-bce50ab9b7ee with identifier: GJ30545
2026-01-29 06:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 e-thp gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 74618, 'odometer_reading_unit': 'km', 'registration_date': '2018-10-21', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gj30545', 'expiration_date': '2026-01-29t16:06:07z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, nanteuil-le-haudouin', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 112, 'id': '70b4a04d-fb9f-5dbc-863e-bce50ab9b7ee', 'current_year_diff': 8, 'age_in_months': 87, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 74618}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 87,
     'auction_title': '',
     'c_o_2_emission_value': 112,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:06:07z',
     'fuel_type': 'petrol',
     'id': '70b4a04d-fb9f-5dbc-863e-bce50ab9b7ee',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gj30545',
     'listing': 'auction',
     'location': 'fr, nanteuil-le-haudouin',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 74618,
     'odometer_in_km': 74618,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-10-21',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 e-thp gt line',
     'transmission': 'manual',
     'trim': 'gt line',
     'year': 2018}
2026-01-29 06:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 70b4a04d-fb9f-5dbc-863e-bce50ab9b7ee spider: auto1.fr
2026-01-29 06:04:17 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 70b4a04d-fb9f-5dbc-863e-bce50ab9b7ee due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 e-thp gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 74618, 'odometer_reading_unit': 'km', 'registration_date': '2018-10-21', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gj30545', 'expiration_date': '2026-01-29t16:06:07z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, nanteuil-le-haudouin', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 112, 'id': '70b4a04d-fb9f-5dbc-863e-bce50ab9b7ee', 'current_year_diff': 8, 'age_in_months': 87, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 74618}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 87,
     'auction_title': '',
     'c_o_2_emission_value': 112,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:06:07z',
     'fuel_type': 'petrol',
     'id': '70b4a04d-fb9f-5dbc-863e-bce50ab9b7ee',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gj30545',
     'listing': 'auction',
     'location': 'fr, nanteuil-le-haudouin',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 74618,
     'odometer_in_km': 74618,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-10-21',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 e-thp gt line',
     'transmission': 'manual',
     'trim': 'gt line',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:06:07Z',
 'fuel_type': 'petrol',
 'id': '70b4a04d-fb9f-5dbc-863e-bce50ab9b7ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ30545',
 'listing': 'auction',
 'location': 'FR, Nanteuil-le-Haudouin',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 74618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 e-THP GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2018}
2026-01-29 06:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GJ30545%27 HTTP/1.1" 200 None
2026-01-29 06:04:17 [auto1.fr] INFO: Saving data for GJ30545: {'auction_closing_time': 1769702767.0, 'created_time': 1769533829.944816, 'last_price_update_time': 1769666657.093135}
2026-01-29 06:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GJ30545') HTTP/1.1" 204 0
2026-01-29 06:04:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f3b4449c-7c33-5aa3-82e6-738c424b88a1 with identifier: EV06332
2026-01-29 06:04:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f3b4449c-7c33-5aa3-82e6-738c424b88a1 with identifier: EV06332
2026-01-29 06:04:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f3b4449c-7c33-5aa3-82e6-738c424b88a1 with identifier: EV06332 to the API
2026-01-29 06:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:04:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:04:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EV06332>
{'auction_title': '',
 'c_o_2_emission_value': 87,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'engine_horse_power': 122,
 'expiration_date': '2026-01-29T16:48:16Z',
 'fuel_type': 'hybrid',
 'id': 'f3b4449c-7c33-5aa3-82e6-738c424b88a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV06332',
 'listing': 'auction',
 'location': 'Valence',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 113784,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota C-HR 1.8 Hybrid Graphic',
 'transmission': 'automatic',
 'trim': 'Graphic',
 'year': 2018}
2026-01-29 06:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EV06332%27 HTTP/1.1" 200 None
2026-01-29 06:04:17 [auto1.fr] INFO: Saving data for EV06332: {'auction_closing_time': 1769705296.0, 'created_time': 1769534429.057254, 'last_price_update_time': 1769666657.447529}
2026-01-29 06:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EV06332') HTTP/1.1" 204 0
2026-01-29 06:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_3df9134a3d2421768f875904d01cc6e1.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_6347c3c711733e89f905555ef2072ae0.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_1f836c2e1e0e435ca0e5e3006eb501f6.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JJ43249> (referer: https://www.auto1.com/v1/car-details-view/JJ43249/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NM72906> (referer: https://www.auto1.com/v1/car-details-view/NM72906/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WD38934> (referer: https://www.auto1.com/v1/car-details-view/WD38934/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c130290>
2026-01-29 06:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e568ace-8955-5943-a54f-3b2b5d255c28/9e568ace-8955-5943-a54f-3b2b5d255c28_image_13.jpg HTTP/1.1" 201 0
2026-01-29 06:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2a%252F3d2a4f42266c8b5b8dba15df9facba85%252Fpa%252FMF46010_520cb2abd9626027f59360b7e46d5b23.jpg') HTTP/1.1" 204 0
2026-01-29 06:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_520cb2abd9626027f59360b7e46d5b23.jpg saved to cache
2026-01-29 06:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 9e568ace-8955-5943-a54f-3b2b5d255c28
2026-01-29 06:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f3b9490>
2026-01-29 06:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebd556ab-5120-52f2-9fba-5871b84db0bf/ebd556ab-5120-52f2-9fba-5871b84db0bf_image_10.jpg HTTP/1.1" 201 0
2026-01-29 06:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F5c%252Fe55cba11dcb6db7c9220cfd537533033%252Fpa%252FYA10266_1b5aaa14e3e8dd21ae9ff9d2b9814227.jpg') HTTP/1.1" 204 0
2026-01-29 06:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_1b5aaa14e3e8dd21ae9ff9d2b9814227.jpg saved to cache
2026-01-29 06:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ebd556ab-5120-52f2-9fba-5871b84db0bf
2026-01-29 06:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f4b6250>
2026-01-29 06:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d7ca5a-8f66-565e-928c-b5ea65a557cd/e2d7ca5a-8f66-565e-928c-b5ea65a557cd_image_13.jpg HTTP/1.1" 201 0
2026-01-29 06:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F14%252Fef14cf0fc3f2d791fabb0a331665f04c%252Fpa%252FXA49145_0cb86aaf0ef5d0b8215090166b9249b1.jpg') HTTP/1.1" 204 0
2026-01-29 06:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_0cb86aaf0ef5d0b8215090166b9249b1.jpg saved to cache
2026-01-29 06:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item e2d7ca5a-8f66-565e-928c-b5ea65a557cd
2026-01-29 06:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YY09741/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KU11817> (referer: https://www.auto1.com/v1/car-details-view/KU11817/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TZ78774/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f3e2650>
2026-01-29 06:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d7ca5a-8f66-565e-928c-b5ea65a557cd/e2d7ca5a-8f66-565e-928c-b5ea65a557cd_image_12.jpg HTTP/1.1" 201 0
2026-01-29 06:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F14%252Fef14cf0fc3f2d791fabb0a331665f04c%252Fpa%252FXA49145_3df9134a3d2421768f875904d01cc6e1.jpg') HTTP/1.1" 204 0
2026-01-29 06:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_3df9134a3d2421768f875904d01cc6e1.jpg saved to cache
2026-01-29 06:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item e2d7ca5a-8f66-565e-928c-b5ea65a557cd
2026-01-29 06:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f254690>
2026-01-29 06:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebd556ab-5120-52f2-9fba-5871b84db0bf/ebd556ab-5120-52f2-9fba-5871b84db0bf_image_9.jpg HTTP/1.1" 201 0
2026-01-29 06:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F5c%252Fe55cba11dcb6db7c9220cfd537533033%252Fpa%252FYA10266_6347c3c711733e89f905555ef2072ae0.jpg') HTTP/1.1" 204 0
2026-01-29 06:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_6347c3c711733e89f905555ef2072ae0.jpg saved to cache
2026-01-29 06:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ebd556ab-5120-52f2-9fba-5871b84db0bf
2026-01-29 06:04:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ebd556ab-5120-52f2-9fba-5871b84db0bf, skipping ID generation
2026-01-29 06:04:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebd556ab-5120-52f2-9fba-5871b84db0bf with scrape type 1
2026-01-29 06:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ebd556ab-5120-52f2-9fba-5871b84db0bf from tracking dictionaries
2026-01-29 06:04:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ebd556ab-5120-52f2-9fba-5871b84db0bf sending to next pipeline
2026-01-29 06:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ebd556ab-5120-52f2-9fba-5871b84db0bf, identifier: YA10266
2026-01-29 06:04:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:04:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f4b7090>
2026-01-29 06:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:04:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e568ace-8955-5943-a54f-3b2b5d255c28/9e568ace-8955-5943-a54f-3b2b5d255c28_image_12.jpg HTTP/1.1" 201 0
2026-01-29 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2a%252F3d2a4f42266c8b5b8dba15df9facba85%252Fpa%252FMF46010_1f836c2e1e0e435ca0e5e3006eb501f6.jpg') HTTP/1.1" 204 0
2026-01-29 06:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_1f836c2e1e0e435ca0e5e3006eb501f6.jpg saved to cache
2026-01-29 06:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 9e568ace-8955-5943-a54f-3b2b5d255c28
2026-01-29 06:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7738f711-deb1-5458-be30-b96e15ed5310 with identifier: JJ43249
2026-01-29 06:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7738f711-deb1-5458-be30-b96e15ed5310 with scrape type 2
2026-01-29 06:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7738f711-deb1-5458-be30-b96e15ed5310 with scrape type 2
2026-01-29 06:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7738f711-deb1-5458-be30-b96e15ed5310, identifier: JJ43249
2026-01-29 06:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89a4ea5a-0950-5459-b46a-d21495b53475 with identifier: NM72906
2026-01-29 06:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89a4ea5a-0950-5459-b46a-d21495b53475 with scrape type 2
2026-01-29 06:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89a4ea5a-0950-5459-b46a-d21495b53475 with scrape type 2
2026-01-29 06:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 89a4ea5a-0950-5459-b46a-d21495b53475, identifier: NM72906
2026-01-29 06:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46f993e6-4763-523d-89fd-68ba6a840471 with identifier: WD38934
2026-01-29 06:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46f993e6-4763-523d-89fd-68ba6a840471 with scrape type 2
2026-01-29 06:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46f993e6-4763-523d-89fd-68ba6a840471 with scrape type 2
2026-01-29 06:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 46f993e6-4763-523d-89fd-68ba6a840471, identifier: WD38934
2026-01-29 06:04:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ebd556ab-5120-52f2-9fba-5871b84db0bf with identifier: YA10266
2026-01-29 06:04:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ebd556ab-5120-52f2-9fba-5871b84db0bf with identifier: YA10266
2026-01-29 06:04:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 160863 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    160863
2026-01-29 06:04:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ebd556ab-5120-52f2-9fba-5871b84db0bf spider: auto1.fr
2026-01-29 06:04:19 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: ebd556ab-5120-52f2-9fba-5871b84db0bf due to rule: high_mileage_for_country.json, error: 160863 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    160863
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:59:51Z',
 'fuel_type': 'diesel',
 'id': 'ebd556ab-5120-52f2-9fba-5871b84db0bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA10266',
 'listing': 'auction',
 'location': 'FR, Saint-Léonard',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 160863,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebd556ab-5120-52f2-9fba-5871b84db0bf/ebd556ab-5120-52f2-9fba-5871b84db0bf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_c94eff5489f6ec8c65acc91b209af087.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebd556ab-5120-52f2-9fba-5871b84db0bf/ebd556ab-5120-52f2-9fba-5871b84db0bf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_4465fc3c6a68e3451ed8b1436133c496.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebd556ab-5120-52f2-9fba-5871b84db0bf/ebd556ab-5120-52f2-9fba-5871b84db0bf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_132e0e0ceceff592e39c9929f1cad2ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebd556ab-5120-52f2-9fba-5871b84db0bf/ebd556ab-5120-52f2-9fba-5871b84db0bf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_f075c4ec90f1da31ce94aa054b78c3f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebd556ab-5120-52f2-9fba-5871b84db0bf/ebd556ab-5120-52f2-9fba-5871b84db0bf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_4298da4a72c75675f99ec8be19207de9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebd556ab-5120-52f2-9fba-5871b84db0bf/ebd556ab-5120-52f2-9fba-5871b84db0bf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_be677b1ae2fe6079841d951e49c17d09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebd556ab-5120-52f2-9fba-5871b84db0bf/ebd556ab-5120-52f2-9fba-5871b84db0bf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_b3d782766dcafad422977656a27581c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebd556ab-5120-52f2-9fba-5871b84db0bf/ebd556ab-5120-52f2-9fba-5871b84db0bf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_4a5644171f28a1d951b012ffb6121800.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebd556ab-5120-52f2-9fba-5871b84db0bf/ebd556ab-5120-52f2-9fba-5871b84db0bf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_7f4a6e856ea6bd014622c63a3a2bca60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebd556ab-5120-52f2-9fba-5871b84db0bf/ebd556ab-5120-52f2-9fba-5871b84db0bf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_6347c3c711733e89f905555ef2072ae0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebd556ab-5120-52f2-9fba-5871b84db0bf/ebd556ab-5120-52f2-9fba-5871b84db0bf_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_1b5aaa14e3e8dd21ae9ff9d2b9814227.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebd556ab-5120-52f2-9fba-5871b84db0bf/ebd556ab-5120-52f2-9fba-5871b84db0bf_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_34c2618888936959432db9dfaf35957a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebd556ab-5120-52f2-9fba-5871b84db0bf/ebd556ab-5120-52f2-9fba-5871b84db0bf_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_35bbc9949e5881fd9ad8fb77ed8e005c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebd556ab-5120-52f2-9fba-5871b84db0bf/ebd556ab-5120-52f2-9fba-5871b84db0bf_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_610f17121f0c85e521c8e66a3ed8b308.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebd556ab-5120-52f2-9fba-5871b84db0bf/ebd556ab-5120-52f2-9fba-5871b84db0bf_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_24899ed6265cbeede611ffe4b69cf75b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebd556ab-5120-52f2-9fba-5871b84db0bf/ebd556ab-5120-52f2-9fba-5871b84db0bf_image_15.png',
             'Extension': 'png',
             'FileSizeInBytes': 75428,
             'Height': 525,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/5c/e55cba11dcb6db7c9220cfd537533033/pa/YA10266_b9d89d41c39e9b49afd3beaace876f03.png',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.5 Blue-HDi Feel',
 'transmission': 'automatic',
 'trim': 'Feel',
 'year': 2020}
2026-01-29 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YA10266%27 HTTP/1.1" 200 None
2026-01-29 06:04:19 [auto1.fr] INFO: Saving data for YA10266: {'created_time': 1769666659.915439, 'last_price_update_time': 1769666659.915447, 'auction_closing_time': 1769705991.0}
2026-01-29 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YA10266') HTTP/1.1" 204 0
2026-01-29 06:04:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7738f711-deb1-5458-be30-b96e15ed5310 with identifier: JJ43249
2026-01-29 06:04:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7738f711-deb1-5458-be30-b96e15ed5310 with identifier: JJ43249
2026-01-29 06:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'yellow', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'automatic', 'odometer': 64470, 'odometer_reading_unit': 'km', 'registration_date': '2020-06-18', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jj43249', 'expiration_date': '2026-01-29t16:14:29z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'saint brieuc', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 133, 'id': '7738f711-deb1-5458-be30-b96e15ed5310', 'current_year_diff': 6, 'age_in_months': 67, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 64470}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 67,
     'auction_title': '',
     'c_o_2_emission_value': 133,
     'category': None,
     'color': 'yellow',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:14:29z',
     'fuel_type': 'petrol',
     'id': '7738f711-deb1-5458-be30-b96e15ed5310',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jj43249',
     'listing': 'auction',
     'location': 'saint brieuc',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 64470,
     'odometer_in_km': 64470,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-06-18',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech gt line',
     'transmission': 'automatic',
     'trim': 'gt line',
     'year': 2020}
2026-01-29 06:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 7738f711-deb1-5458-be30-b96e15ed5310 spider: auto1.fr
2026-01-29 06:04:20 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 7738f711-deb1-5458-be30-b96e15ed5310 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'yellow', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'automatic', 'odometer': 64470, 'odometer_reading_unit': 'km', 'registration_date': '2020-06-18', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jj43249', 'expiration_date': '2026-01-29t16:14:29z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'saint brieuc', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 133, 'id': '7738f711-deb1-5458-be30-b96e15ed5310', 'current_year_diff': 6, 'age_in_months': 67, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 64470}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 67,
     'auction_title': '',
     'c_o_2_emission_value': 133,
     'category': None,
     'color': 'yellow',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:14:29z',
     'fuel_type': 'petrol',
     'id': '7738f711-deb1-5458-be30-b96e15ed5310',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jj43249',
     'listing': 'auction',
     'location': 'saint brieuc',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 64470,
     'odometer_in_km': 64470,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-06-18',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech gt line',
     'transmission': 'automatic',
     'trim': 'gt line',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:14:29Z',
 'fuel_type': 'petrol',
 'id': '7738f711-deb1-5458-be30-b96e15ed5310',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ43249',
 'listing': 'auction',
 'location': 'Saint Brieuc',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 64470,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2020}
2026-01-29 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ43249%27 HTTP/1.1" 200 None
2026-01-29 06:04:20 [auto1.fr] INFO: Saving data for JJ43249: {'auction_closing_time': 1769703269.0, 'created_time': 1769015764.516308, 'last_price_update_time': 1769666660.138804}
2026-01-29 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JJ43249') HTTP/1.1" 204 0
2026-01-29 06:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 89a4ea5a-0950-5459-b46a-d21495b53475 with identifier: NM72906
2026-01-29 06:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 89a4ea5a-0950-5459-b46a-d21495b53475 with identifier: NM72906
2026-01-29 06:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 e-thp style', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 88256, 'odometer_reading_unit': 'km', 'registration_date': '2018-07-08', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nm72906', 'expiration_date': '2026-01-29t16:58:46z', 'origin_country_code': 'fr', 'trim': 'style', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, la chapelle longueville', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 112, 'id': '89a4ea5a-0950-5459-b46a-d21495b53475', 'current_year_diff': 8, 'age_in_months': 90, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 88256}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 90,
     'auction_title': '',
     'c_o_2_emission_value': 112,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:58:46z',
     'fuel_type': 'petrol',
     'id': '89a4ea5a-0950-5459-b46a-d21495b53475',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nm72906',
     'listing': 'auction',
     'location': 'fr, la chapelle longueville',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 88256,
     'odometer_in_km': 88256,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-07-08',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 e-thp style',
     'transmission': 'manual',
     'trim': 'style',
     'year': 2018}
2026-01-29 06:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 89a4ea5a-0950-5459-b46a-d21495b53475 spider: auto1.fr
2026-01-29 06:04:20 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 89a4ea5a-0950-5459-b46a-d21495b53475 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 e-thp style', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 88256, 'odometer_reading_unit': 'km', 'registration_date': '2018-07-08', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nm72906', 'expiration_date': '2026-01-29t16:58:46z', 'origin_country_code': 'fr', 'trim': 'style', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, la chapelle longueville', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 112, 'id': '89a4ea5a-0950-5459-b46a-d21495b53475', 'current_year_diff': 8, 'age_in_months': 90, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 88256}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 90,
     'auction_title': '',
     'c_o_2_emission_value': 112,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:58:46z',
     'fuel_type': 'petrol',
     'id': '89a4ea5a-0950-5459-b46a-d21495b53475',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nm72906',
     'listing': 'auction',
     'location': 'fr, la chapelle longueville',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 88256,
     'odometer_in_km': 88256,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-07-08',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 e-thp style',
     'transmission': 'manual',
     'trim': 'style',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:58:46Z',
 'fuel_type': 'petrol',
 'id': '89a4ea5a-0950-5459-b46a-d21495b53475',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM72906',
 'listing': 'auction',
 'location': 'FR, LA CHAPELLE LONGUEVILLE',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 88256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 e-THP Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2018}
2026-01-29 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NM72906%27 HTTP/1.1" 200 None
2026-01-29 06:04:20 [auto1.fr] INFO: Saving data for NM72906: {'auction_closing_time': 1769705926.0, 'created_time': 1769534094.589302, 'last_price_update_time': 1769666660.35713}
2026-01-29 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NM72906') HTTP/1.1" 204 0
2026-01-29 06:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 46f993e6-4763-523d-89fd-68ba6a840471 with identifier: WD38934
2026-01-29 06:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 46f993e6-4763-523d-89fd-68ba6a840471 with identifier: WD38934
2026-01-29 06:04:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 46f993e6-4763-523d-89fd-68ba6a840471 with identifier: WD38934 to the API
2026-01-29 06:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:04:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:04:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WD38934>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:56:00Z',
 'fuel_type': 'gas',
 'id': '46f993e6-4763-523d-89fd-68ba6a840471',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD38934',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Dacia',
 'model': 'Jogger',
 'odometer': 28766,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-09-13',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Dacia Jogger 1.0 TCe LPG Extreme',
 'transmission': 'manual',
 'trim': 'Extreme',
 'year': 2023}
2026-01-29 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD38934%27 HTTP/1.1" 200 None
2026-01-29 06:04:20 [auto1.fr] INFO: Saving data for WD38934: {'auction_closing_time': 1769705760.0, 'created_time': 1769534135.453342, 'last_price_update_time': 1769666660.696692}
2026-01-29 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WD38934') HTTP/1.1" 204 0
2026-01-29 06:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_519c432fa8d5867386bb79309de0a1f6.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_86b1f430b6a4a283c3f919c1a2441ddc.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZB17169> (referer: https://www.auto1.com/v1/car-details-view/ZB17169/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_0e22f8440fa54c741637f3f4854fcab4.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:04:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b769d60-340c-5ab2-8f5a-c5ac8e28ec3d with identifier: KU11817
2026-01-29 06:04:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b769d60-340c-5ab2-8f5a-c5ac8e28ec3d with scrape type 2
2026-01-29 06:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b769d60-340c-5ab2-8f5a-c5ac8e28ec3d with scrape type 2
2026-01-29 06:04:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6b769d60-340c-5ab2-8f5a-c5ac8e28ec3d, identifier: KU11817
2026-01-29 06:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6b769d60-340c-5ab2-8f5a-c5ac8e28ec3d with identifier: KU11817
2026-01-29 06:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6b769d60-340c-5ab2-8f5a-c5ac8e28ec3d with identifier: KU11817
2026-01-29 06:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 mild-hybrid 136 allure pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 62014, 'odometer_reading_unit': 'km', 'registration_date': '2024-04-08', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ku11817', 'expiration_date': '2026-01-29t16:28:22z', 'origin_country_code': 'fr', 'trim': '136 allure pack', 'year': 2024, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 136, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '6b769d60-340c-5ab2-8f5a-c5ac8e28ec3d', 'current_year_diff': 2, 'age_in_months': 21, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 62014}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 21,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 136,
     'expiration_date': '2026-01-29t16:28:22z',
     'fuel_type': 'petrol',
     'id': '6b769d60-340c-5ab2-8f5a-c5ac8e28ec3d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ku11817',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 62014,
     'odometer_in_km': 62014,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2024-04-08',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 mild-hybrid 136 allure pack',
     'transmission': 'automatic',
     'trim': '136 allure pack',
     'year': 2024}
2026-01-29 06:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 6b769d60-340c-5ab2-8f5a-c5ac8e28ec3d spider: auto1.fr
2026-01-29 06:04:21 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 6b769d60-340c-5ab2-8f5a-c5ac8e28ec3d due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 mild-hybrid 136 allure pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 62014, 'odometer_reading_unit': 'km', 'registration_date': '2024-04-08', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ku11817', 'expiration_date': '2026-01-29t16:28:22z', 'origin_country_code': 'fr', 'trim': '136 allure pack', 'year': 2024, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 136, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '6b769d60-340c-5ab2-8f5a-c5ac8e28ec3d', 'current_year_diff': 2, 'age_in_months': 21, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 62014}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 21,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 136,
     'expiration_date': '2026-01-29t16:28:22z',
     'fuel_type': 'petrol',
     'id': '6b769d60-340c-5ab2-8f5a-c5ac8e28ec3d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ku11817',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 62014,
     'odometer_in_km': 62014,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2024-04-08',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 mild-hybrid 136 allure pack',
     'transmission': 'automatic',
     'trim': '136 allure pack',
     'year': 2024}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:28:22Z',
 'fuel_type': 'petrol',
 'id': '6b769d60-340c-5ab2-8f5a-c5ac8e28ec3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU11817',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 62014,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-04-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 Mild-Hybrid 136 Allure Pack',
 'transmission': 'automatic',
 'trim': '136 Allure Pack',
 'year': 2024}
2026-01-29 06:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KU11817%27 HTTP/1.1" 200 None
2026-01-29 06:04:21 [auto1.fr] INFO: Saving data for KU11817: {'auction_closing_time': 1769704102.0, 'created_time': 1769533753.268933, 'last_price_update_time': 1769666661.090429}
2026-01-29 06:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KU11817') HTTP/1.1" 204 0
2026-01-29 06:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_62eb0d2fdf3d2a58bad6d8b3a9c3ff1d.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_3dddb8f2a5236b2f779fd1d1356f0a79.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_76a05c29028b83677ed87507ce7f7326.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f3bebd0>
2026-01-29 06:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e568ace-8955-5943-a54f-3b2b5d255c28/9e568ace-8955-5943-a54f-3b2b5d255c28_image_11.jpg HTTP/1.1" 201 0
2026-01-29 06:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2a%252F3d2a4f42266c8b5b8dba15df9facba85%252Fpa%252FMF46010_519c432fa8d5867386bb79309de0a1f6.jpg') HTTP/1.1" 204 0
2026-01-29 06:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_519c432fa8d5867386bb79309de0a1f6.jpg saved to cache
2026-01-29 06:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 9e568ace-8955-5943-a54f-3b2b5d255c28
2026-01-29 06:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f5d1750>
2026-01-29 06:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d7ca5a-8f66-565e-928c-b5ea65a557cd/e2d7ca5a-8f66-565e-928c-b5ea65a557cd_image_11.jpg HTTP/1.1" 201 0
2026-01-29 06:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F14%252Fef14cf0fc3f2d791fabb0a331665f04c%252Fpa%252FXA49145_86b1f430b6a4a283c3f919c1a2441ddc.jpg') HTTP/1.1" 204 0
2026-01-29 06:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_86b1f430b6a4a283c3f919c1a2441ddc.jpg saved to cache
2026-01-29 06:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e2d7ca5a-8f66-565e-928c-b5ea65a557cd
2026-01-29 06:04:21 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:04:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68734405-bc24-5399-8202-8e263153719a with identifier: ZB17169
2026-01-29 06:04:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68734405-bc24-5399-8202-8e263153719a with scrape type 2
2026-01-29 06:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68734405-bc24-5399-8202-8e263153719a with scrape type 2
2026-01-29 06:04:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 68734405-bc24-5399-8202-8e263153719a, identifier: ZB17169
2026-01-29 06:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f3bf450>
2026-01-29 06:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:04:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e568ace-8955-5943-a54f-3b2b5d255c28/9e568ace-8955-5943-a54f-3b2b5d255c28_image_10.jpg HTTP/1.1" 201 0
2026-01-29 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2a%252F3d2a4f42266c8b5b8dba15df9facba85%252Fpa%252FMF46010_0e22f8440fa54c741637f3f4854fcab4.jpg') HTTP/1.1" 204 0
2026-01-29 06:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_0e22f8440fa54c741637f3f4854fcab4.jpg saved to cache
2026-01-29 06:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9e568ace-8955-5943-a54f-3b2b5d255c28
2026-01-29 06:04:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 68734405-bc24-5399-8202-8e263153719a with identifier: ZB17169
2026-01-29 06:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 68734405-bc24-5399-8202-8e263153719a with identifier: ZB17169
2026-01-29 06:04:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 68734405-bc24-5399-8202-8e263153719a with identifier: ZB17169 to the API
2026-01-29 06:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:04:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:04:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZB17169>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:36:14Z',
 'fuel_type': 'petrol',
 'id': '68734405-bc24-5399-8202-8e263153719a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB17169',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 85503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q2 35 TFSI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2020}
2026-01-29 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZB17169%27 HTTP/1.1" 200 None
2026-01-29 06:04:22 [auto1.fr] INFO: Saving data for ZB17169: {'auction_closing_time': 1769704574.0, 'created_time': 1769533624.088888, 'last_price_update_time': 1769666662.460201}
2026-01-29 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZB17169') HTTP/1.1" 204 0
2026-01-29 06:04:22 [auto1.fr] INFO: Found listing with ID: LG70683
2026-01-29 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LG70683%27 HTTP/1.1" 200 None
2026-01-29 06:04:22 [auto1.fr] INFO: Scrape type for LG70683: 0
2026-01-29 06:04:22 [auto1.fr] INFO: Found listing with ID: ZK61192
2026-01-29 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZK61192%27 HTTP/1.1" 200 None
2026-01-29 06:04:22 [auto1.fr] INFO: Scrape type for ZK61192: 2
2026-01-29 06:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_3cb8c49d815278b6c479b8fa9a391d1f.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_03e5d8837cc705e1f662ae2590754492.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EJ76169> (referer: https://www.auto1.com/v1/car-details-view/EJ76169/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SJ18122> (referer: https://www.auto1.com/v1/car-details-view/SJ18122/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HW54822/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UM56564/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HC62658/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JY47910> (referer: https://www.auto1.com/v1/car-details-view/JY47910/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:04:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f4d4810>
2026-01-29 06:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:04:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e568ace-8955-5943-a54f-3b2b5d255c28/9e568ace-8955-5943-a54f-3b2b5d255c28_image_9.jpg HTTP/1.1" 201 0
2026-01-29 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2a%252F3d2a4f42266c8b5b8dba15df9facba85%252Fpa%252FMF46010_62eb0d2fdf3d2a58bad6d8b3a9c3ff1d.jpg') HTTP/1.1" 204 0
2026-01-29 06:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_62eb0d2fdf3d2a58bad6d8b3a9c3ff1d.jpg saved to cache
2026-01-29 06:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9e568ace-8955-5943-a54f-3b2b5d255c28
2026-01-29 06:04:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:04:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c271810>
2026-01-29 06:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d7ca5a-8f66-565e-928c-b5ea65a557cd/e2d7ca5a-8f66-565e-928c-b5ea65a557cd_image_10.jpg HTTP/1.1" 201 0
2026-01-29 06:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F14%252Fef14cf0fc3f2d791fabb0a331665f04c%252Fpa%252FXA49145_3dddb8f2a5236b2f779fd1d1356f0a79.jpg') HTTP/1.1" 204 0
2026-01-29 06:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_3dddb8f2a5236b2f779fd1d1356f0a79.jpg saved to cache
2026-01-29 06:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e2d7ca5a-8f66-565e-928c-b5ea65a557cd
2026-01-29 06:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c270590>
2026-01-29 06:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d7ca5a-8f66-565e-928c-b5ea65a557cd/e2d7ca5a-8f66-565e-928c-b5ea65a557cd_image_9.jpg HTTP/1.1" 201 0
2026-01-29 06:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F14%252Fef14cf0fc3f2d791fabb0a331665f04c%252Fpa%252FXA49145_76a05c29028b83677ed87507ce7f7326.jpg') HTTP/1.1" 204 0
2026-01-29 06:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_76a05c29028b83677ed87507ce7f7326.jpg saved to cache
2026-01-29 06:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e2d7ca5a-8f66-565e-928c-b5ea65a557cd
2026-01-29 06:04:23 [auto1.fr] INFO: Found listing with ID: GZ40091
2026-01-29 06:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GZ40091%27 HTTP/1.1" 200 None
2026-01-29 06:04:23 [auto1.fr] INFO: Scrape type for GZ40091: 0
2026-01-29 06:04:23 [auto1.fr] INFO: Found listing with ID: GT56276
2026-01-29 06:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GT56276%27 HTTP/1.1" 200 None
2026-01-29 06:04:23 [auto1.fr] INFO: Scrape type for GT56276: 2
2026-01-29 06:04:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:23 [auto1.fr] INFO: Found listing with ID: LP71945
2026-01-29 06:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LP71945%27 HTTP/1.1" 200 None
2026-01-29 06:04:23 [auto1.fr] INFO: Scrape type for LP71945: 2
2026-01-29 06:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XU26131/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GN42324> (referer: https://www.auto1.com/v1/car-details-view/GN42324/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c29ad10>
2026-01-29 06:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e568ace-8955-5943-a54f-3b2b5d255c28/9e568ace-8955-5943-a54f-3b2b5d255c28_image_7.jpg HTTP/1.1" 201 0
2026-01-29 06:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F2a%252F3d2a4f42266c8b5b8dba15df9facba85%252Fpa%252FMF46010_3cb8c49d815278b6c479b8fa9a391d1f.jpg') HTTP/1.1" 204 0
2026-01-29 06:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_3cb8c49d815278b6c479b8fa9a391d1f.jpg saved to cache
2026-01-29 06:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9e568ace-8955-5943-a54f-3b2b5d255c28
2026-01-29 06:04:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9e568ace-8955-5943-a54f-3b2b5d255c28, skipping ID generation
2026-01-29 06:04:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e568ace-8955-5943-a54f-3b2b5d255c28 with scrape type 1
2026-01-29 06:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9e568ace-8955-5943-a54f-3b2b5d255c28 from tracking dictionaries
2026-01-29 06:04:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e568ace-8955-5943-a54f-3b2b5d255c28 sending to next pipeline
2026-01-29 06:04:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9e568ace-8955-5943-a54f-3b2b5d255c28, identifier: MF46010
2026-01-29 06:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6fe5d0d0>
2026-01-29 06:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d7ca5a-8f66-565e-928c-b5ea65a557cd/e2d7ca5a-8f66-565e-928c-b5ea65a557cd_image_7.jpg HTTP/1.1" 201 0
2026-01-29 06:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F14%252Fef14cf0fc3f2d791fabb0a331665f04c%252Fpa%252FXA49145_03e5d8837cc705e1f662ae2590754492.jpg') HTTP/1.1" 204 0
2026-01-29 06:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_03e5d8837cc705e1f662ae2590754492.jpg saved to cache
2026-01-29 06:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e2d7ca5a-8f66-565e-928c-b5ea65a557cd
2026-01-29 06:04:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2d7ca5a-8f66-565e-928c-b5ea65a557cd, skipping ID generation
2026-01-29 06:04:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2d7ca5a-8f66-565e-928c-b5ea65a557cd with scrape type 1
2026-01-29 06:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e2d7ca5a-8f66-565e-928c-b5ea65a557cd from tracking dictionaries
2026-01-29 06:04:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e2d7ca5a-8f66-565e-928c-b5ea65a557cd sending to next pipeline
2026-01-29 06:04:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e2d7ca5a-8f66-565e-928c-b5ea65a557cd, identifier: XA49145
2026-01-29 06:04:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0523cdf8-bb9c-569e-b1a8-d3b9f4ea2b5f with identifier: EJ76169
2026-01-29 06:04:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0523cdf8-bb9c-569e-b1a8-d3b9f4ea2b5f with scrape type 2
2026-01-29 06:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0523cdf8-bb9c-569e-b1a8-d3b9f4ea2b5f with scrape type 2
2026-01-29 06:04:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0523cdf8-bb9c-569e-b1a8-d3b9f4ea2b5f, identifier: EJ76169
2026-01-29 06:04:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c3de2dd-521a-53c3-aa5e-38c315836edf with identifier: SJ18122
2026-01-29 06:04:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c3de2dd-521a-53c3-aa5e-38c315836edf with scrape type 2
2026-01-29 06:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c3de2dd-521a-53c3-aa5e-38c315836edf with scrape type 2
2026-01-29 06:04:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6c3de2dd-521a-53c3-aa5e-38c315836edf, identifier: SJ18122
2026-01-29 06:04:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea70fa9c-18d1-5a98-86db-7a5dc40ff23a with identifier: JY47910
2026-01-29 06:04:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea70fa9c-18d1-5a98-86db-7a5dc40ff23a with scrape type 2
2026-01-29 06:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea70fa9c-18d1-5a98-86db-7a5dc40ff23a with scrape type 2
2026-01-29 06:04:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ea70fa9c-18d1-5a98-86db-7a5dc40ff23a, identifier: JY47910
2026-01-29 06:04:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9e568ace-8955-5943-a54f-3b2b5d255c28 with identifier: MF46010
2026-01-29 06:04:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9e568ace-8955-5943-a54f-3b2b5d255c28 with identifier: MF46010
2026-01-29 06:04:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9e568ace-8955-5943-a54f-3b2b5d255c28 with identifier: MF46010 to the API
2026-01-29 06:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:04:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:04:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_3cb8c49d815278b6c479b8fa9a391d1f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 306,
 'expiration_date': '2026-01-29T16:55:17Z',
 'fuel_type': 'petrol',
 'id': '9e568ace-8955-5943-a54f-3b2b5d255c28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF46010',
 'listing': 'auction',
 'location': 'FR, Saint Brieuc',
 'make': 'BMW',
 'model': '2er',
 'odometer': 66500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e568ace-8955-5943-a54f-3b2b5d255c28/9e568ace-8955-5943-a54f-3b2b5d255c28_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_e72a07a73f7d821f7f56b832adbcd0a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e568ace-8955-5943-a54f-3b2b5d255c28/9e568ace-8955-5943-a54f-3b2b5d255c28_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_b62285ce2d95449417e776af84c40156.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e568ace-8955-5943-a54f-3b2b5d255c28/9e568ace-8955-5943-a54f-3b2b5d255c28_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_c7c249d5587e8cc1ff2c7ab22230c525.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e568ace-8955-5943-a54f-3b2b5d255c28/9e568ace-8955-5943-a54f-3b2b5d255c28_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_ddc5cd22f08e7f5c405b47eb07b3553b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e568ace-8955-5943-a54f-3b2b5d255c28/9e568ace-8955-5943-a54f-3b2b5d255c28_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_f223c3135803b9eef571d54d06b95ac9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e568ace-8955-5943-a54f-3b2b5d255c28/9e568ace-8955-5943-a54f-3b2b5d255c28_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_52a8d5cb4f1b3b526a4319aae4fc9595.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e568ace-8955-5943-a54f-3b2b5d255c28/9e568ace-8955-5943-a54f-3b2b5d255c28_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_defb133bf5db620f85f2b32f2ff64d2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e568ace-8955-5943-a54f-3b2b5d255c28/9e568ace-8955-5943-a54f-3b2b5d255c28_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_3cb8c49d815278b6c479b8fa9a391d1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e568ace-8955-5943-a54f-3b2b5d255c28/9e568ace-8955-5943-a54f-3b2b5d255c28_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67882,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_8a564e8148769b8c8d62edd0e7bd7b63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e568ace-8955-5943-a54f-3b2b5d255c28/9e568ace-8955-5943-a54f-3b2b5d255c28_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64658,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_62eb0d2fdf3d2a58bad6d8b3a9c3ff1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e568ace-8955-5943-a54f-3b2b5d255c28/9e568ace-8955-5943-a54f-3b2b5d255c28_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_0e22f8440fa54c741637f3f4854fcab4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e568ace-8955-5943-a54f-3b2b5d255c28/9e568ace-8955-5943-a54f-3b2b5d255c28_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_519c432fa8d5867386bb79309de0a1f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e568ace-8955-5943-a54f-3b2b5d255c28/9e568ace-8955-5943-a54f-3b2b5d255c28_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_1f836c2e1e0e435ca0e5e3006eb501f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e568ace-8955-5943-a54f-3b2b5d255c28/9e568ace-8955-5943-a54f-3b2b5d255c28_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52189,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_520cb2abd9626027f59360b7e46d5b23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e568ace-8955-5943-a54f-3b2b5d255c28/9e568ace-8955-5943-a54f-3b2b5d255c28_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_922f4d90c87fe863ebc2b4bf499f2f55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e568ace-8955-5943-a54f-3b2b5d255c28/9e568ace-8955-5943-a54f-3b2b5d255c28_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/2a/3d2a4f42266c8b5b8dba15df9facba85/pa/MF46010_f8a29b9462179dd5b88d0c4d78eaa299.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2er M235i Gran Coupe xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2020}
2026-01-29 06:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MF46010%27 HTTP/1.1" 200 None
2026-01-29 06:04:24 [auto1.fr] INFO: Saving data for MF46010: {'created_time': 1769666664.876883, 'last_price_update_time': 1769666664.876892, 'auction_closing_time': 1769705717.0}
2026-01-29 06:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MF46010') HTTP/1.1" 204 0
2026-01-29 06:04:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e2d7ca5a-8f66-565e-928c-b5ea65a557cd with identifier: XA49145
2026-01-29 06:04:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e2d7ca5a-8f66-565e-928c-b5ea65a557cd with identifier: XA49145
2026-01-29 06:04:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e2d7ca5a-8f66-565e-928c-b5ea65a557cd with identifier: XA49145 to the API
2026-01-29 06:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:04:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:04:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_03e5d8837cc705e1f662ae2590754492.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:02:48Z',
 'fuel_type': 'diesel',
 'id': 'e2d7ca5a-8f66-565e-928c-b5ea65a557cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA49145',
 'listing': 'auction',
 'location': 'FR, Cholet',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 95851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d7ca5a-8f66-565e-928c-b5ea65a557cd/e2d7ca5a-8f66-565e-928c-b5ea65a557cd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_9268d966b3de663fa68a9a4958e6e39b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d7ca5a-8f66-565e-928c-b5ea65a557cd/e2d7ca5a-8f66-565e-928c-b5ea65a557cd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61078,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_410bbcf532d8d19122275f8435c81af5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d7ca5a-8f66-565e-928c-b5ea65a557cd/e2d7ca5a-8f66-565e-928c-b5ea65a557cd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_d4f7fe2aafa1a9bc7e3014632a0753ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d7ca5a-8f66-565e-928c-b5ea65a557cd/e2d7ca5a-8f66-565e-928c-b5ea65a557cd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46266,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_d34abb4d2b7aa5342a5a780723e26573.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d7ca5a-8f66-565e-928c-b5ea65a557cd/e2d7ca5a-8f66-565e-928c-b5ea65a557cd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_c0b7ceece9aac2b78e686144a0aad9ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d7ca5a-8f66-565e-928c-b5ea65a557cd/e2d7ca5a-8f66-565e-928c-b5ea65a557cd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_93c4653078ac23193363fa36b3920182.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d7ca5a-8f66-565e-928c-b5ea65a557cd/e2d7ca5a-8f66-565e-928c-b5ea65a557cd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58712,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_65e8ac6b29f8e599cb744c570bb0cc82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d7ca5a-8f66-565e-928c-b5ea65a557cd/e2d7ca5a-8f66-565e-928c-b5ea65a557cd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64877,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_03e5d8837cc705e1f662ae2590754492.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d7ca5a-8f66-565e-928c-b5ea65a557cd/e2d7ca5a-8f66-565e-928c-b5ea65a557cd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_436c8bc78a6fd84a98f8e171532d8f35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d7ca5a-8f66-565e-928c-b5ea65a557cd/e2d7ca5a-8f66-565e-928c-b5ea65a557cd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54396,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_76a05c29028b83677ed87507ce7f7326.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d7ca5a-8f66-565e-928c-b5ea65a557cd/e2d7ca5a-8f66-565e-928c-b5ea65a557cd_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_3dddb8f2a5236b2f779fd1d1356f0a79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d7ca5a-8f66-565e-928c-b5ea65a557cd/e2d7ca5a-8f66-565e-928c-b5ea65a557cd_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_86b1f430b6a4a283c3f919c1a2441ddc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d7ca5a-8f66-565e-928c-b5ea65a557cd/e2d7ca5a-8f66-565e-928c-b5ea65a557cd_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_3df9134a3d2421768f875904d01cc6e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d7ca5a-8f66-565e-928c-b5ea65a557cd/e2d7ca5a-8f66-565e-928c-b5ea65a557cd_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_0cb86aaf0ef5d0b8215090166b9249b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d7ca5a-8f66-565e-928c-b5ea65a557cd/e2d7ca5a-8f66-565e-928c-b5ea65a557cd_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87734,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_f4ec9fa6bb9ac10f24bfac06f64a4e4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d7ca5a-8f66-565e-928c-b5ea65a557cd/e2d7ca5a-8f66-565e-928c-b5ea65a557cd_image_15.png',
             'Extension': 'png',
             'FileSizeInBytes': 115588,
             'Height': 525,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/14/ef14cf0fc3f2d791fabb0a331665f04c/pa/XA49145_b002fad87fcbc027c037170b1f1e8863.png',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500X 1.6 JTDM City Cross',
 'transmission': 'manual',
 'trim': 'City Cross',
 'year': 2018}
2026-01-29 06:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XA49145%27 HTTP/1.1" 200 None
2026-01-29 06:04:25 [auto1.fr] INFO: Saving data for XA49145: {'created_time': 1769666665.330845, 'last_price_update_time': 1769666665.330857, 'auction_closing_time': 1769702568.0}
2026-01-29 06:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XA49145') HTTP/1.1" 204 0
2026-01-29 06:04:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0523cdf8-bb9c-569e-b1a8-d3b9f4ea2b5f with identifier: EJ76169
2026-01-29 06:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0523cdf8-bb9c-569e-b1a8-d3b9f4ea2b5f with identifier: EJ76169
2026-01-29 06:04:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0523cdf8-bb9c-569e-b1a8-d3b9f4ea2b5f with identifier: EJ76169 to the API
2026-01-29 06:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:04:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:04:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EJ76169>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:27:04Z',
 'fuel_type': 'diesel',
 'id': '0523cdf8-bb9c-569e-b1a8-d3b9f4ea2b5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ76169',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 81605,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2020}
2026-01-29 06:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EJ76169%27 HTTP/1.1" 200 None
2026-01-29 06:04:25 [auto1.fr] INFO: Saving data for EJ76169: {'auction_closing_time': 1769704024.0, 'created_time': 1769580126.709994, 'last_price_update_time': 1769666665.638769}
2026-01-29 06:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EJ76169') HTTP/1.1" 204 0
2026-01-29 06:04:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6c3de2dd-521a-53c3-aa5e-38c315836edf with identifier: SJ18122
2026-01-29 06:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6c3de2dd-521a-53c3-aa5e-38c315836edf with identifier: SJ18122
2026-01-29 06:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
2026-01-29 06:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 6c3de2dd-521a-53c3-aa5e-38c315836edf spider: auto1.fr
2026-01-29 06:04:25 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 6c3de2dd-521a-53c3-aa5e-38c315836edf due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:58:00Z',
 'fuel_type': 'diesel',
 'id': '6c3de2dd-521a-53c3-aa5e-38c315836edf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ18122',
 'listing': 'auction',
 'location': 'FR, Quincieux',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 194740,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-28',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Peugeot Expert 1.5 Blue-HDi Asphalt L2',
 'transmission': 'manual',
 'trim': 'Asphalt L2',
 'year': 2020}
2026-01-29 06:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SJ18122%27 HTTP/1.1" 200 None
2026-01-29 06:04:25 [auto1.fr] INFO: Saving data for SJ18122: {'auction_closing_time': 1769705880.0, 'created_time': 1768844248.675771, 'last_price_update_time': 1769666665.898674}
2026-01-29 06:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SJ18122') HTTP/1.1" 204 0
2026-01-29 06:04:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ea70fa9c-18d1-5a98-86db-7a5dc40ff23a with identifier: JY47910
2026-01-29 06:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ea70fa9c-18d1-5a98-86db-7a5dc40ff23a with identifier: JY47910
2026-01-29 06:04:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ea70fa9c-18d1-5a98-86db-7a5dc40ff23a with identifier: JY47910 to the API
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:04:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JY47910>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:12:02Z',
 'fuel_type': 'diesel',
 'id': 'ea70fa9c-18d1-5a98-86db-7a5dc40ff23a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY47910',
 'listing': 'auction',
 'location': 'FR, Nanteuil-le-Haudouin',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 124143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 220 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JY47910%27 HTTP/1.1" 200 None
2026-01-29 06:04:26 [auto1.fr] INFO: Saving data for JY47910: {'auction_closing_time': 1769703122.0, 'created_time': 1769580137.492705, 'last_price_update_time': 1769666666.199038}
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JY47910') HTTP/1.1" 204 0
2026-01-29 06:04:26 [auto1.fr] INFO: Found listing with ID: TS23838
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TS23838%27 HTTP/1.1" 200 None
2026-01-29 06:04:26 [auto1.fr] INFO: Scrape type for TS23838: 0
2026-01-29 06:04:26 [auto1.fr] INFO: Found listing with ID: FR59824
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FR59824%27 HTTP/1.1" 200 None
2026-01-29 06:04:26 [auto1.fr] INFO: Scrape type for FR59824: 0
2026-01-29 06:04:26 [auto1.fr] INFO: Found listing with ID: TX71256
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TX71256%27 HTTP/1.1" 200 None
2026-01-29 06:04:26 [auto1.fr] INFO: Scrape type for TX71256: 2
2026-01-29 06:04:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ded8663-1b24-5e2f-af96-c03b119d9d65 with identifier: GN42324
2026-01-29 06:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ded8663-1b24-5e2f-af96-c03b119d9d65 with scrape type 2
2026-01-29 06:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ded8663-1b24-5e2f-af96-c03b119d9d65 with scrape type 2
2026-01-29 06:04:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1ded8663-1b24-5e2f-af96-c03b119d9d65, identifier: GN42324
2026-01-29 06:04:26 [auto1.fr] INFO: Found listing with ID: ZR28348
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZR28348%27 HTTP/1.1" 200 None
2026-01-29 06:04:26 [auto1.fr] INFO: Scrape type for ZR28348: 2
2026-01-29 06:04:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1ded8663-1b24-5e2f-af96-c03b119d9d65 with identifier: GN42324
2026-01-29 06:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1ded8663-1b24-5e2f-af96-c03b119d9d65 with identifier: GN42324
2026-01-29 06:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 164932 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164932
2026-01-29 06:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 1ded8663-1b24-5e2f-af96-c03b119d9d65 spider: auto1.fr
2026-01-29 06:04:26 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 1ded8663-1b24-5e2f-af96-c03b119d9d65 due to rule: high_mileage_for_country.json, error: 164932 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164932
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:01:45Z',
 'fuel_type': 'diesel',
 'id': '1ded8663-1b24-5e2f-af96-c03b119d9d65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN42324',
 'listing': 'auction',
 'location': 'FR, Villeneuve-lès-Béziers',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 164932,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-27',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Blue-HDi Premium Pack',
 'transmission': 'manual',
 'trim': 'Premium Pack',
 'year': 2017}
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN42324%27 HTTP/1.1" 200 None
2026-01-29 06:04:26 [auto1.fr] INFO: Saving data for GN42324: {'auction_closing_time': 1769702505.0, 'created_time': 1769533508.228909, 'last_price_update_time': 1769666666.586602}
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GN42324') HTTP/1.1" 204 0
2026-01-29 06:04:26 [auto1.fr] INFO: Found listing with ID: FJ10816
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ10816%27 HTTP/1.1" 200 None
2026-01-29 06:04:26 [auto1.fr] INFO: Scrape type for FJ10816: 2
2026-01-29 06:04:26 [auto1.fr] INFO: Found listing with ID: VY82915
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VY82915%27 HTTP/1.1" 200 None
2026-01-29 06:04:26 [auto1.fr] INFO: Scrape type for VY82915: 0
2026-01-29 06:04:26 [auto1.fr] INFO: Found listing with ID: PX96099
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX96099%27 HTTP/1.1" 200 None
2026-01-29 06:04:26 [auto1.fr] INFO: Scrape type for PX96099: 0
2026-01-29 06:04:26 [auto1.fr] INFO: Found listing with ID: TH98710
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TH98710%27 HTTP/1.1" 200 None
2026-01-29 06:04:26 [auto1.fr] INFO: Scrape type for TH98710: 0
2026-01-29 06:04:26 [auto1.fr] INFO: Found listing with ID: FK02907
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FK02907%27 HTTP/1.1" 200 None
2026-01-29 06:04:26 [auto1.fr] INFO: Scrape type for FK02907: 0
2026-01-29 06:04:26 [auto1.fr] INFO: Found listing with ID: TW73591
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TW73591%27 HTTP/1.1" 200 None
2026-01-29 06:04:26 [auto1.fr] INFO: Scrape type for TW73591: 2
2026-01-29 06:04:26 [auto1.fr] INFO: Found listing with ID: LL77312
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LL77312%27 HTTP/1.1" 200 None
2026-01-29 06:04:26 [auto1.fr] INFO: Scrape type for LL77312: 2
2026-01-29 06:04:26 [auto1.fr] INFO: Found listing with ID: JJ45702
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ45702%27 HTTP/1.1" 200 None
2026-01-29 06:04:26 [auto1.fr] INFO: Scrape type for JJ45702: 2
2026-01-29 06:04:26 [auto1.fr] INFO: Found listing with ID: CX82590
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CX82590%27 HTTP/1.1" 200 None
2026-01-29 06:04:26 [auto1.fr] INFO: Scrape type for CX82590: 2
2026-01-29 06:04:26 [auto1.fr] INFO: Found listing with ID: HV54747
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HV54747%27 HTTP/1.1" 200 None
2026-01-29 06:04:26 [auto1.fr] INFO: Scrape type for HV54747: 0
2026-01-29 06:04:26 [auto1.fr] INFO: Found listing with ID: JU93355
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JU93355%27 HTTP/1.1" 200 None
2026-01-29 06:04:26 [auto1.fr] INFO: Scrape type for JU93355: 2
2026-01-29 06:04:26 [auto1.fr] INFO: Found listing with ID: KV24028
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV24028%27 HTTP/1.1" 200 None
2026-01-29 06:04:26 [auto1.fr] INFO: Scrape type for KV24028: 2
2026-01-29 06:04:26 [auto1.fr] INFO: Found listing with ID: PE11192
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PE11192%27 HTTP/1.1" 200 None
2026-01-29 06:04:26 [auto1.fr] INFO: Scrape type for PE11192: 0
2026-01-29 06:04:26 [auto1.fr] INFO: Found listing with ID: EF97126
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF97126%27 HTTP/1.1" 200 None
2026-01-29 06:04:26 [auto1.fr] INFO: Scrape type for EF97126: 0
2026-01-29 06:04:26 [auto1.fr] INFO: Found listing with ID: BK42255
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BK42255%27 HTTP/1.1" 200 None
2026-01-29 06:04:26 [auto1.fr] INFO: Scrape type for BK42255: 2
2026-01-29 06:04:26 [auto1.fr] INFO: Found listing with ID: JT65923
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JT65923%27 HTTP/1.1" 200 None
2026-01-29 06:04:26 [auto1.fr] INFO: Scrape type for JT65923: 0
2026-01-29 06:04:26 [auto1.fr] INFO: Found listing with ID: TE65186
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TE65186%27 HTTP/1.1" 200 None
2026-01-29 06:04:27 [auto1.fr] INFO: Scrape type for TE65186: 0
2026-01-29 06:04:27 [auto1.fr] INFO: Found listing with ID: NL71749
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NL71749%27 HTTP/1.1" 200 None
2026-01-29 06:04:27 [auto1.fr] INFO: Scrape type for NL71749: 2
2026-01-29 06:04:27 [auto1.fr] INFO: Found listing with ID: DU31055
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DU31055%27 HTTP/1.1" 200 None
2026-01-29 06:04:27 [auto1.fr] INFO: Scrape type for DU31055: 2
2026-01-29 06:04:27 [auto1.fr] INFO: Found listing with ID: BV52926
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BV52926%27 HTTP/1.1" 200 None
2026-01-29 06:04:27 [auto1.fr] INFO: Scrape type for BV52926: 0
2026-01-29 06:04:27 [auto1.fr] INFO: Found listing with ID: RW68562
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RW68562%27 HTTP/1.1" 200 None
2026-01-29 06:04:27 [auto1.fr] INFO: Scrape type for RW68562: 0
2026-01-29 06:04:27 [auto1.fr] INFO: Found listing with ID: HE04705
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HE04705%27 HTTP/1.1" 200 None
2026-01-29 06:04:27 [auto1.fr] INFO: Scrape type for HE04705: 0
2026-01-29 06:04:27 [auto1.fr] INFO: Found listing with ID: KB26391
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KB26391%27 HTTP/1.1" 200 None
2026-01-29 06:04:27 [auto1.fr] INFO: Scrape type for KB26391: 2
2026-01-29 06:04:27 [auto1.fr] INFO: Found listing with ID: UX54455
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UX54455%27 HTTP/1.1" 200 None
2026-01-29 06:04:27 [auto1.fr] INFO: Scrape type for UX54455: 0
2026-01-29 06:04:27 [auto1.fr] INFO: Found listing with ID: ZU64067
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZU64067%27 HTTP/1.1" 200 None
2026-01-29 06:04:27 [auto1.fr] INFO: Scrape type for ZU64067: 0
2026-01-29 06:04:27 [auto1.fr] INFO: Found listing with ID: UH12185
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UH12185%27 HTTP/1.1" 200 None
2026-01-29 06:04:27 [auto1.fr] INFO: Scrape type for UH12185: 2
2026-01-29 06:04:27 [auto1.fr] INFO: Found listing with ID: BY93625
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BY93625%27 HTTP/1.1" 200 None
2026-01-29 06:04:27 [auto1.fr] INFO: Scrape type for BY93625: 2
2026-01-29 06:04:27 [auto1.fr] INFO: Found listing with ID: CB05708
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CB05708%27 HTTP/1.1" 200 None
2026-01-29 06:04:27 [auto1.fr] INFO: Scrape type for CB05708: 2
2026-01-29 06:04:27 [auto1.fr] INFO: Found listing with ID: AU99102
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AU99102%27 HTTP/1.1" 200 None
2026-01-29 06:04:27 [auto1.fr] INFO: Scrape type for AU99102: 2
2026-01-29 06:04:27 [auto1.fr] INFO: Found listing with ID: LW18978
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LW18978%27 HTTP/1.1" 200 None
2026-01-29 06:04:27 [auto1.fr] INFO: Scrape type for LW18978: 2
2026-01-29 06:04:27 [auto1.fr] INFO: Found listing with ID: TF44474
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TF44474%27 HTTP/1.1" 200 None
2026-01-29 06:04:27 [auto1.fr] INFO: Scrape type for TF44474: 2
2026-01-29 06:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JD70507/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZK61192/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YY09741> (referer: https://www.auto1.com/v1/car-details-view/YY09741/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FK82779/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NT78881/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TZ78774> (referer: https://www.auto1.com/v1/car-details-view/TZ78774/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:27 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:04:27 [auto1.fr] INFO: Found listing with ID: YT22653
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YT22653%27 HTTP/1.1" 200 None
2026-01-29 06:04:27 [auto1.fr] INFO: Scrape type for YT22653: 2
2026-01-29 06:04:27 [auto1.fr] INFO: Found listing with ID: AV14620
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV14620%27 HTTP/1.1" 200 None
2026-01-29 06:04:27 [auto1.fr] INFO: Scrape type for AV14620: 2
2026-01-29 06:04:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87e01005-f846-58a3-b440-9a18faa67e89 with identifier: YY09741
2026-01-29 06:04:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87e01005-f846-58a3-b440-9a18faa67e89 with scrape type 2
2026-01-29 06:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87e01005-f846-58a3-b440-9a18faa67e89 with scrape type 2
2026-01-29 06:04:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 87e01005-f846-58a3-b440-9a18faa67e89, identifier: YY09741
2026-01-29 06:04:27 [auto1.fr] INFO: Found listing with ID: BL08452
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BL08452%27 HTTP/1.1" 200 None
2026-01-29 06:04:27 [auto1.fr] INFO: Scrape type for BL08452: 2
2026-01-29 06:04:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 87e01005-f846-58a3-b440-9a18faa67e89 with identifier: YY09741
2026-01-29 06:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 87e01005-f846-58a3-b440-9a18faa67e89 with identifier: YY09741
2026-01-29 06:04:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 87e01005-f846-58a3-b440-9a18faa67e89 with identifier: YY09741 to the API
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:04:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:04:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YY09741>
{'auction_title': '',
 'c_o_2_emission_value': 87,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'engine_horse_power': 122,
 'expiration_date': '2026-01-29T16:06:03Z',
 'fuel_type': 'hybrid',
 'id': '87e01005-f846-58a3-b440-9a18faa67e89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY09741',
 'listing': 'auction',
 'location': 'FR, Ambarès-et-Lagrave',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 142924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota C-HR 1.8 Hybrid Graphic',
 'transmission': 'automatic',
 'trim': 'Graphic',
 'year': 2018}
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YY09741%27 HTTP/1.1" 200 None
2026-01-29 06:04:28 [auto1.fr] INFO: Saving data for YY09741: {'auction_closing_time': 1769702763.0, 'created_time': 1769076081.42271, 'last_price_update_time': 1769666668.071769}
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YY09741') HTTP/1.1" 204 0
2026-01-29 06:04:28 [auto1.fr] INFO: Found listing with ID: KJ98759
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KJ98759%27 HTTP/1.1" 200 None
2026-01-29 06:04:28 [auto1.fr] INFO: Scrape type for KJ98759: 0
2026-01-29 06:04:28 [auto1.fr] INFO: Found listing with ID: UV79273
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UV79273%27 HTTP/1.1" 200 None
2026-01-29 06:04:28 [auto1.fr] INFO: Scrape type for UV79273: 0
2026-01-29 06:04:28 [auto1.fr] INFO: Found listing with ID: ZA23967
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZA23967%27 HTTP/1.1" 200 None
2026-01-29 06:04:28 [auto1.fr] INFO: Scrape type for ZA23967: 0
2026-01-29 06:04:28 [auto1.fr] INFO: Found listing with ID: PL21814
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PL21814%27 HTTP/1.1" 200 None
2026-01-29 06:04:28 [auto1.fr] INFO: Scrape type for PL21814: 0
2026-01-29 06:04:28 [auto1.fr] INFO: Found listing with ID: DK51210
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DK51210%27 HTTP/1.1" 200 None
2026-01-29 06:04:28 [auto1.fr] INFO: Scrape type for DK51210: 0
2026-01-29 06:04:28 [auto1.fr] INFO: Found listing with ID: KF46655
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KF46655%27 HTTP/1.1" 200 None
2026-01-29 06:04:28 [auto1.fr] INFO: Scrape type for KF46655: 0
2026-01-29 06:04:28 [auto1.fr] INFO: Found listing with ID: TL78459
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TL78459%27 HTTP/1.1" 200 None
2026-01-29 06:04:28 [auto1.fr] INFO: Scrape type for TL78459: 0
2026-01-29 06:04:28 [auto1.fr] INFO: Found listing with ID: NK15801
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK15801%27 HTTP/1.1" 200 None
2026-01-29 06:04:28 [auto1.fr] INFO: Scrape type for NK15801: 0
2026-01-29 06:04:28 [auto1.fr] INFO: Found listing with ID: ZV29924
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZV29924%27 HTTP/1.1" 200 None
2026-01-29 06:04:28 [auto1.fr] INFO: Scrape type for ZV29924: 0
2026-01-29 06:04:28 [auto1.fr] INFO: Found listing with ID: VG58569
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG58569%27 HTTP/1.1" 200 None
2026-01-29 06:04:28 [auto1.fr] INFO: Scrape type for VG58569: 2
2026-01-29 06:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RK40922/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GT56276/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e50a3ec-7457-5915-9a7f-79194ded66ec with identifier: TZ78774
2026-01-29 06:04:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e50a3ec-7457-5915-9a7f-79194ded66ec with scrape type 2
2026-01-29 06:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e50a3ec-7457-5915-9a7f-79194ded66ec with scrape type 2
2026-01-29 06:04:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4e50a3ec-7457-5915-9a7f-79194ded66ec, identifier: TZ78774
2026-01-29 06:04:28 [auto1.fr] INFO: Found listing with ID: EC25209
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EC25209%27 HTTP/1.1" 200 None
2026-01-29 06:04:28 [auto1.fr] INFO: Scrape type for EC25209: 0
2026-01-29 06:04:28 [auto1.fr] INFO: Found listing with ID: PK72949
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PK72949%27 HTTP/1.1" 200 None
2026-01-29 06:04:28 [auto1.fr] INFO: Scrape type for PK72949: 2
2026-01-29 06:04:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4e50a3ec-7457-5915-9a7f-79194ded66ec with identifier: TZ78774
2026-01-29 06:04:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4e50a3ec-7457-5915-9a7f-79194ded66ec with identifier: TZ78774
2026-01-29 06:04:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech active pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 25463, 'odometer_reading_unit': 'km', 'registration_date': '2022-10-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/tz78774', 'expiration_date': '2026-01-29t16:01:40z', 'origin_country_code': 'fr', 'trim': 'active pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, warluis', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '4e50a3ec-7457-5915-9a7f-79194ded66ec', 'current_year_diff': 4, 'age_in_months': 39, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 25463}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 39,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 75,
     'expiration_date': '2026-01-29t16:01:40z',
     'fuel_type': 'petrol',
     'id': '4e50a3ec-7457-5915-9a7f-79194ded66ec',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/tz78774',
     'listing': 'auction',
     'location': 'fr, warluis',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 25463,
     'odometer_in_km': 25463,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-10-23',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech active pack',
     'transmission': 'manual',
     'trim': 'active pack',
     'year': 2022}
2026-01-29 06:04:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 4e50a3ec-7457-5915-9a7f-79194ded66ec spider: auto1.fr
2026-01-29 06:04:28 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 4e50a3ec-7457-5915-9a7f-79194ded66ec due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech active pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 25463, 'odometer_reading_unit': 'km', 'registration_date': '2022-10-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/tz78774', 'expiration_date': '2026-01-29t16:01:40z', 'origin_country_code': 'fr', 'trim': 'active pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, warluis', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '4e50a3ec-7457-5915-9a7f-79194ded66ec', 'current_year_diff': 4, 'age_in_months': 39, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 25463}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 39,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 75,
     'expiration_date': '2026-01-29t16:01:40z',
     'fuel_type': 'petrol',
     'id': '4e50a3ec-7457-5915-9a7f-79194ded66ec',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/tz78774',
     'listing': 'auction',
     'location': 'fr, warluis',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 25463,
     'odometer_in_km': 25463,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-10-23',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech active pack',
     'transmission': 'manual',
     'trim': 'active pack',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:01:40Z',
 'fuel_type': 'petrol',
 'id': '4e50a3ec-7457-5915-9a7f-79194ded66ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ78774',
 'listing': 'auction',
 'location': 'FR, Warluis',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 25463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Active Pack',
 'transmission': 'manual',
 'trim': 'Active Pack',
 'year': 2022}
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TZ78774%27 HTTP/1.1" 200 None
2026-01-29 06:04:28 [auto1.fr] INFO: Saving data for TZ78774: {'auction_closing_time': 1769702500.0, 'created_time': 1768819213.32501, 'last_price_update_time': 1769666668.727929}
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TZ78774') HTTP/1.1" 204 0
2026-01-29 06:04:28 [auto1.fr] INFO: Found listing with ID: AF50767
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AF50767%27 HTTP/1.1" 200 None
2026-01-29 06:04:28 [auto1.fr] INFO: Scrape type for AF50767: 0
2026-01-29 06:04:28 [auto1.fr] INFO: Found listing with ID: FF39606
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FF39606%27 HTTP/1.1" 200 None
2026-01-29 06:04:28 [auto1.fr] INFO: Scrape type for FF39606: 0
2026-01-29 06:04:28 [auto1.fr] INFO: Found listing with ID: PM66724
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PM66724%27 HTTP/1.1" 200 None
2026-01-29 06:04:28 [auto1.fr] INFO: Scrape type for PM66724: 2
2026-01-29 06:04:28 [auto1.fr] INFO: Found listing with ID: HA77616
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HA77616%27 HTTP/1.1" 200 None
2026-01-29 06:04:28 [auto1.fr] INFO: Scrape type for HA77616: 2
2026-01-29 06:04:28 [auto1.fr] INFO: Found listing with ID: VE58160
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VE58160%27 HTTP/1.1" 200 None
2026-01-29 06:04:28 [auto1.fr] INFO: Scrape type for VE58160: 0
2026-01-29 06:04:28 [auto1.fr] INFO: Found listing with ID: FC62857
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FC62857%27 HTTP/1.1" 200 None
2026-01-29 06:04:28 [auto1.fr] INFO: Scrape type for FC62857: 2
2026-01-29 06:04:28 [auto1.fr] INFO: Found listing with ID: FE87788
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FE87788%27 HTTP/1.1" 200 None
2026-01-29 06:04:28 [auto1.fr] INFO: Scrape type for FE87788: 0
2026-01-29 06:04:28 [auto1.fr] INFO: Found listing with ID: AZ32044
2026-01-29 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AZ32044%27 HTTP/1.1" 200 None
2026-01-29 06:04:29 [auto1.fr] INFO: Scrape type for AZ32044: 0
2026-01-29 06:04:29 [auto1.fr] INFO: Found listing with ID: MT87682
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MT87682%27 HTTP/1.1" 200 None
2026-01-29 06:04:29 [auto1.fr] INFO: Scrape type for MT87682: 0
2026-01-29 06:04:29 [auto1.fr] INFO: Found listing with ID: GY54647
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GY54647%27 HTTP/1.1" 200 None
2026-01-29 06:04:29 [auto1.fr] INFO: Scrape type for GY54647: 2
2026-01-29 06:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LP71945/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:29 [auto1.fr] INFO: Found listing with ID: WV28469
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WV28469%27 HTTP/1.1" 200 None
2026-01-29 06:04:29 [auto1.fr] INFO: Scrape type for WV28469: 0
2026-01-29 06:04:29 [auto1.fr] INFO: Found listing with ID: PE53711
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PE53711%27 HTTP/1.1" 200 None
2026-01-29 06:04:29 [auto1.fr] INFO: Scrape type for PE53711: 0
2026-01-29 06:04:29 [auto1.fr] INFO: Found listing with ID: SG82752
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SG82752%27 HTTP/1.1" 200 None
2026-01-29 06:04:29 [auto1.fr] INFO: Scrape type for SG82752: 0
2026-01-29 06:04:29 [auto1.fr] INFO: Found listing with ID: ZU43919
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZU43919%27 HTTP/1.1" 200 None
2026-01-29 06:04:29 [auto1.fr] INFO: Scrape type for ZU43919: 2
2026-01-29 06:04:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:29 [auto1.fr] INFO: Found listing with ID: ZT94272
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZT94272%27 HTTP/1.1" 200 None
2026-01-29 06:04:29 [auto1.fr] INFO: Scrape type for ZT94272: 0
2026-01-29 06:04:29 [auto1.fr] INFO: Found listing with ID: VK53466
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VK53466%27 HTTP/1.1" 200 None
2026-01-29 06:04:29 [auto1.fr] INFO: Scrape type for VK53466: 0
2026-01-29 06:04:29 [auto1.fr] INFO: Found listing with ID: AD38713
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AD38713%27 HTTP/1.1" 200 None
2026-01-29 06:04:29 [auto1.fr] INFO: Scrape type for AD38713: 2
2026-01-29 06:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UM56564> (referer: https://www.auto1.com/v1/car-details-view/UM56564/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HC62658> (referer: https://www.auto1.com/v1/car-details-view/HC62658/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:29 [auto1.fr] INFO: Found listing with ID: BC02724
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BC02724%27 HTTP/1.1" 200 None
2026-01-29 06:04:29 [auto1.fr] INFO: Scrape type for BC02724: 2
2026-01-29 06:04:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:29 [auto1.fr] INFO: Found listing with ID: LH34845
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LH34845%27 HTTP/1.1" 200 None
2026-01-29 06:04:29 [auto1.fr] INFO: Scrape type for LH34845: 0
2026-01-29 06:04:29 [auto1.fr] INFO: Found listing with ID: XG35898
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XG35898%27 HTTP/1.1" 200 None
2026-01-29 06:04:29 [auto1.fr] INFO: Scrape type for XG35898: 0
2026-01-29 06:04:29 [auto1.fr] INFO: Found listing with ID: RY16305
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RY16305%27 HTTP/1.1" 200 None
2026-01-29 06:04:29 [auto1.fr] INFO: Scrape type for RY16305: 2
2026-01-29 06:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HW54822> (referer: https://www.auto1.com/v1/car-details-view/HW54822/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:29 [auto1.fr] INFO: Found listing with ID: EE43921
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EE43921%27 HTTP/1.1" 200 None
2026-01-29 06:04:29 [auto1.fr] INFO: Scrape type for EE43921: 2
2026-01-29 06:04:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:29 [auto1.fr] INFO: Found listing with ID: TU73217
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU73217%27 HTTP/1.1" 200 None
2026-01-29 06:04:29 [auto1.fr] INFO: Scrape type for TU73217: 0
2026-01-29 06:04:29 [auto1.fr] INFO: Found listing with ID: PV82676
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PV82676%27 HTTP/1.1" 200 None
2026-01-29 06:04:29 [auto1.fr] INFO: Scrape type for PV82676: 0
2026-01-29 06:04:29 [auto1.fr] INFO: Found listing with ID: PY80490
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY80490%27 HTTP/1.1" 200 None
2026-01-29 06:04:29 [auto1.fr] INFO: Scrape type for PY80490: 0
2026-01-29 06:04:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11fe0051-0032-50b1-bb73-ffbd6cdfa6d3 with identifier: UM56564
2026-01-29 06:04:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11fe0051-0032-50b1-bb73-ffbd6cdfa6d3 with scrape type 2
2026-01-29 06:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11fe0051-0032-50b1-bb73-ffbd6cdfa6d3 with scrape type 2
2026-01-29 06:04:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 11fe0051-0032-50b1-bb73-ffbd6cdfa6d3, identifier: UM56564
2026-01-29 06:04:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03e54166-654a-53db-a266-8839ab50368f with identifier: HC62658
2026-01-29 06:04:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03e54166-654a-53db-a266-8839ab50368f with scrape type 2
2026-01-29 06:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03e54166-654a-53db-a266-8839ab50368f with scrape type 2
2026-01-29 06:04:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 03e54166-654a-53db-a266-8839ab50368f, identifier: HC62658
2026-01-29 06:04:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 11fe0051-0032-50b1-bb73-ffbd6cdfa6d3 with identifier: UM56564
2026-01-29 06:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 11fe0051-0032-50b1-bb73-ffbd6cdfa6d3 with identifier: UM56564
2026-01-29 06:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 38975, 'odometer_reading_unit': 'km', 'registration_date': '2021-04-11', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/um56564', 'expiration_date': '2026-01-29t16:41:40z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ingrandes sur vienne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 118, 'id': '11fe0051-0032-50b1-bb73-ffbd6cdfa6d3', 'current_year_diff': 5, 'age_in_months': 57, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 38975}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 57,
     'auction_title': '',
     'c_o_2_emission_value': 118,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:41:40z',
     'fuel_type': 'petrol',
     'id': '11fe0051-0032-50b1-bb73-ffbd6cdfa6d3',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/um56564',
     'listing': 'auction',
     'location': 'fr, ingrandes sur vienne',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 38975,
     'odometer_in_km': 38975,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-04-11',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2021}
2026-01-29 06:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 11fe0051-0032-50b1-bb73-ffbd6cdfa6d3 spider: auto1.fr
2026-01-29 06:04:29 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 11fe0051-0032-50b1-bb73-ffbd6cdfa6d3 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 38975, 'odometer_reading_unit': 'km', 'registration_date': '2021-04-11', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/um56564', 'expiration_date': '2026-01-29t16:41:40z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ingrandes sur vienne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 118, 'id': '11fe0051-0032-50b1-bb73-ffbd6cdfa6d3', 'current_year_diff': 5, 'age_in_months': 57, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 38975}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 57,
     'auction_title': '',
     'c_o_2_emission_value': 118,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:41:40z',
     'fuel_type': 'petrol',
     'id': '11fe0051-0032-50b1-bb73-ffbd6cdfa6d3',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/um56564',
     'listing': 'auction',
     'location': 'fr, ingrandes sur vienne',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 38975,
     'odometer_in_km': 38975,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-04-11',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:41:40Z',
 'fuel_type': 'petrol',
 'id': '11fe0051-0032-50b1-bb73-ffbd6cdfa6d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM56564',
 'listing': 'auction',
 'location': 'FR, Ingrandes sur Vienne',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 38975,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2021}
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UM56564%27 HTTP/1.1" 200 None
2026-01-29 06:04:29 [auto1.fr] INFO: Saving data for UM56564: {'auction_closing_time': 1769704900.0, 'created_time': 1769533720.898981, 'last_price_update_time': 1769666669.866825}
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UM56564') HTTP/1.1" 204 0
2026-01-29 06:04:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 03e54166-654a-53db-a266-8839ab50368f with identifier: HC62658
2026-01-29 06:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 03e54166-654a-53db-a266-8839ab50368f with identifier: HC62658
2026-01-29 06:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 't6 transporter' containing 'transporter'
2026-01-29 06:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 03e54166-654a-53db-a266-8839ab50368f spider: auto1.fr
2026-01-29 06:04:30 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 03e54166-654a-53db-a266-8839ab50368f due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 't6 transporter' containing 'transporter'
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:16:55Z',
 'fuel_type': 'diesel',
 'id': '03e54166-654a-53db-a266-8839ab50368f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC62658',
 'listing': 'auction',
 'location': 'FR, Muret',
 'make': 'Volkswagen',
 'model': 'T6 Transporter',
 'odometer': 171270,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-13',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten FWD',
 'transmission': 'manual',
 'trim': 'Kasten FWD',
 'year': 2019}
2026-01-29 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC62658%27 HTTP/1.1" 200 None
2026-01-29 06:04:30 [auto1.fr] INFO: Saving data for HC62658: {'auction_closing_time': 1769703415.0, 'created_time': 1769580196.689259, 'last_price_update_time': 1769666670.198688}
2026-01-29 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HC62658') HTTP/1.1" 204 0
2026-01-29 06:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TX71256/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XU26131> (referer: https://www.auto1.com/v1/car-details-view/XU26131/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TF44474/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZR28348/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbb752c0-18fb-5dfb-a8c8-bc430a5cf874 with identifier: HW54822
2026-01-29 06:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbb752c0-18fb-5dfb-a8c8-bc430a5cf874 with scrape type 2
2026-01-29 06:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbb752c0-18fb-5dfb-a8c8-bc430a5cf874 with scrape type 2
2026-01-29 06:04:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fbb752c0-18fb-5dfb-a8c8-bc430a5cf874, identifier: HW54822
2026-01-29 06:04:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fbb752c0-18fb-5dfb-a8c8-bc430a5cf874 with identifier: HW54822
2026-01-29 06:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fbb752c0-18fb-5dfb-a8c8-bc430a5cf874 with identifier: HW54822
2026-01-29 06:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 146685 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    146685
2026-01-29 06:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: fbb752c0-18fb-5dfb-a8c8-bc430a5cf874 spider: auto1.fr
2026-01-29 06:04:30 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: fbb752c0-18fb-5dfb-a8c8-bc430a5cf874 due to rule: high_mileage_for_make.json, error: 146685 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    146685
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:39:07Z',
 'fuel_type': 'diesel',
 'id': 'fbb752c0-18fb-5dfb-a8c8-bc430a5cf874',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW54822',
 'listing': 'auction',
 'location': 'Montigny-le-Bretonneux',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 146685,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2019}
2026-01-29 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HW54822%27 HTTP/1.1" 200 None
2026-01-29 06:04:30 [auto1.fr] INFO: Saving data for HW54822: {'auction_closing_time': 1769704747.0, 'created_time': 1769534276.290513, 'last_price_update_time': 1769666670.52609}
2026-01-29 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HW54822') HTTP/1.1" 204 0
2026-01-29 06:04:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 860869ab-e50b-5498-b628-af990c05d7f3 with identifier: XU26131
2026-01-29 06:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 860869ab-e50b-5498-b628-af990c05d7f3 with scrape type 2
2026-01-29 06:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 860869ab-e50b-5498-b628-af990c05d7f3 with scrape type 2
2026-01-29 06:04:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 860869ab-e50b-5498-b628-af990c05d7f3, identifier: XU26131
2026-01-29 06:04:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 860869ab-e50b-5498-b628-af990c05d7f3 with identifier: XU26131
2026-01-29 06:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 860869ab-e50b-5498-b628-af990c05d7f3 with identifier: XU26131
2026-01-29 06:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo edition', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 75287, 'odometer_reading_unit': 'km', 'registration_date': '2022-10-05', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xu26131', 'expiration_date': '2026-01-29t16:22:58z', 'origin_country_code': 'fr', 'trim': 'edition', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, saint herblain', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '860869ab-e50b-5498-b628-af990c05d7f3', 'current_year_diff': 4, 'age_in_months': 39, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 75287}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 39,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:22:58z',
     'fuel_type': 'petrol',
     'id': '860869ab-e50b-5498-b628-af990c05d7f3',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xu26131',
     'listing': 'auction',
     'location': 'fr, saint herblain',
     'make': 'opel',
     'make_model': 'opel crossland x',
     'model': 'crossland x',
     'odometer': 75287,
     'odometer_in_km': 75287,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-10-05',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel crossland x 1.2 turbo edition',
     'transmission': 'manual',
     'trim': 'edition',
     'year': 2022}
2026-01-29 06:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 860869ab-e50b-5498-b628-af990c05d7f3 spider: auto1.fr
2026-01-29 06:04:30 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 860869ab-e50b-5498-b628-af990c05d7f3 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo edition', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 75287, 'odometer_reading_unit': 'km', 'registration_date': '2022-10-05', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xu26131', 'expiration_date': '2026-01-29t16:22:58z', 'origin_country_code': 'fr', 'trim': 'edition', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, saint herblain', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '860869ab-e50b-5498-b628-af990c05d7f3', 'current_year_diff': 4, 'age_in_months': 39, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 75287}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 39,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:22:58z',
     'fuel_type': 'petrol',
     'id': '860869ab-e50b-5498-b628-af990c05d7f3',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xu26131',
     'listing': 'auction',
     'location': 'fr, saint herblain',
     'make': 'opel',
     'make_model': 'opel crossland x',
     'model': 'crossland x',
     'odometer': 75287,
     'odometer_in_km': 75287,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-10-05',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel crossland x 1.2 turbo edition',
     'transmission': 'manual',
     'trim': 'edition',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:22:58Z',
 'fuel_type': 'petrol',
 'id': '860869ab-e50b-5498-b628-af990c05d7f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU26131',
 'listing': 'auction',
 'location': 'FR, Saint Herblain',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 75287,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2022}
2026-01-29 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XU26131%27 HTTP/1.1" 200 None
2026-01-29 06:04:30 [auto1.fr] INFO: Saving data for XU26131: {'auction_closing_time': 1769703778.0, 'created_time': 1768905551.409822, 'last_price_update_time': 1769666670.846292}
2026-01-29 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XU26131') HTTP/1.1" 204 0
2026-01-29 06:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LW18978/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AU99102/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JD70507> (referer: https://www.auto1.com/v1/car-details-view/JD70507/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b032a604-397f-5cad-9da3-ef5e9087458a with identifier: JD70507
2026-01-29 06:04:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b032a604-397f-5cad-9da3-ef5e9087458a with scrape type 2
2026-01-29 06:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b032a604-397f-5cad-9da3-ef5e9087458a with scrape type 2
2026-01-29 06:04:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b032a604-397f-5cad-9da3-ef5e9087458a, identifier: JD70507
2026-01-29 06:04:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b032a604-397f-5cad-9da3-ef5e9087458a with identifier: JD70507
2026-01-29 06:04:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b032a604-397f-5cad-9da3-ef5e9087458a with identifier: JD70507
2026-01-29 06:04:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 e-thp gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'manual', 'odometer': 47588, 'odometer_reading_unit': 'km', 'registration_date': '2019-04-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jd70507', 'expiration_date': '2026-01-29t16:34:20z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, houecourt', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 118, 'id': 'b032a604-397f-5cad-9da3-ef5e9087458a', 'current_year_diff': 7, 'age_in_months': 81, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 47588}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 81,
     'auction_title': '',
     'c_o_2_emission_value': 118,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:34:20z',
     'fuel_type': 'petrol',
     'id': 'b032a604-397f-5cad-9da3-ef5e9087458a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jd70507',
     'listing': 'auction',
     'location': 'fr, houecourt',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 47588,
     'odometer_in_km': 47588,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-04-24',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 e-thp gt line',
     'transmission': 'manual',
     'trim': 'gt line',
     'year': 2019}
2026-01-29 06:04:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: b032a604-397f-5cad-9da3-ef5e9087458a spider: auto1.fr
2026-01-29 06:04:31 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: b032a604-397f-5cad-9da3-ef5e9087458a due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 e-thp gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'manual', 'odometer': 47588, 'odometer_reading_unit': 'km', 'registration_date': '2019-04-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jd70507', 'expiration_date': '2026-01-29t16:34:20z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, houecourt', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 118, 'id': 'b032a604-397f-5cad-9da3-ef5e9087458a', 'current_year_diff': 7, 'age_in_months': 81, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 47588}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 81,
     'auction_title': '',
     'c_o_2_emission_value': 118,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:34:20z',
     'fuel_type': 'petrol',
     'id': 'b032a604-397f-5cad-9da3-ef5e9087458a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jd70507',
     'listing': 'auction',
     'location': 'fr, houecourt',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 47588,
     'odometer_in_km': 47588,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-04-24',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 e-thp gt line',
     'transmission': 'manual',
     'trim': 'gt line',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:34:20Z',
 'fuel_type': 'petrol',
 'id': 'b032a604-397f-5cad-9da3-ef5e9087458a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD70507',
 'listing': 'auction',
 'location': 'FR, Houecourt',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 47588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 e-THP GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2019}
2026-01-29 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD70507%27 HTTP/1.1" 200 None
2026-01-29 06:04:31 [auto1.fr] INFO: Saving data for JD70507: {'auction_closing_time': 1769704460.0, 'created_time': 1769533739.471691, 'last_price_update_time': 1769666671.542557}
2026-01-29 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JD70507') HTTP/1.1" 204 0
2026-01-29 06:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CB05708/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BL08452/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BY93625/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UH12185/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NT78881> (referer: https://www.auto1.com/v1/car-details-view/NT78881/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3e8af2f-1467-5498-94f5-4f0e21c71195 with identifier: NT78881
2026-01-29 06:04:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3e8af2f-1467-5498-94f5-4f0e21c71195 with scrape type 2
2026-01-29 06:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3e8af2f-1467-5498-94f5-4f0e21c71195 with scrape type 2
2026-01-29 06:04:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a3e8af2f-1467-5498-94f5-4f0e21c71195, identifier: NT78881
2026-01-29 06:04:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a3e8af2f-1467-5498-94f5-4f0e21c71195 with identifier: NT78881
2026-01-29 06:04:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a3e8af2f-1467-5498-94f5-4f0e21c71195 with identifier: NT78881
2026-01-29 06:04:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a3e8af2f-1467-5498-94f5-4f0e21c71195 with identifier: NT78881 to the API
2026-01-29 06:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:04:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:04:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NT78881>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:19:45Z',
 'fuel_type': 'petrol',
 'id': 'a3e8af2f-1467-5498-94f5-4f0e21c71195',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT78881',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 99396,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Duster 1.3 TCe Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2019}
2026-01-29 06:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NT78881%27 HTTP/1.1" 200 None
2026-01-29 06:04:32 [auto1.fr] INFO: Saving data for NT78881: {'auction_closing_time': 1769703585.0, 'created_time': 1769533748.071499, 'last_price_update_time': 1769666672.174958}
2026-01-29 06:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NT78881') HTTP/1.1" 204 0
2026-01-29 06:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GY54647/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AD38713/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LP71945> (referer: https://www.auto1.com/v1/car-details-view/LP71945/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e7088f3-2732-5a17-a0db-7b9aa88713a3 with identifier: LP71945
2026-01-29 06:04:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e7088f3-2732-5a17-a0db-7b9aa88713a3 with scrape type 2
2026-01-29 06:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e7088f3-2732-5a17-a0db-7b9aa88713a3 with scrape type 2
2026-01-29 06:04:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5e7088f3-2732-5a17-a0db-7b9aa88713a3, identifier: LP71945
2026-01-29 06:04:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5e7088f3-2732-5a17-a0db-7b9aa88713a3 with identifier: LP71945
2026-01-29 06:04:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5e7088f3-2732-5a17-a0db-7b9aa88713a3 with identifier: LP71945
2026-01-29 06:04:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel astra 1.2 turbo gs', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'astra', 'transmission': 'automatic', 'odometer': 30262, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-31', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lp71945', 'expiration_date': '2026-01-29t16:30:13z', 'origin_country_code': 'fr', 'trim': 'gs', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, metz', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 127, 'id': '5e7088f3-2732-5a17-a0db-7b9aa88713a3', 'current_year_diff': 3, 'age_in_months': 28, 'make_model': 'opel astra', 'sanitized_make': 'opel', 'odometer_in_km': 30262}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 28,
     'auction_title': '',
     'c_o_2_emission_value': 127,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:30:13z',
     'fuel_type': 'petrol',
     'id': '5e7088f3-2732-5a17-a0db-7b9aa88713a3',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lp71945',
     'listing': 'auction',
     'location': 'fr, metz',
     'make': 'opel',
     'make_model': 'opel astra',
     'model': 'astra',
     'odometer': 30262,
     'odometer_in_km': 30262,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-08-31',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel astra 1.2 turbo gs',
     'transmission': 'automatic',
     'trim': 'gs',
     'year': 2023}
2026-01-29 06:04:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 5e7088f3-2732-5a17-a0db-7b9aa88713a3 spider: auto1.fr
2026-01-29 06:04:32 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 5e7088f3-2732-5a17-a0db-7b9aa88713a3 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel astra 1.2 turbo gs', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'astra', 'transmission': 'automatic', 'odometer': 30262, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-31', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lp71945', 'expiration_date': '2026-01-29t16:30:13z', 'origin_country_code': 'fr', 'trim': 'gs', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, metz', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 127, 'id': '5e7088f3-2732-5a17-a0db-7b9aa88713a3', 'current_year_diff': 3, 'age_in_months': 28, 'make_model': 'opel astra', 'sanitized_make': 'opel', 'odometer_in_km': 30262}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 28,
     'auction_title': '',
     'c_o_2_emission_value': 127,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:30:13z',
     'fuel_type': 'petrol',
     'id': '5e7088f3-2732-5a17-a0db-7b9aa88713a3',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lp71945',
     'listing': 'auction',
     'location': 'fr, metz',
     'make': 'opel',
     'make_model': 'opel astra',
     'model': 'astra',
     'odometer': 30262,
     'odometer_in_km': 30262,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-08-31',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel astra 1.2 turbo gs',
     'transmission': 'automatic',
     'trim': 'gs',
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:30:13Z',
 'fuel_type': 'petrol',
 'id': '5e7088f3-2732-5a17-a0db-7b9aa88713a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP71945',
 'listing': 'auction',
 'location': 'FR, Metz',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 30262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-08-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.2 Turbo GS',
 'transmission': 'automatic',
 'trim': 'GS',
 'year': 2023}
2026-01-29 06:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LP71945%27 HTTP/1.1" 200 None
2026-01-29 06:04:32 [auto1.fr] INFO: Saving data for LP71945: {'auction_closing_time': 1769704213.0, 'created_time': 1769534560.31598, 'last_price_update_time': 1769666672.789416}
2026-01-29 06:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LP71945') HTTP/1.1" 204 0
2026-01-29 06:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZU43919/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RY16305/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FC62857/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EE43921/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BC02724/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZR28348> (referer: https://www.auto1.com/v1/car-details-view/ZR28348/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3675b50-5b4a-5e75-94cb-811719a09131 with identifier: ZR28348
2026-01-29 06:04:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3675b50-5b4a-5e75-94cb-811719a09131 with scrape type 2
2026-01-29 06:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3675b50-5b4a-5e75-94cb-811719a09131 with scrape type 2
2026-01-29 06:04:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d3675b50-5b4a-5e75-94cb-811719a09131, identifier: ZR28348
2026-01-29 06:04:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d3675b50-5b4a-5e75-94cb-811719a09131 with identifier: ZR28348
2026-01-29 06:04:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d3675b50-5b4a-5e75-94cb-811719a09131 with identifier: ZR28348
2026-01-29 06:04:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot rifter 1.2 puretech allure pack l2', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': 'rifter', 'transmission': 'automatic', 'odometer': 33347, 'odometer_reading_unit': 'km', 'registration_date': '2021-09-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zr28348', 'expiration_date': '2026-01-29t16:20:37z', 'origin_country_code': 'fr', 'trim': 'allure pack l2', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, quincieux', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 158, 'id': 'd3675b50-5b4a-5e75-94cb-811719a09131', 'current_year_diff': 5, 'age_in_months': 51, 'make_model': 'peugeot rifter', 'sanitized_make': 'peugeot', 'odometer_in_km': 33347}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 51,
     'auction_title': '',
     'c_o_2_emission_value': 158,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:20:37z',
     'fuel_type': 'petrol',
     'id': 'd3675b50-5b4a-5e75-94cb-811719a09131',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zr28348',
     'listing': 'auction',
     'location': 'fr, quincieux',
     'make': 'peugeot',
     'make_model': 'peugeot rifter',
     'model': 'rifter',
     'odometer': 33347,
     'odometer_in_km': 33347,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-09-30',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot rifter 1.2 puretech allure pack l2',
     'transmission': 'automatic',
     'trim': 'allure pack l2',
     'year': 2021}
2026-01-29 06:04:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: d3675b50-5b4a-5e75-94cb-811719a09131 spider: auto1.fr
2026-01-29 06:04:33 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: d3675b50-5b4a-5e75-94cb-811719a09131 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot rifter 1.2 puretech allure pack l2', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': 'rifter', 'transmission': 'automatic', 'odometer': 33347, 'odometer_reading_unit': 'km', 'registration_date': '2021-09-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zr28348', 'expiration_date': '2026-01-29t16:20:37z', 'origin_country_code': 'fr', 'trim': 'allure pack l2', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, quincieux', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 158, 'id': 'd3675b50-5b4a-5e75-94cb-811719a09131', 'current_year_diff': 5, 'age_in_months': 51, 'make_model': 'peugeot rifter', 'sanitized_make': 'peugeot', 'odometer_in_km': 33347}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 51,
     'auction_title': '',
     'c_o_2_emission_value': 158,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:20:37z',
     'fuel_type': 'petrol',
     'id': 'd3675b50-5b4a-5e75-94cb-811719a09131',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zr28348',
     'listing': 'auction',
     'location': 'fr, quincieux',
     'make': 'peugeot',
     'make_model': 'peugeot rifter',
     'model': 'rifter',
     'odometer': 33347,
     'odometer_in_km': 33347,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-09-30',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot rifter 1.2 puretech allure pack l2',
     'transmission': 'automatic',
     'trim': 'allure pack l2',
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:20:37Z',
 'fuel_type': 'petrol',
 'id': 'd3675b50-5b4a-5e75-94cb-811719a09131',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR28348',
 'listing': 'auction',
 'location': 'FR, Quincieux',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 33347,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Rifter 1.2 PureTech Allure Pack L2',
 'transmission': 'automatic',
 'trim': 'Allure Pack L2',
 'year': 2021}
2026-01-29 06:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZR28348%27 HTTP/1.1" 200 None
2026-01-29 06:04:33 [auto1.fr] INFO: Saving data for ZR28348: {'auction_closing_time': 1769703637.0, 'created_time': 1769533363.044479, 'last_price_update_time': 1769666673.710468}
2026-01-29 06:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZR28348') HTTP/1.1" 204 0
2026-01-29 06:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TF44474> (referer: https://www.auto1.com/v1/car-details-view/TF44474/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HA77616/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GT56276> (referer: https://www.auto1.com/v1/car-details-view/GT56276/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TX71256> (referer: https://www.auto1.com/v1/car-details-view/TX71256/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LW18978> (referer: https://www.auto1.com/v1/car-details-view/LW18978/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7a3117c-0675-5556-89bb-8d2727d654f1 with identifier: TF44474
2026-01-29 06:04:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7a3117c-0675-5556-89bb-8d2727d654f1 with scrape type 2
2026-01-29 06:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7a3117c-0675-5556-89bb-8d2727d654f1 with scrape type 2
2026-01-29 06:04:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e7a3117c-0675-5556-89bb-8d2727d654f1, identifier: TF44474
2026-01-29 06:04:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e7a3117c-0675-5556-89bb-8d2727d654f1 with identifier: TF44474
2026-01-29 06:04:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e7a3117c-0675-5556-89bb-8d2727d654f1 with identifier: TF44474
2026-01-29 06:04:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 164829 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164829
2026-01-29 06:04:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: e7a3117c-0675-5556-89bb-8d2727d654f1 spider: auto1.fr
2026-01-29 06:04:34 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: e7a3117c-0675-5556-89bb-8d2727d654f1 due to rule: high_mileage_for_country.json, error: 164829 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164829
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:49:51Z',
 'fuel_type': 'diesel',
 'id': 'e7a3117c-0675-5556-89bb-8d2727d654f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF44474',
 'listing': 'auction',
 'location': 'Ludres',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 164829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2020}
2026-01-29 06:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TF44474%27 HTTP/1.1" 200 None
2026-01-29 06:04:34 [auto1.fr] INFO: Saving data for TF44474: {'auction_closing_time': 1769705391.0, 'created_time': 1769534000.174027, 'last_price_update_time': 1769666674.150122}
2026-01-29 06:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TF44474') HTTP/1.1" 204 0
2026-01-29 06:04:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2d9fe58-ca31-5bef-90fa-5fca44454495 with identifier: GT56276
2026-01-29 06:04:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2d9fe58-ca31-5bef-90fa-5fca44454495 with scrape type 2
2026-01-29 06:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2d9fe58-ca31-5bef-90fa-5fca44454495 with scrape type 2
2026-01-29 06:04:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f2d9fe58-ca31-5bef-90fa-5fca44454495, identifier: GT56276
2026-01-29 06:04:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77f9f2bc-7017-5788-b2c4-cd7be0d81402 with identifier: TX71256
2026-01-29 06:04:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77f9f2bc-7017-5788-b2c4-cd7be0d81402 with scrape type 2
2026-01-29 06:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77f9f2bc-7017-5788-b2c4-cd7be0d81402 with scrape type 2
2026-01-29 06:04:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 77f9f2bc-7017-5788-b2c4-cd7be0d81402, identifier: TX71256
2026-01-29 06:04:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c998ac2c-a914-5774-a10c-3ca6ae691d73 with identifier: LW18978
2026-01-29 06:04:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c998ac2c-a914-5774-a10c-3ca6ae691d73 with scrape type 2
2026-01-29 06:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c998ac2c-a914-5774-a10c-3ca6ae691d73 with scrape type 2
2026-01-29 06:04:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c998ac2c-a914-5774-a10c-3ca6ae691d73, identifier: LW18978
2026-01-29 06:04:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f2d9fe58-ca31-5bef-90fa-5fca44454495 with identifier: GT56276
2026-01-29 06:04:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f2d9fe58-ca31-5bef-90fa-5fca44454495 with identifier: GT56276
2026-01-29 06:04:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 5008 1.2 puretech style', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '5008', 'transmission': 'automatic', 'odometer': 81897, 'odometer_reading_unit': 'km', 'registration_date': '2022-12-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gt56276', 'expiration_date': '2026-01-29t16:40:44z', 'origin_country_code': 'fr', 'trim': 'style', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, carrières-sous-poissy', 'category': None, 'seats_number': 7, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'f2d9fe58-ca31-5bef-90fa-5fca44454495', 'current_year_diff': 4, 'age_in_months': 37, 'make_model': 'peugeot 5008', 'sanitized_make': 'peugeot', 'odometer_in_km': 81897}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 37,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:40:44z',
     'fuel_type': 'petrol',
     'id': 'f2d9fe58-ca31-5bef-90fa-5fca44454495',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gt56276',
     'listing': 'auction',
     'location': 'fr, carrières-sous-poissy',
     'make': 'peugeot',
     'make_model': 'peugeot 5008',
     'model': '5008',
     'odometer': 81897,
     'odometer_in_km': 81897,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-12-26',
     'sanitized_make': 'peugeot',
     'seats_number': 7,
     'seller_name': None,
     'title': 'peugeot 5008 1.2 puretech style',
     'transmission': 'automatic',
     'trim': 'style',
     'year': 2022}
2026-01-29 06:04:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: f2d9fe58-ca31-5bef-90fa-5fca44454495 spider: auto1.fr
2026-01-29 06:04:34 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: f2d9fe58-ca31-5bef-90fa-5fca44454495 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 5008 1.2 puretech style', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '5008', 'transmission': 'automatic', 'odometer': 81897, 'odometer_reading_unit': 'km', 'registration_date': '2022-12-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gt56276', 'expiration_date': '2026-01-29t16:40:44z', 'origin_country_code': 'fr', 'trim': 'style', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, carrières-sous-poissy', 'category': None, 'seats_number': 7, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'f2d9fe58-ca31-5bef-90fa-5fca44454495', 'current_year_diff': 4, 'age_in_months': 37, 'make_model': 'peugeot 5008', 'sanitized_make': 'peugeot', 'odometer_in_km': 81897}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 37,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:40:44z',
     'fuel_type': 'petrol',
     'id': 'f2d9fe58-ca31-5bef-90fa-5fca44454495',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gt56276',
     'listing': 'auction',
     'location': 'fr, carrières-sous-poissy',
     'make': 'peugeot',
     'make_model': 'peugeot 5008',
     'model': '5008',
     'odometer': 81897,
     'odometer_in_km': 81897,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-12-26',
     'sanitized_make': 'peugeot',
     'seats_number': 7,
     'seller_name': None,
     'title': 'peugeot 5008 1.2 puretech style',
     'transmission': 'automatic',
     'trim': 'style',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:40:44Z',
 'fuel_type': 'petrol',
 'id': 'f2d9fe58-ca31-5bef-90fa-5fca44454495',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT56276',
 'listing': 'auction',
 'location': 'FR, Carrières-sous-Poissy',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 81897,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-26',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 1.2 PureTech Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2022}
2026-01-29 06:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GT56276%27 HTTP/1.1" 200 None
2026-01-29 06:04:34 [auto1.fr] INFO: Saving data for GT56276: {'auction_closing_time': 1769704844.0, 'created_time': 1769533710.65297, 'last_price_update_time': 1769666674.798384}
2026-01-29 06:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GT56276') HTTP/1.1" 204 0
2026-01-29 06:04:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 77f9f2bc-7017-5788-b2c4-cd7be0d81402 with identifier: TX71256
2026-01-29 06:04:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 77f9f2bc-7017-5788-b2c4-cd7be0d81402 with identifier: TX71256
2026-01-29 06:04:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 77f9f2bc-7017-5788-b2c4-cd7be0d81402 with identifier: TX71256 to the API
2026-01-29 06:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:04:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:04:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TX71256>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:33:07Z',
 'fuel_type': 'diesel',
 'id': '77f9f2bc-7017-5788-b2c4-cd7be0d81402',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX71256',
 'listing': 'auction',
 'location': 'FR, Carrières-sous-Poissy',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 86757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-30',
 'seats_number': 2,
 'seller_name': None,
 'title': "Peugeot 208 1.5 Blue-HDi Active Business R'",
 'transmission': 'manual',
 'trim': "Active Business R'",
 'year': 2019}
2026-01-29 06:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TX71256%27 HTTP/1.1" 200 None
2026-01-29 06:04:35 [auto1.fr] INFO: Saving data for TX71256: {'auction_closing_time': 1769704387.0, 'created_time': 1769580175.234728, 'last_price_update_time': 1769666675.158737}
2026-01-29 06:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TX71256') HTTP/1.1" 204 0
2026-01-29 06:04:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c998ac2c-a914-5774-a10c-3ca6ae691d73 with identifier: LW18978
2026-01-29 06:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c998ac2c-a914-5774-a10c-3ca6ae691d73 with identifier: LW18978
2026-01-29 06:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 60889, 'odometer_reading_unit': 'km', 'registration_date': '2021-02-25', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lw18978', 'expiration_date': '2026-01-29t16:15:50z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, boé', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 126, 'id': 'c998ac2c-a914-5774-a10c-3ca6ae691d73', 'current_year_diff': 5, 'age_in_months': 59, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 60889}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 59,
     'auction_title': '',
     'c_o_2_emission_value': 126,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:15:50z',
     'fuel_type': 'petrol',
     'id': 'c998ac2c-a914-5774-a10c-3ca6ae691d73',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lw18978',
     'listing': 'auction',
     'location': 'fr, boé',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 60889,
     'odometer_in_km': 60889,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-02-25',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2021}
2026-01-29 06:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: c998ac2c-a914-5774-a10c-3ca6ae691d73 spider: auto1.fr
2026-01-29 06:04:35 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: c998ac2c-a914-5774-a10c-3ca6ae691d73 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 60889, 'odometer_reading_unit': 'km', 'registration_date': '2021-02-25', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lw18978', 'expiration_date': '2026-01-29t16:15:50z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, boé', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 126, 'id': 'c998ac2c-a914-5774-a10c-3ca6ae691d73', 'current_year_diff': 5, 'age_in_months': 59, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 60889}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 59,
     'auction_title': '',
     'c_o_2_emission_value': 126,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:15:50z',
     'fuel_type': 'petrol',
     'id': 'c998ac2c-a914-5774-a10c-3ca6ae691d73',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lw18978',
     'listing': 'auction',
     'location': 'fr, boé',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 60889,
     'odometer_in_km': 60889,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-02-25',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:15:50Z',
 'fuel_type': 'petrol',
 'id': 'c998ac2c-a914-5774-a10c-3ca6ae691d73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW18978',
 'listing': 'auction',
 'location': 'FR, Boé',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 60889,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2021}
2026-01-29 06:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LW18978%27 HTTP/1.1" 200 None
2026-01-29 06:04:35 [auto1.fr] INFO: Saving data for LW18978: {'auction_closing_time': 1769703350.0, 'created_time': 1768413542.654278, 'last_price_update_time': 1769666675.437774}
2026-01-29 06:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LW18978') HTTP/1.1" 204 0
2026-01-29 06:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RK40922> (referer: https://www.auto1.com/v1/car-details-view/RK40922/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UH12185> (referer: https://www.auto1.com/v1/car-details-view/UH12185/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae01aa4c-5f85-5252-8d43-d14f98ff5398 with identifier: RK40922
2026-01-29 06:04:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae01aa4c-5f85-5252-8d43-d14f98ff5398 with scrape type 2
2026-01-29 06:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae01aa4c-5f85-5252-8d43-d14f98ff5398 with scrape type 2
2026-01-29 06:04:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ae01aa4c-5f85-5252-8d43-d14f98ff5398, identifier: RK40922
2026-01-29 06:04:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ae01aa4c-5f85-5252-8d43-d14f98ff5398 with identifier: RK40922
2026-01-29 06:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ae01aa4c-5f85-5252-8d43-d14f98ff5398 with identifier: RK40922
2026-01-29 06:04:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ae01aa4c-5f85-5252-8d43-d14f98ff5398 with identifier: RK40922 to the API
2026-01-29 06:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:04:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:04:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RK40922>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:57:03Z',
 'fuel_type': 'diesel',
 'id': 'ae01aa4c-5f85-5252-8d43-d14f98ff5398',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK40922',
 'listing': 'auction',
 'location': 'FR, Boé',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 105004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 xDrive 18d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-01-29 06:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RK40922%27 HTTP/1.1" 200 None
2026-01-29 06:04:36 [auto1.fr] INFO: Saving data for RK40922: {'auction_closing_time': 1769705823.0, 'created_time': 1769580099.25358, 'last_price_update_time': 1769666676.057199}
2026-01-29 06:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RK40922') HTTP/1.1" 204 0
2026-01-29 06:04:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8413128a-ddad-53c6-b277-c2075ffaa862 with identifier: UH12185
2026-01-29 06:04:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8413128a-ddad-53c6-b277-c2075ffaa862 with scrape type 2
2026-01-29 06:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8413128a-ddad-53c6-b277-c2075ffaa862 with scrape type 2
2026-01-29 06:04:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8413128a-ddad-53c6-b277-c2075ffaa862, identifier: UH12185
2026-01-29 06:04:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8413128a-ddad-53c6-b277-c2075ffaa862 with identifier: UH12185
2026-01-29 06:04:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8413128a-ddad-53c6-b277-c2075ffaa862 with identifier: UH12185
2026-01-29 06:04:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8413128a-ddad-53c6-b277-c2075ffaa862 with identifier: UH12185 to the API
2026-01-29 06:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:04:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:04:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UH12185>
{'auction_title': '',
 'c_o_2_emission_value': 86,
 'category': 'Taxi',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'engine_horse_power': 122,
 'expiration_date': '2026-01-29T16:41:43Z',
 'fuel_type': 'hybrid',
 'id': '8413128a-ddad-53c6-b277-c2075ffaa862',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH12185',
 'listing': 'auction',
 'location': 'FR, Saint-Denis',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 147131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota C-HR 1.8 Hybrid Graphic',
 'transmission': 'automatic',
 'trim': 'Graphic',
 'year': 2019}
2026-01-29 06:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UH12185%27 HTTP/1.1" 200 None
2026-01-29 06:04:36 [auto1.fr] INFO: Saving data for UH12185: {'auction_closing_time': 1769704903.0, 'created_time': 1769533739.236705, 'last_price_update_time': 1769666676.541222}
2026-01-29 06:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UH12185') HTTP/1.1" 204 0
2026-01-29 06:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GY54647> (referer: https://www.auto1.com/v1/car-details-view/GY54647/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BL08452> (referer: https://www.auto1.com/v1/car-details-view/BL08452/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CB05708> (referer: https://www.auto1.com/v1/car-details-view/CB05708/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AD38713> (referer: https://www.auto1.com/v1/car-details-view/AD38713/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ad607f9-dbce-52c8-8e39-b01064224cc4 with identifier: GY54647
2026-01-29 06:04:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ad607f9-dbce-52c8-8e39-b01064224cc4 with scrape type 2
2026-01-29 06:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ad607f9-dbce-52c8-8e39-b01064224cc4 with scrape type 2
2026-01-29 06:04:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4ad607f9-dbce-52c8-8e39-b01064224cc4, identifier: GY54647
2026-01-29 06:04:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4ad607f9-dbce-52c8-8e39-b01064224cc4 with identifier: GY54647
2026-01-29 06:04:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4ad607f9-dbce-52c8-8e39-b01064224cc4 with identifier: GY54647
2026-01-29 06:04:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 e-thp allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 164097, 'odometer_reading_unit': 'km', 'registration_date': '2019-02-17', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gy54647', 'expiration_date': '2026-01-29t16:43:37z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, périgny', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 117, 'id': '4ad607f9-dbce-52c8-8e39-b01064224cc4', 'current_year_diff': 7, 'age_in_months': 83, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 164097}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 83,
     'auction_title': '',
     'c_o_2_emission_value': 117,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:43:37z',
     'fuel_type': 'petrol',
     'id': '4ad607f9-dbce-52c8-8e39-b01064224cc4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gy54647',
     'listing': 'auction',
     'location': 'fr, périgny',
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 164097,
     'odometer_in_km': 164097,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-02-17',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 1.2 e-thp allure',
     'transmission': 'automatic',
     'trim': 'allure',
     'year': 2019}
2026-01-29 06:04:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 4ad607f9-dbce-52c8-8e39-b01064224cc4 spider: auto1.fr
2026-01-29 06:04:37 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 4ad607f9-dbce-52c8-8e39-b01064224cc4 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 e-thp allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 164097, 'odometer_reading_unit': 'km', 'registration_date': '2019-02-17', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gy54647', 'expiration_date': '2026-01-29t16:43:37z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, périgny', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 117, 'id': '4ad607f9-dbce-52c8-8e39-b01064224cc4', 'current_year_diff': 7, 'age_in_months': 83, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 164097}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 83,
     'auction_title': '',
     'c_o_2_emission_value': 117,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:43:37z',
     'fuel_type': 'petrol',
     'id': '4ad607f9-dbce-52c8-8e39-b01064224cc4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gy54647',
     'listing': 'auction',
     'location': 'fr, périgny',
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 164097,
     'odometer_in_km': 164097,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-02-17',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 1.2 e-thp allure',
     'transmission': 'automatic',
     'trim': 'allure',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:43:37Z',
 'fuel_type': 'petrol',
 'id': '4ad607f9-dbce-52c8-8e39-b01064224cc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY54647',
 'listing': 'auction',
 'location': 'FR, Périgny',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 164097,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2019}
2026-01-29 06:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GY54647%27 HTTP/1.1" 200 None
2026-01-29 06:04:37 [auto1.fr] INFO: Saving data for GY54647: {'auction_closing_time': 1769705017.0, 'created_time': 1769534454.616792, 'last_price_update_time': 1769666677.057776}
2026-01-29 06:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GY54647') HTTP/1.1" 204 0
2026-01-29 06:04:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 446a793e-50de-5634-9bce-b39141101511 with identifier: BL08452
2026-01-29 06:04:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 446a793e-50de-5634-9bce-b39141101511 with scrape type 2
2026-01-29 06:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 446a793e-50de-5634-9bce-b39141101511 with scrape type 2
2026-01-29 06:04:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 446a793e-50de-5634-9bce-b39141101511, identifier: BL08452
2026-01-29 06:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BY93625> (referer: https://www.auto1.com/v1/car-details-view/BY93625/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 446a793e-50de-5634-9bce-b39141101511 with identifier: BL08452
2026-01-29 06:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 446a793e-50de-5634-9bce-b39141101511 with identifier: BL08452
2026-01-29 06:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'nissan' containing 'nissan' and model 'nv250' containing 'nv'
2026-01-29 06:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 446a793e-50de-5634-9bce-b39141101511 spider: auto1.fr
2026-01-29 06:04:37 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 446a793e-50de-5634-9bce-b39141101511 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'nissan' containing 'nissan' and model 'nv250' containing 'nv'
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:27:08Z',
 'fuel_type': 'diesel',
 'id': '446a793e-50de-5634-9bce-b39141101511',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL08452',
 'listing': 'auction',
 'location': 'FR, Chambray-Lès-Tours',
 'make': 'Nissan',
 'model': 'NV250',
 'odometer': 80198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-13',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Nissan NV250 1.5 dCi L1H1 Made in France',
 'transmission': 'manual',
 'trim': 'L1H1 Made in France',
 'year': 2021}
2026-01-29 06:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BL08452%27 HTTP/1.1" 200 None
2026-01-29 06:04:37 [auto1.fr] INFO: Saving data for BL08452: {'auction_closing_time': 1769704028.0, 'created_time': 1769534443.993434, 'last_price_update_time': 1769666677.382228}
2026-01-29 06:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BL08452') HTTP/1.1" 204 0
2026-01-29 06:04:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AU99102> (referer: https://www.auto1.com/v1/car-details-view/AU99102/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23aea53c-bf47-5736-a08b-5f2a59c16cd8 with identifier: CB05708
2026-01-29 06:04:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23aea53c-bf47-5736-a08b-5f2a59c16cd8 with scrape type 2
2026-01-29 06:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23aea53c-bf47-5736-a08b-5f2a59c16cd8 with scrape type 2
2026-01-29 06:04:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 23aea53c-bf47-5736-a08b-5f2a59c16cd8, identifier: CB05708
2026-01-29 06:04:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 548f28d8-5f73-5887-95f9-b0d755177475 with identifier: AD38713
2026-01-29 06:04:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 548f28d8-5f73-5887-95f9-b0d755177475 with scrape type 2
2026-01-29 06:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 548f28d8-5f73-5887-95f9-b0d755177475 with scrape type 2
2026-01-29 06:04:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 548f28d8-5f73-5887-95f9-b0d755177475, identifier: AD38713
2026-01-29 06:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EE43921> (referer: https://www.auto1.com/v1/car-details-view/EE43921/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RY16305> (referer: https://www.auto1.com/v1/car-details-view/RY16305/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 23aea53c-bf47-5736-a08b-5f2a59c16cd8 with identifier: CB05708
2026-01-29 06:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 23aea53c-bf47-5736-a08b-5f2a59c16cd8 with identifier: CB05708
2026-01-29 06:04:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 23aea53c-bf47-5736-a08b-5f2a59c16cd8 with identifier: CB05708 to the API
2026-01-29 06:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:04:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:04:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CB05708>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 60,
 'expiration_date': '2026-01-29T16:05:52Z',
 'fuel_type': 'petrol',
 'id': '23aea53c-bf47-5736-a08b-5f2a59c16cd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB05708',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 34505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2020}
2026-01-29 06:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CB05708%27 HTTP/1.1" 200 None
2026-01-29 06:04:37 [auto1.fr] INFO: Saving data for CB05708: {'auction_closing_time': 1769702752.0, 'created_time': 1768644219.694613, 'last_price_update_time': 1769666677.955418}
2026-01-29 06:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CB05708') HTTP/1.1" 204 0
2026-01-29 06:04:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 548f28d8-5f73-5887-95f9-b0d755177475 with identifier: AD38713
2026-01-29 06:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 548f28d8-5f73-5887-95f9-b0d755177475 with identifier: AD38713
2026-01-29 06:04:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 168784 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168784
2026-01-29 06:04:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 548f28d8-5f73-5887-95f9-b0d755177475 spider: auto1.fr
2026-01-29 06:04:38 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 548f28d8-5f73-5887-95f9-b0d755177475 due to rule: high_mileage_for_country.json, error: 168784 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168784
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:05:34Z',
 'fuel_type': 'diesel',
 'id': '548f28d8-5f73-5887-95f9-b0d755177475',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD38713',
 'listing': 'auction',
 'location': 'FR, Ambérieu en Bugey',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 168784,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 40 TDI quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2019}
2026-01-29 06:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AD38713%27 HTTP/1.1" 200 None
2026-01-29 06:04:38 [auto1.fr] INFO: Saving data for AD38713: {'auction_closing_time': 1769702734.0, 'created_time': 1769533422.145636, 'last_price_update_time': 1769666678.227007}
2026-01-29 06:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AD38713') HTTP/1.1" 204 0
2026-01-29 06:04:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b57c15ea-8a4e-5064-8bb5-6874e7fbffc0 with identifier: BY93625
2026-01-29 06:04:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b57c15ea-8a4e-5064-8bb5-6874e7fbffc0 with scrape type 2
2026-01-29 06:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b57c15ea-8a4e-5064-8bb5-6874e7fbffc0 with scrape type 2
2026-01-29 06:04:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b57c15ea-8a4e-5064-8bb5-6874e7fbffc0, identifier: BY93625
2026-01-29 06:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZU43919> (referer: https://www.auto1.com/v1/car-details-view/ZU43919/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b57c15ea-8a4e-5064-8bb5-6874e7fbffc0 with identifier: BY93625
2026-01-29 06:04:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b57c15ea-8a4e-5064-8bb5-6874e7fbffc0 with identifier: BY93625
2026-01-29 06:04:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b57c15ea-8a4e-5064-8bb5-6874e7fbffc0 with identifier: BY93625 to the API
2026-01-29 06:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:04:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:04:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BY93625>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:32:02Z',
 'fuel_type': 'petrol',
 'id': 'b57c15ea-8a4e-5064-8bb5-6874e7fbffc0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY93625',
 'listing': 'auction',
 'location': 'FR, MOUGINS',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 97087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.4 Turbo Super',
 'transmission': 'manual',
 'trim': 'Super',
 'year': 2017}
2026-01-29 06:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BY93625%27 HTTP/1.1" 200 None
2026-01-29 06:04:38 [auto1.fr] INFO: Saving data for BY93625: {'auction_closing_time': 1769704322.0, 'created_time': 1769533572.636972, 'last_price_update_time': 1769666678.684834}
2026-01-29 06:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BY93625') HTTP/1.1" 204 0
2026-01-29 06:04:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53c030d5-f292-5384-9f23-72f6109f563a with identifier: AU99102
2026-01-29 06:04:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53c030d5-f292-5384-9f23-72f6109f563a with scrape type 2
2026-01-29 06:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53c030d5-f292-5384-9f23-72f6109f563a with scrape type 2
2026-01-29 06:04:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 53c030d5-f292-5384-9f23-72f6109f563a, identifier: AU99102
2026-01-29 06:04:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b017b8ba-b672-5003-908c-96f1472d7721 with identifier: EE43921
2026-01-29 06:04:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b017b8ba-b672-5003-908c-96f1472d7721 with scrape type 2
2026-01-29 06:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b017b8ba-b672-5003-908c-96f1472d7721 with scrape type 2
2026-01-29 06:04:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b017b8ba-b672-5003-908c-96f1472d7721, identifier: EE43921
2026-01-29 06:04:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8efa9fb-20fd-5319-a1f2-6e34800790ad with identifier: RY16305
2026-01-29 06:04:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8efa9fb-20fd-5319-a1f2-6e34800790ad with scrape type 2
2026-01-29 06:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8efa9fb-20fd-5319-a1f2-6e34800790ad with scrape type 2
2026-01-29 06:04:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f8efa9fb-20fd-5319-a1f2-6e34800790ad, identifier: RY16305
2026-01-29 06:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PM66724/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 53c030d5-f292-5384-9f23-72f6109f563a with identifier: AU99102
2026-01-29 06:04:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 53c030d5-f292-5384-9f23-72f6109f563a with identifier: AU99102
2026-01-29 06:04:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'nissan note 1.2 acenta', 'price': 0, 'currency': 'eur', 'make': 'nissan', 'model': 'note', 'transmission': 'manual', 'odometer': 128699, 'odometer_reading_unit': 'km', 'registration_date': '2017-01-31', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/au99102', 'expiration_date': '2026-01-29t16:16:55z', 'origin_country_code': 'fr', 'trim': 'acenta', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 80, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, beaucaire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': '53c030d5-f292-5384-9f23-72f6109f563a', 'current_year_diff': 9, 'age_in_months': 107, 'make_model': 'nissan note', 'sanitized_make': 'nissan', 'odometer_in_km': 128699}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 107,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 80,
     'expiration_date': '2026-01-29t16:16:55z',
     'fuel_type': 'petrol',
     'id': '53c030d5-f292-5384-9f23-72f6109f563a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/au99102',
     'listing': 'auction',
     'location': 'fr, beaucaire',
     'make': 'nissan',
     'make_model': 'nissan note',
     'model': 'note',
     'odometer': 128699,
     'odometer_in_km': 128699,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-01-31',
     'sanitized_make': 'nissan',
     'seats_number': 5,
     'seller_name': None,
     'title': 'nissan note 1.2 acenta',
     'transmission': 'manual',
     'trim': 'acenta',
     'year': 2017}
2026-01-29 06:04:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 53c030d5-f292-5384-9f23-72f6109f563a spider: auto1.fr
2026-01-29 06:04:39 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 53c030d5-f292-5384-9f23-72f6109f563a due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'nissan note 1.2 acenta', 'price': 0, 'currency': 'eur', 'make': 'nissan', 'model': 'note', 'transmission': 'manual', 'odometer': 128699, 'odometer_reading_unit': 'km', 'registration_date': '2017-01-31', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/au99102', 'expiration_date': '2026-01-29t16:16:55z', 'origin_country_code': 'fr', 'trim': 'acenta', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 80, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, beaucaire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': '53c030d5-f292-5384-9f23-72f6109f563a', 'current_year_diff': 9, 'age_in_months': 107, 'make_model': 'nissan note', 'sanitized_make': 'nissan', 'odometer_in_km': 128699}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 107,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 80,
     'expiration_date': '2026-01-29t16:16:55z',
     'fuel_type': 'petrol',
     'id': '53c030d5-f292-5384-9f23-72f6109f563a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/au99102',
     'listing': 'auction',
     'location': 'fr, beaucaire',
     'make': 'nissan',
     'make_model': 'nissan note',
     'model': 'note',
     'odometer': 128699,
     'odometer_in_km': 128699,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-01-31',
     'sanitized_make': 'nissan',
     'seats_number': 5,
     'seller_name': None,
     'title': 'nissan note 1.2 acenta',
     'transmission': 'manual',
     'trim': 'acenta',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 80,
 'expiration_date': '2026-01-29T16:16:55Z',
 'fuel_type': 'petrol',
 'id': '53c030d5-f292-5384-9f23-72f6109f563a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU99102',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Nissan',
 'model': 'Note',
 'odometer': 128699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Note 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2017}
2026-01-29 06:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AU99102%27 HTTP/1.1" 200 None
2026-01-29 06:04:39 [auto1.fr] INFO: Saving data for AU99102: {'auction_closing_time': 1769703415.0, 'created_time': 1768844564.40869, 'last_price_update_time': 1769666679.325409}
2026-01-29 06:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AU99102') HTTP/1.1" 204 0
2026-01-29 06:04:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b017b8ba-b672-5003-908c-96f1472d7721 with identifier: EE43921
2026-01-29 06:04:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b017b8ba-b672-5003-908c-96f1472d7721 with identifier: EE43921
2026-01-29 06:04:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 175751 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    175751
2026-01-29 06:04:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b017b8ba-b672-5003-908c-96f1472d7721 spider: auto1.fr
2026-01-29 06:04:39 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: b017b8ba-b672-5003-908c-96f1472d7721 due to rule: high_mileage_for_country.json, error: 175751 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    175751
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-01-29T16:32:58Z',
 'fuel_type': 'diesel',
 'id': 'b017b8ba-b672-5003-908c-96f1472d7721',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE43921',
 'listing': 'auction',
 'location': 'FR, Boé',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 175751,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 2.0 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2018}
2026-01-29 06:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EE43921%27 HTTP/1.1" 200 None
2026-01-29 06:04:39 [auto1.fr] INFO: Saving data for EE43921: {'auction_closing_time': 1769704378.0, 'created_time': 1769580042.888382, 'last_price_update_time': 1769666679.558336}
2026-01-29 06:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EE43921') HTTP/1.1" 204 0
2026-01-29 06:04:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f8efa9fb-20fd-5319-a1f2-6e34800790ad with identifier: RY16305
2026-01-29 06:04:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f8efa9fb-20fd-5319-a1f2-6e34800790ad with identifier: RY16305
2026-01-29 06:04:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f8efa9fb-20fd-5319-a1f2-6e34800790ad with identifier: RY16305 to the API
2026-01-29 06:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:04:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:04:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RY16305>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:28:53Z',
 'fuel_type': 'petrol',
 'id': 'f8efa9fb-20fd-5319-a1f2-6e34800790ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY16305',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 109847,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2019}
2026-01-29 06:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RY16305%27 HTTP/1.1" 200 None
2026-01-29 06:04:39 [auto1.fr] INFO: Saving data for RY16305: {'auction_closing_time': 1769704133.0, 'created_time': 1767807838.779858, 'last_price_update_time': 1769666679.909705}
2026-01-29 06:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RY16305') HTTP/1.1" 204 0
2026-01-29 06:04:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FC62857> (referer: https://www.auto1.com/v1/car-details-view/FC62857/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BC02724> (referer: https://www.auto1.com/v1/car-details-view/BC02724/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07274e12-2e77-5ea5-9367-bd19bde1c202 with identifier: ZU43919
2026-01-29 06:04:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07274e12-2e77-5ea5-9367-bd19bde1c202 with scrape type 2
2026-01-29 06:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07274e12-2e77-5ea5-9367-bd19bde1c202 with scrape type 2
2026-01-29 06:04:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 07274e12-2e77-5ea5-9367-bd19bde1c202, identifier: ZU43919
2026-01-29 06:04:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 07274e12-2e77-5ea5-9367-bd19bde1c202 with identifier: ZU43919
2026-01-29 06:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 07274e12-2e77-5ea5-9367-bd19bde1c202 with identifier: ZU43919
2026-01-29 06:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'yellow', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech active business', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 57110, 'odometer_reading_unit': 'km', 'registration_date': '2020-12-22', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zu43919', 'expiration_date': '2026-01-29t16:16:30z', 'origin_country_code': 'fr', 'trim': 'active business', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 2, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 118, 'id': '07274e12-2e77-5ea5-9367-bd19bde1c202', 'current_year_diff': 6, 'age_in_months': 61, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 57110}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 61,
     'auction_title': '',
     'c_o_2_emission_value': 118,
     'category': None,
     'color': 'yellow',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 75,
     'expiration_date': '2026-01-29t16:16:30z',
     'fuel_type': 'petrol',
     'id': '07274e12-2e77-5ea5-9367-bd19bde1c202',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zu43919',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 57110,
     'odometer_in_km': 57110,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-12-22',
     'sanitized_make': 'peugeot',
     'seats_number': 2,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech active business',
     'transmission': 'manual',
     'trim': 'active business',
     'year': 2020}
2026-01-29 06:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 07274e12-2e77-5ea5-9367-bd19bde1c202 spider: auto1.fr
2026-01-29 06:04:40 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 07274e12-2e77-5ea5-9367-bd19bde1c202 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'yellow', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech active business', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 57110, 'odometer_reading_unit': 'km', 'registration_date': '2020-12-22', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zu43919', 'expiration_date': '2026-01-29t16:16:30z', 'origin_country_code': 'fr', 'trim': 'active business', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 2, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 118, 'id': '07274e12-2e77-5ea5-9367-bd19bde1c202', 'current_year_diff': 6, 'age_in_months': 61, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 57110}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 61,
     'auction_title': '',
     'c_o_2_emission_value': 118,
     'category': None,
     'color': 'yellow',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 75,
     'expiration_date': '2026-01-29t16:16:30z',
     'fuel_type': 'petrol',
     'id': '07274e12-2e77-5ea5-9367-bd19bde1c202',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zu43919',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 57110,
     'odometer_in_km': 57110,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-12-22',
     'sanitized_make': 'peugeot',
     'seats_number': 2,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech active business',
     'transmission': 'manual',
     'trim': 'active business',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:16:30Z',
 'fuel_type': 'petrol',
 'id': '07274e12-2e77-5ea5-9367-bd19bde1c202',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU43919',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 57110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Active Business',
 'transmission': 'manual',
 'trim': 'Active Business',
 'year': 2020}
2026-01-29 06:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZU43919%27 HTTP/1.1" 200 None
2026-01-29 06:04:40 [auto1.fr] INFO: Saving data for ZU43919: {'auction_closing_time': 1769703390.0, 'created_time': 1768990195.62764, 'last_price_update_time': 1769666680.274282}
2026-01-29 06:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZU43919') HTTP/1.1" 204 0
2026-01-29 06:04:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e932a00e-f95f-53ca-acd5-0e25cd54a794 with identifier: FC62857
2026-01-29 06:04:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e932a00e-f95f-53ca-acd5-0e25cd54a794 with scrape type 2
2026-01-29 06:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e932a00e-f95f-53ca-acd5-0e25cd54a794 with scrape type 2
2026-01-29 06:04:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e932a00e-f95f-53ca-acd5-0e25cd54a794, identifier: FC62857
2026-01-29 06:04:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bd199e3-6406-5883-aabd-b5e1e5062504 with identifier: BC02724
2026-01-29 06:04:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bd199e3-6406-5883-aabd-b5e1e5062504 with scrape type 2
2026-01-29 06:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bd199e3-6406-5883-aabd-b5e1e5062504 with scrape type 2
2026-01-29 06:04:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3bd199e3-6406-5883-aabd-b5e1e5062504, identifier: BC02724
2026-01-29 06:04:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e932a00e-f95f-53ca-acd5-0e25cd54a794 with identifier: FC62857
2026-01-29 06:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e932a00e-f95f-53ca-acd5-0e25cd54a794 with identifier: FC62857
2026-01-29 06:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'ds automobiles ds3 crossback 1.2 puretech inès de la fressange', 'price': 0, 'currency': 'eur', 'make': 'ds automobiles', 'model': 'ds3 crossback', 'transmission': 'automatic', 'odometer': 51712, 'odometer_reading_unit': 'km', 'registration_date': '2021-12-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fc62857', 'expiration_date': '2026-01-29t16:51:05z', 'origin_country_code': 'fr', 'trim': 'inès de la fressange', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marly-la-ville', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 138, 'id': 'e932a00e-f95f-53ca-acd5-0e25cd54a794', 'current_year_diff': 5, 'age_in_months': 49, 'make_model': 'ds automobiles ds3 crossback', 'sanitized_make': 'dsautomobiles', 'odometer_in_km': 51712}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 49,
     'auction_title': '',
     'c_o_2_emission_value': 138,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:51:05z',
     'fuel_type': 'petrol',
     'id': 'e932a00e-f95f-53ca-acd5-0e25cd54a794',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fc62857',
     'listing': 'auction',
     'location': 'fr, marly-la-ville',
     'make': 'ds automobiles',
     'make_model': 'ds automobiles ds3 crossback',
     'model': 'ds3 crossback',
     'odometer': 51712,
     'odometer_in_km': 51712,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-12-28',
     'sanitized_make': 'dsautomobiles',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ds automobiles ds3 crossback 1.2 puretech inès de la '
              'fressange',
     'transmission': 'automatic',
     'trim': 'inès de la fressange',
     'year': 2021}
2026-01-29 06:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: e932a00e-f95f-53ca-acd5-0e25cd54a794 spider: auto1.fr
2026-01-29 06:04:40 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: e932a00e-f95f-53ca-acd5-0e25cd54a794 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'ds automobiles ds3 crossback 1.2 puretech inès de la fressange', 'price': 0, 'currency': 'eur', 'make': 'ds automobiles', 'model': 'ds3 crossback', 'transmission': 'automatic', 'odometer': 51712, 'odometer_reading_unit': 'km', 'registration_date': '2021-12-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fc62857', 'expiration_date': '2026-01-29t16:51:05z', 'origin_country_code': 'fr', 'trim': 'inès de la fressange', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marly-la-ville', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 138, 'id': 'e932a00e-f95f-53ca-acd5-0e25cd54a794', 'current_year_diff': 5, 'age_in_months': 49, 'make_model': 'ds automobiles ds3 crossback', 'sanitized_make': 'dsautomobiles', 'odometer_in_km': 51712}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 49,
     'auction_title': '',
     'c_o_2_emission_value': 138,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:51:05z',
     'fuel_type': 'petrol',
     'id': 'e932a00e-f95f-53ca-acd5-0e25cd54a794',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fc62857',
     'listing': 'auction',
     'location': 'fr, marly-la-ville',
     'make': 'ds automobiles',
     'make_model': 'ds automobiles ds3 crossback',
     'model': 'ds3 crossback',
     'odometer': 51712,
     'odometer_in_km': 51712,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-12-28',
     'sanitized_make': 'dsautomobiles',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ds automobiles ds3 crossback 1.2 puretech inès de la '
              'fressange',
     'transmission': 'automatic',
     'trim': 'inès de la fressange',
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:51:05Z',
 'fuel_type': 'petrol',
 'id': 'e932a00e-f95f-53ca-acd5-0e25cd54a794',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC62857',
 'listing': 'auction',
 'location': 'FR, Marly-la-ville',
 'make': 'DS Automobiles',
 'model': 'DS3 Crossback',
 'odometer': 51712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS Automobiles DS3 Crossback 1.2 PureTech Inès de la Fressange',
 'transmission': 'automatic',
 'trim': 'Inès de la Fressange',
 'year': 2021}
2026-01-29 06:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FC62857%27 HTTP/1.1" 200 None
2026-01-29 06:04:40 [auto1.fr] INFO: Saving data for FC62857: {'auction_closing_time': 1769705465.0, 'created_time': 1768064802.039333, 'last_price_update_time': 1769666680.700929}
2026-01-29 06:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FC62857') HTTP/1.1" 204 0
2026-01-29 06:04:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3bd199e3-6406-5883-aabd-b5e1e5062504 with identifier: BC02724
2026-01-29 06:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3bd199e3-6406-5883-aabd-b5e1e5062504 with identifier: BC02724
2026-01-29 06:04:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3bd199e3-6406-5883-aabd-b5e1e5062504 with identifier: BC02724 to the API
2026-01-29 06:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:04:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:04:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BC02724>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:17:52Z',
 'fuel_type': 'petrol',
 'id': '3bd199e3-6406-5883-aabd-b5e1e5062504',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC02724',
 'listing': 'auction',
 'location': 'FR, MOUGINS',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 92692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-25',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.3 TCe Energy Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2019}
2026-01-29 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BC02724%27 HTTP/1.1" 200 None
2026-01-29 06:04:41 [auto1.fr] INFO: Saving data for BC02724: {'auction_closing_time': 1769703472.0, 'created_time': 1767074549.702421, 'last_price_update_time': 1769666681.014196}
2026-01-29 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BC02724') HTTP/1.1" 204 0
2026-01-29 06:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PK72949/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AV14620/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YT22653/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VG58569/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZK61192> (referer: https://www.auto1.com/v1/car-details-view/ZK61192/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:41 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:04:41 [auto1.fr] INFO: Found listing with ID: JM14902
2026-01-29 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JM14902%27 HTTP/1.1" 200 None
2026-01-29 06:04:41 [auto1.fr] INFO: Scrape type for JM14902: 2
2026-01-29 06:04:41 [auto1.fr] INFO: Found listing with ID: GP21596
2026-01-29 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GP21596%27 HTTP/1.1" 200 None
2026-01-29 06:04:41 [auto1.fr] INFO: Scrape type for GP21596: 0
2026-01-29 06:04:41 [auto1.fr] INFO: Found listing with ID: UX67190
2026-01-29 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UX67190%27 HTTP/1.1" 200 None
2026-01-29 06:04:41 [auto1.fr] INFO: Scrape type for UX67190: 2
2026-01-29 06:04:41 [auto1.fr] INFO: Found listing with ID: NZ28607
2026-01-29 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NZ28607%27 HTTP/1.1" 200 None
2026-01-29 06:04:41 [auto1.fr] INFO: Scrape type for NZ28607: 2
2026-01-29 06:04:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40d2c69f-800f-58c6-ba0a-d7f143182de3 with identifier: ZK61192
2026-01-29 06:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40d2c69f-800f-58c6-ba0a-d7f143182de3 with scrape type 2
2026-01-29 06:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40d2c69f-800f-58c6-ba0a-d7f143182de3 with scrape type 2
2026-01-29 06:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 40d2c69f-800f-58c6-ba0a-d7f143182de3, identifier: ZK61192
2026-01-29 06:04:42 [auto1.fr] INFO: Found listing with ID: BC93991
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BC93991%27 HTTP/1.1" 200 None
2026-01-29 06:04:42 [auto1.fr] INFO: Scrape type for BC93991: 2
2026-01-29 06:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 40d2c69f-800f-58c6-ba0a-d7f143182de3 with identifier: ZK61192
2026-01-29 06:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 40d2c69f-800f-58c6-ba0a-d7f143182de3 with identifier: ZK61192
2026-01-29 06:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 133970, 'odometer_reading_unit': 'km', 'registration_date': '2017-10-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zk61192', 'expiration_date': '2026-01-29t16:03:22z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, escaudain', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 99, 'id': '40d2c69f-800f-58c6-ba0a-d7f143182de3', 'current_year_diff': 9, 'age_in_months': 98, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 133970}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 98,
     'auction_title': '',
     'c_o_2_emission_value': 99,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:03:22z',
     'fuel_type': 'petrol',
     'id': '40d2c69f-800f-58c6-ba0a-d7f143182de3',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zk61192',
     'listing': 'auction',
     'location': 'fr, escaudain',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 133970,
     'odometer_in_km': 133970,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-10-30',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2017}
2026-01-29 06:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 40d2c69f-800f-58c6-ba0a-d7f143182de3 spider: auto1.fr
2026-01-29 06:04:42 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 40d2c69f-800f-58c6-ba0a-d7f143182de3 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 133970, 'odometer_reading_unit': 'km', 'registration_date': '2017-10-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zk61192', 'expiration_date': '2026-01-29t16:03:22z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, escaudain', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 99, 'id': '40d2c69f-800f-58c6-ba0a-d7f143182de3', 'current_year_diff': 9, 'age_in_months': 98, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 133970}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 98,
     'auction_title': '',
     'c_o_2_emission_value': 99,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:03:22z',
     'fuel_type': 'petrol',
     'id': '40d2c69f-800f-58c6-ba0a-d7f143182de3',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zk61192',
     'listing': 'auction',
     'location': 'fr, escaudain',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 133970,
     'odometer_in_km': 133970,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-10-30',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:03:22Z',
 'fuel_type': 'petrol',
 'id': '40d2c69f-800f-58c6-ba0a-d7f143182de3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK61192',
 'listing': 'auction',
 'location': 'FR, Escaudain',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 133970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2017}
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZK61192%27 HTTP/1.1" 200 None
2026-01-29 06:04:42 [auto1.fr] INFO: Saving data for ZK61192: {'auction_closing_time': 1769702602.0, 'created_time': 1769534655.333592, 'last_price_update_time': 1769666682.215519}
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZK61192') HTTP/1.1" 204 0
2026-01-29 06:04:42 [auto1.fr] INFO: Found listing with ID: ZF74059
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZF74059%27 HTTP/1.1" 200 None
2026-01-29 06:04:42 [auto1.fr] INFO: Scrape type for ZF74059: 0
2026-01-29 06:04:42 [auto1.fr] INFO: Found listing with ID: HH87516
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HH87516%27 HTTP/1.1" 200 None
2026-01-29 06:04:42 [auto1.fr] INFO: Scrape type for HH87516: 0
2026-01-29 06:04:42 [auto1.fr] INFO: Found listing with ID: TN67980
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TN67980%27 HTTP/1.1" 200 None
2026-01-29 06:04:42 [auto1.fr] INFO: Scrape type for TN67980: 0
2026-01-29 06:04:42 [auto1.fr] INFO: Found listing with ID: TN55425
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TN55425%27 HTTP/1.1" 200 None
2026-01-29 06:04:42 [auto1.fr] INFO: Scrape type for TN55425: 0
2026-01-29 06:04:42 [auto1.fr] INFO: Found listing with ID: VM61175
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VM61175%27 HTTP/1.1" 200 None
2026-01-29 06:04:42 [auto1.fr] INFO: Scrape type for VM61175: 0
2026-01-29 06:04:42 [auto1.fr] INFO: Found listing with ID: DH74043
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DH74043%27 HTTP/1.1" 200 None
2026-01-29 06:04:42 [auto1.fr] INFO: Scrape type for DH74043: 0
2026-01-29 06:04:42 [auto1.fr] INFO: Found listing with ID: FU78933
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FU78933%27 HTTP/1.1" 200 None
2026-01-29 06:04:42 [auto1.fr] INFO: Scrape type for FU78933: 2
2026-01-29 06:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KB26391/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FK82779> (referer: https://www.auto1.com/v1/car-details-view/FK82779/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HA77616> (referer: https://www.auto1.com/v1/car-details-view/HA77616/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DU31055/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:42 [auto1.fr] INFO: Found listing with ID: EW12885
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW12885%27 HTTP/1.1" 200 None
2026-01-29 06:04:42 [auto1.fr] INFO: Scrape type for EW12885: 2
2026-01-29 06:04:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:42 [auto1.fr] INFO: Found listing with ID: LN85292
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LN85292%27 HTTP/1.1" 200 None
2026-01-29 06:04:42 [auto1.fr] INFO: Scrape type for LN85292: 0
2026-01-29 06:04:42 [auto1.fr] INFO: Found listing with ID: DN66808
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DN66808%27 HTTP/1.1" 200 None
2026-01-29 06:04:42 [auto1.fr] INFO: Scrape type for DN66808: 2
2026-01-29 06:04:42 [auto1.fr] INFO: Found listing with ID: KM59159
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KM59159%27 HTTP/1.1" 200 None
2026-01-29 06:04:42 [auto1.fr] INFO: Scrape type for KM59159: 0
2026-01-29 06:04:42 [auto1.fr] INFO: Found listing with ID: TT93520
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TT93520%27 HTTP/1.1" 200 None
2026-01-29 06:04:42 [auto1.fr] INFO: Scrape type for TT93520: 2
2026-01-29 06:04:42 [auto1.fr] INFO: Found listing with ID: PK47381
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PK47381%27 HTTP/1.1" 200 None
2026-01-29 06:04:42 [auto1.fr] INFO: Scrape type for PK47381: 2
2026-01-29 06:04:42 [auto1.fr] INFO: Found listing with ID: HA19372
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HA19372%27 HTTP/1.1" 200 None
2026-01-29 06:04:42 [auto1.fr] INFO: Scrape type for HA19372: 0
2026-01-29 06:04:42 [auto1.fr] INFO: Found listing with ID: FL36266
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FL36266%27 HTTP/1.1" 200 None
2026-01-29 06:04:42 [auto1.fr] INFO: Scrape type for FL36266: 0
2026-01-29 06:04:42 [auto1.fr] INFO: Found listing with ID: FN17085
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FN17085%27 HTTP/1.1" 200 None
2026-01-29 06:04:42 [auto1.fr] INFO: Scrape type for FN17085: 0
2026-01-29 06:04:42 [auto1.fr] INFO: Found listing with ID: HS67954
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HS67954%27 HTTP/1.1" 200 None
2026-01-29 06:04:42 [auto1.fr] INFO: Scrape type for HS67954: 0
2026-01-29 06:04:42 [auto1.fr] INFO: Found listing with ID: KC93823
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KC93823%27 HTTP/1.1" 200 None
2026-01-29 06:04:42 [auto1.fr] INFO: Scrape type for KC93823: 2
2026-01-29 06:04:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f2f5693-afb2-5dbf-832c-781ef23b0824 with identifier: FK82779
2026-01-29 06:04:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f2f5693-afb2-5dbf-832c-781ef23b0824 with scrape type 2
2026-01-29 06:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f2f5693-afb2-5dbf-832c-781ef23b0824 with scrape type 2
2026-01-29 06:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1f2f5693-afb2-5dbf-832c-781ef23b0824, identifier: FK82779
2026-01-29 06:04:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d9b67d0-e0c0-57ce-a0ba-e998b09ca004 with identifier: HA77616
2026-01-29 06:04:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d9b67d0-e0c0-57ce-a0ba-e998b09ca004 with scrape type 2
2026-01-29 06:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d9b67d0-e0c0-57ce-a0ba-e998b09ca004 with scrape type 2
2026-01-29 06:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2d9b67d0-e0c0-57ce-a0ba-e998b09ca004, identifier: HA77616
2026-01-29 06:04:42 [auto1.fr] INFO: Found listing with ID: EE38454
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EE38454%27 HTTP/1.1" 200 None
2026-01-29 06:04:42 [auto1.fr] INFO: Scrape type for EE38454: 0
2026-01-29 06:04:42 [auto1.fr] INFO: Found listing with ID: KU40350
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KU40350%27 HTTP/1.1" 200 None
2026-01-29 06:04:42 [auto1.fr] INFO: Scrape type for KU40350: 2
2026-01-29 06:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1f2f5693-afb2-5dbf-832c-781ef23b0824 with identifier: FK82779
2026-01-29 06:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1f2f5693-afb2-5dbf-832c-781ef23b0824 with identifier: FK82779
2026-01-29 06:04:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1f2f5693-afb2-5dbf-832c-781ef23b0824 with identifier: FK82779 to the API
2026-01-29 06:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:04:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:04:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FK82779>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:12:11Z',
 'fuel_type': 'diesel',
 'id': '1f2f5693-afb2-5dbf-832c-781ef23b0824',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK82779',
 'listing': 'auction',
 'location': 'FR, Houecourt',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 100518,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.5 Blue-HDi Active Auto-Ecole',
 'transmission': 'manual',
 'trim': 'Active Auto-Ecole',
 'year': 2022}
2026-01-29 06:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FK82779%27 HTTP/1.1" 200 None
2026-01-29 06:04:43 [auto1.fr] INFO: Saving data for FK82779: {'auction_closing_time': 1769703131.0, 'created_time': 1768809644.371483, 'last_price_update_time': 1769666683.122428}
2026-01-29 06:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FK82779') HTTP/1.1" 204 0
2026-01-29 06:04:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2d9b67d0-e0c0-57ce-a0ba-e998b09ca004 with identifier: HA77616
2026-01-29 06:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2d9b67d0-e0c0-57ce-a0ba-e998b09ca004 with identifier: HA77616
2026-01-29 06:04:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2d9b67d0-e0c0-57ce-a0ba-e998b09ca004 with identifier: HA77616 to the API
2026-01-29 06:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:04:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:04:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HA77616>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:06:41Z',
 'fuel_type': 'petrol',
 'id': '2d9b67d0-e0c0-57ce-a0ba-e998b09ca004',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA77616',
 'listing': 'auction',
 'location': 'FR',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 126733,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Karoq 1.5 TSI ACT Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2020}
2026-01-29 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HA77616%27 HTTP/1.1" 200 None
2026-01-29 06:04:44 [auto1.fr] INFO: Saving data for HA77616: {'auction_closing_time': 1769702801.0, 'created_time': 1768928894.152059, 'last_price_update_time': 1769666684.011981}
2026-01-29 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HA77616') HTTP/1.1" 204 0
2026-01-29 06:04:44 [auto1.fr] INFO: Found listing with ID: WU41155
2026-01-29 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU41155%27 HTTP/1.1" 200 None
2026-01-29 06:04:44 [auto1.fr] INFO: Scrape type for WU41155: 2
2026-01-29 06:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NL71749/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BK42255/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KV24028/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JU93355/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:44 [auto1.fr] INFO: Found listing with ID: KU89206
2026-01-29 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KU89206%27 HTTP/1.1" 200 None
2026-01-29 06:04:44 [auto1.fr] INFO: Scrape type for KU89206: 0
2026-01-29 06:04:44 [auto1.fr] INFO: Found listing with ID: HP38730
2026-01-29 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HP38730%27 HTTP/1.1" 200 None
2026-01-29 06:04:44 [auto1.fr] INFO: Scrape type for HP38730: 0
2026-01-29 06:04:44 [auto1.fr] INFO: Found listing with ID: BT95513
2026-01-29 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BT95513%27 HTTP/1.1" 200 None
2026-01-29 06:04:44 [auto1.fr] INFO: Scrape type for BT95513: 0
2026-01-29 06:04:44 [auto1.fr] INFO: Found listing with ID: EU05025
2026-01-29 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EU05025%27 HTTP/1.1" 200 None
2026-01-29 06:04:44 [auto1.fr] INFO: Scrape type for EU05025: 0
2026-01-29 06:04:44 [auto1.fr] INFO: Found listing with ID: BR39793
2026-01-29 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BR39793%27 HTTP/1.1" 200 None
2026-01-29 06:04:44 [auto1.fr] INFO: Scrape type for BR39793: 2
2026-01-29 06:04:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:44 [auto1.fr] INFO: Found listing with ID: EG37469
2026-01-29 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EG37469%27 HTTP/1.1" 200 None
2026-01-29 06:04:44 [auto1.fr] INFO: Scrape type for EG37469: 2
2026-01-29 06:04:44 [auto1.fr] INFO: Found listing with ID: FD56672
2026-01-29 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FD56672%27 HTTP/1.1" 200 None
2026-01-29 06:04:44 [auto1.fr] INFO: Scrape type for FD56672: 0
2026-01-29 06:04:44 [auto1.fr] INFO: Found listing with ID: ZV05776
2026-01-29 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZV05776%27 HTTP/1.1" 200 None
2026-01-29 06:04:44 [auto1.fr] INFO: Scrape type for ZV05776: 2
2026-01-29 06:04:44 [auto1.fr] INFO: Found listing with ID: CH13915
2026-01-29 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CH13915%27 HTTP/1.1" 200 None
2026-01-29 06:04:44 [auto1.fr] INFO: Scrape type for CH13915: 0
2026-01-29 06:04:44 [auto1.fr] INFO: Found listing with ID: NE09859
2026-01-29 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NE09859%27 HTTP/1.1" 200 None
2026-01-29 06:04:44 [auto1.fr] INFO: Scrape type for NE09859: 0
2026-01-29 06:04:44 [auto1.fr] INFO: Found listing with ID: XA02351
2026-01-29 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XA02351%27 HTTP/1.1" 200 None
2026-01-29 06:04:44 [auto1.fr] INFO: Scrape type for XA02351: 2
2026-01-29 06:04:44 [auto1.fr] INFO: Found listing with ID: CZ75211
2026-01-29 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CZ75211%27 HTTP/1.1" 200 None
2026-01-29 06:04:44 [auto1.fr] INFO: Scrape type for CZ75211: 0
2026-01-29 06:04:44 [auto1.fr] INFO: Found listing with ID: SS53516
2026-01-29 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SS53516%27 HTTP/1.1" 200 None
2026-01-29 06:04:44 [auto1.fr] INFO: Scrape type for SS53516: 0
2026-01-29 06:04:44 [auto1.fr] INFO: Found listing with ID: HH86127
2026-01-29 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HH86127%27 HTTP/1.1" 200 None
2026-01-29 06:04:44 [auto1.fr] INFO: Scrape type for HH86127: 0
2026-01-29 06:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PK72949> (referer: https://www.auto1.com/v1/car-details-view/PK72949/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PM66724> (referer: https://www.auto1.com/v1/car-details-view/PM66724/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TW73591/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JJ45702/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41d233e3-b62c-5135-8b2a-9f6f356bd5d2 with identifier: PK72949
2026-01-29 06:04:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41d233e3-b62c-5135-8b2a-9f6f356bd5d2 with scrape type 2
2026-01-29 06:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41d233e3-b62c-5135-8b2a-9f6f356bd5d2 with scrape type 2
2026-01-29 06:04:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 41d233e3-b62c-5135-8b2a-9f6f356bd5d2, identifier: PK72949
2026-01-29 06:04:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 41d233e3-b62c-5135-8b2a-9f6f356bd5d2 with identifier: PK72949
2026-01-29 06:04:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 41d233e3-b62c-5135-8b2a-9f6f356bd5d2 with identifier: PK72949
2026-01-29 06:04:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 41d233e3-b62c-5135-8b2a-9f6f356bd5d2 with identifier: PK72949 to the API
2026-01-29 06:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:04:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:04:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PK72949>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 230,
 'expiration_date': '2026-01-29T16:05:17Z',
 'fuel_type': 'hybrid',
 'id': '41d233e3-b62c-5135-8b2a-9f6f356bd5d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK72949',
 'listing': 'auction',
 'location': 'FR',
 'make': 'Hyundai',
 'model': 'Santa Fe',
 'odometer': 131076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-09-19',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Hyundai Santa Fe 1.6 T-GDI Hybrid Creative 2WD',
 'transmission': 'automatic',
 'trim': 'Creative 2WD',
 'year': 2023}
2026-01-29 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PK72949%27 HTTP/1.1" 200 None
2026-01-29 06:04:46 [auto1.fr] INFO: Saving data for PK72949: {'auction_closing_time': 1769702717.0, 'created_time': 1768929098.648891, 'last_price_update_time': 1769666686.502645}
2026-01-29 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PK72949') HTTP/1.1" 204 0
2026-01-29 06:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AV14620> (referer: https://www.auto1.com/v1/car-details-view/AV14620/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CX82590/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LL77312/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YT22653> (referer: https://www.auto1.com/v1/car-details-view/YT22653/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dded9f4-db77-5631-9233-27e94be87472 with identifier: PM66724
2026-01-29 06:04:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dded9f4-db77-5631-9233-27e94be87472 with scrape type 2
2026-01-29 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0dded9f4-db77-5631-9233-27e94be87472 with scrape type 2
2026-01-29 06:04:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0dded9f4-db77-5631-9233-27e94be87472, identifier: PM66724
2026-01-29 06:04:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0dded9f4-db77-5631-9233-27e94be87472 with identifier: PM66724
2026-01-29 06:04:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0dded9f4-db77-5631-9233-27e94be87472 with identifier: PM66724
2026-01-29 06:04:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0dded9f4-db77-5631-9233-27e94be87472 with identifier: PM66724 to the API
2026-01-29 06:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:04:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:04:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PM66724>
{'auction_title': '',
 'c_o_2_emission_value': 177,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 200,
 'expiration_date': '2026-01-29T16:41:20Z',
 'fuel_type': 'diesel',
 'id': '0dded9f4-db77-5631-9233-27e94be87472',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM66724',
 'listing': 'auction',
 'location': 'FR, Quincieux',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 79575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 Sportback 40 TDI quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2021}
2026-01-29 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PM66724%27 HTTP/1.1" 200 None
2026-01-29 06:04:47 [auto1.fr] INFO: Saving data for PM66724: {'auction_closing_time': 1769704880.0, 'created_time': 1769015433.015882, 'last_price_update_time': 1769666687.03985}
2026-01-29 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PM66724') HTTP/1.1" 204 0
2026-01-29 06:04:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd998893-12e4-5bcf-ad87-c339858c7cb6 with identifier: AV14620
2026-01-29 06:04:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd998893-12e4-5bcf-ad87-c339858c7cb6 with scrape type 2
2026-01-29 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd998893-12e4-5bcf-ad87-c339858c7cb6 with scrape type 2
2026-01-29 06:04:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fd998893-12e4-5bcf-ad87-c339858c7cb6, identifier: AV14620
2026-01-29 06:04:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7af3214-1b79-55fc-9283-7955795e6de7 with identifier: YT22653
2026-01-29 06:04:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7af3214-1b79-55fc-9283-7955795e6de7 with scrape type 2
2026-01-29 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7af3214-1b79-55fc-9283-7955795e6de7 with scrape type 2
2026-01-29 06:04:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f7af3214-1b79-55fc-9283-7955795e6de7, identifier: YT22653
2026-01-29 06:04:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fd998893-12e4-5bcf-ad87-c339858c7cb6 with identifier: AV14620
2026-01-29 06:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fd998893-12e4-5bcf-ad87-c339858c7cb6 with identifier: AV14620
2026-01-29 06:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 140527 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    140527
2026-01-29 06:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: fd998893-12e4-5bcf-ad87-c339858c7cb6 spider: auto1.fr
2026-01-29 06:04:47 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: fd998893-12e4-5bcf-ad87-c339858c7cb6 due to rule: high_mileage_for_make.json, error: 140527 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    140527
{'auction_title': '',
 'c_o_2_emission_value': 84,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:04:57Z',
 'fuel_type': 'diesel',
 'id': 'fd998893-12e4-5bcf-ad87-c339858c7cb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV14620',
 'listing': 'auction',
 'location': 'FR, Marckolsheim',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 140527,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2017}
2026-01-29 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV14620%27 HTTP/1.1" 200 None
2026-01-29 06:04:47 [auto1.fr] INFO: Saving data for AV14620: {'auction_closing_time': 1769702697.0, 'created_time': 1769533913.940776, 'last_price_update_time': 1769666687.472389}
2026-01-29 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AV14620') HTTP/1.1" 204 0
2026-01-29 06:04:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f7af3214-1b79-55fc-9283-7955795e6de7 with identifier: YT22653
2026-01-29 06:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f7af3214-1b79-55fc-9283-7955795e6de7 with identifier: YT22653
2026-01-29 06:04:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f7af3214-1b79-55fc-9283-7955795e6de7 with identifier: YT22653 to the API
2026-01-29 06:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:04:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:04:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YT22653>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 265,
 'expiration_date': '2026-01-29T16:56:05Z',
 'fuel_type': 'hybrid',
 'id': 'f7af3214-1b79-55fc-9283-7955795e6de7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT22653',
 'listing': 'auction',
 'location': 'FR, Ingrandes sur Vienne',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 90716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Plug-in Hybrid N Line Executive 4WD',
 'transmission': 'automatic',
 'trim': 'N Line Executive 4WD',
 'year': 2022}
2026-01-29 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YT22653%27 HTTP/1.1" 200 None
2026-01-29 06:04:47 [auto1.fr] INFO: Saving data for YT22653: {'auction_closing_time': 1769705765.0, 'created_time': 1769446995.065147, 'last_price_update_time': 1769666687.799554}
2026-01-29 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YT22653') HTTP/1.1" 204 0
2026-01-29 06:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BC93991/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UX67190/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FU78933/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NZ28607/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KU40350/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WU41155/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KB26391> (referer: https://www.auto1.com/v1/car-details-view/KB26391/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DU31055> (referer: https://www.auto1.com/v1/car-details-view/DU31055/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de7f9e93-2e87-5b07-8dd2-6bc75424c5b5 with identifier: KB26391
2026-01-29 06:04:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de7f9e93-2e87-5b07-8dd2-6bc75424c5b5 with scrape type 2
2026-01-29 06:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de7f9e93-2e87-5b07-8dd2-6bc75424c5b5 with scrape type 2
2026-01-29 06:04:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: de7f9e93-2e87-5b07-8dd2-6bc75424c5b5, identifier: KB26391
2026-01-29 06:04:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: de7f9e93-2e87-5b07-8dd2-6bc75424c5b5 with identifier: KB26391
2026-01-29 06:04:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: de7f9e93-2e87-5b07-8dd2-6bc75424c5b5 with identifier: KB26391
2026-01-29 06:04:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 176082 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    176082
2026-01-29 06:04:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: de7f9e93-2e87-5b07-8dd2-6bc75424c5b5 spider: auto1.fr
2026-01-29 06:04:49 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: de7f9e93-2e87-5b07-8dd2-6bc75424c5b5 due to rule: high_mileage_for_country.json, error: 176082 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    176082
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:07:42Z',
 'fuel_type': 'diesel',
 'id': 'de7f9e93-2e87-5b07-8dd2-6bc75424c5b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB26391',
 'listing': 'auction',
 'location': 'FR, Saint-Avé',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 176082,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 Turbodiesel N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2018}
2026-01-29 06:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KB26391%27 HTTP/1.1" 200 None
2026-01-29 06:04:49 [auto1.fr] INFO: Saving data for KB26391: {'auction_closing_time': 1769702862.0, 'created_time': 1769534584.094591, 'last_price_update_time': 1769666689.117342}
2026-01-29 06:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KB26391') HTTP/1.1" 204 0
2026-01-29 06:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JU93355> (referer: https://www.auto1.com/v1/car-details-view/JU93355/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KV24028> (referer: https://www.auto1.com/v1/car-details-view/KV24028/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XA02351/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BK42255> (referer: https://www.auto1.com/v1/car-details-view/BK42255/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40ab2d08-9bed-57a9-b378-2d9adeffa8ba with identifier: DU31055
2026-01-29 06:04:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40ab2d08-9bed-57a9-b378-2d9adeffa8ba with scrape type 2
2026-01-29 06:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40ab2d08-9bed-57a9-b378-2d9adeffa8ba with scrape type 2
2026-01-29 06:04:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 40ab2d08-9bed-57a9-b378-2d9adeffa8ba, identifier: DU31055
2026-01-29 06:04:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 40ab2d08-9bed-57a9-b378-2d9adeffa8ba with identifier: DU31055
2026-01-29 06:04:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 40ab2d08-9bed-57a9-b378-2d9adeffa8ba with identifier: DU31055
2026-01-29 06:04:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 40ab2d08-9bed-57a9-b378-2d9adeffa8ba with identifier: DU31055 to the API
2026-01-29 06:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:04:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:04:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DU31055>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 135,
 'expiration_date': '2026-01-29T16:03:26Z',
 'fuel_type': 'diesel',
 'id': '40ab2d08-9bed-57a9-b378-2d9adeffa8ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU31055',
 'listing': 'auction',
 'location': 'FR, Coudekerque-Branche',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 55810,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 Shooting Brake AMG Line',
 'transmission': 'manual',
 'trim': 'AMG Line',
 'year': 2019}
2026-01-29 06:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DU31055%27 HTTP/1.1" 200 None
2026-01-29 06:04:49 [auto1.fr] INFO: Saving data for DU31055: {'auction_closing_time': 1769702606.0, 'created_time': 1769580126.376766, 'last_price_update_time': 1769666689.58789}
2026-01-29 06:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DU31055') HTTP/1.1" 204 0
2026-01-29 06:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NL71749> (referer: https://www.auto1.com/v1/car-details-view/NL71749/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fe29cec-22c2-58e8-acdd-7deaeb4f8a9c with identifier: JU93355
2026-01-29 06:04:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fe29cec-22c2-58e8-acdd-7deaeb4f8a9c with scrape type 2
2026-01-29 06:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fe29cec-22c2-58e8-acdd-7deaeb4f8a9c with scrape type 2
2026-01-29 06:04:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3fe29cec-22c2-58e8-acdd-7deaeb4f8a9c, identifier: JU93355
2026-01-29 06:04:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79fcd795-8000-5466-a4cb-a2bdea4e22e2 with identifier: KV24028
2026-01-29 06:04:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79fcd795-8000-5466-a4cb-a2bdea4e22e2 with scrape type 2
2026-01-29 06:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79fcd795-8000-5466-a4cb-a2bdea4e22e2 with scrape type 2
2026-01-29 06:04:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 79fcd795-8000-5466-a4cb-a2bdea4e22e2, identifier: KV24028
2026-01-29 06:04:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24e74bab-d85f-56d2-a137-c66a0588f29e with identifier: BK42255
2026-01-29 06:04:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24e74bab-d85f-56d2-a137-c66a0588f29e with scrape type 2
2026-01-29 06:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24e74bab-d85f-56d2-a137-c66a0588f29e with scrape type 2
2026-01-29 06:04:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 24e74bab-d85f-56d2-a137-c66a0588f29e, identifier: BK42255
2026-01-29 06:04:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3fe29cec-22c2-58e8-acdd-7deaeb4f8a9c with identifier: JU93355
2026-01-29 06:04:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3fe29cec-22c2-58e8-acdd-7deaeb4f8a9c with identifier: JU93355
2026-01-29 06:04:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 136824 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    136824
2026-01-29 06:04:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 3fe29cec-22c2-58e8-acdd-7deaeb4f8a9c spider: auto1.fr
2026-01-29 06:04:50 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 3fe29cec-22c2-58e8-acdd-7deaeb4f8a9c due to rule: high_mileage_for_make.json, error: 136824 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    136824
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:35:50Z',
 'fuel_type': 'petrol',
 'id': '3fe29cec-22c2-58e8-acdd-7deaeb4f8a9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU93355',
 'listing': 'auction',
 'location': 'FR, Saint-Léonard',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 136824,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.0 TCe Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2019}
2026-01-29 06:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JU93355%27 HTTP/1.1" 200 None
2026-01-29 06:04:50 [auto1.fr] INFO: Saving data for JU93355: {'auction_closing_time': 1769704550.0, 'created_time': 1769533648.862979, 'last_price_update_time': 1769666690.178447}
2026-01-29 06:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JU93355') HTTP/1.1" 204 0
2026-01-29 06:04:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 79fcd795-8000-5466-a4cb-a2bdea4e22e2 with identifier: KV24028
2026-01-29 06:04:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 79fcd795-8000-5466-a4cb-a2bdea4e22e2 with identifier: KV24028
2026-01-29 06:04:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 51989, 'odometer_reading_unit': 'km', 'registration_date': '2020-12-02', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kv24028', 'expiration_date': '2026-01-29t16:36:49z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, villenoy', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 139, 'id': '79fcd795-8000-5466-a4cb-a2bdea4e22e2', 'current_year_diff': 6, 'age_in_months': 61, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 51989}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 61,
     'auction_title': '',
     'c_o_2_emission_value': 139,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:36:49z',
     'fuel_type': 'petrol',
     'id': '79fcd795-8000-5466-a4cb-a2bdea4e22e2',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kv24028',
     'listing': 'auction',
     'location': 'fr, villenoy',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 51989,
     'odometer_in_km': 51989,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-12-02',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech gt line',
     'transmission': 'automatic',
     'trim': 'gt line',
     'year': 2020}
2026-01-29 06:04:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 79fcd795-8000-5466-a4cb-a2bdea4e22e2 spider: auto1.fr
2026-01-29 06:04:50 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 79fcd795-8000-5466-a4cb-a2bdea4e22e2 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 51989, 'odometer_reading_unit': 'km', 'registration_date': '2020-12-02', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kv24028', 'expiration_date': '2026-01-29t16:36:49z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, villenoy', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 139, 'id': '79fcd795-8000-5466-a4cb-a2bdea4e22e2', 'current_year_diff': 6, 'age_in_months': 61, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 51989}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 61,
     'auction_title': '',
     'c_o_2_emission_value': 139,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:36:49z',
     'fuel_type': 'petrol',
     'id': '79fcd795-8000-5466-a4cb-a2bdea4e22e2',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kv24028',
     'listing': 'auction',
     'location': 'fr, villenoy',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 51989,
     'odometer_in_km': 51989,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-12-02',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech gt line',
     'transmission': 'automatic',
     'trim': 'gt line',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:36:49Z',
 'fuel_type': 'petrol',
 'id': '79fcd795-8000-5466-a4cb-a2bdea4e22e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV24028',
 'listing': 'auction',
 'location': 'FR, Villenoy',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 51989,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2020}
2026-01-29 06:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV24028%27 HTTP/1.1" 200 None
2026-01-29 06:04:50 [auto1.fr] INFO: Saving data for KV24028: {'auction_closing_time': 1769704609.0, 'created_time': 1769533469.476901, 'last_price_update_time': 1769666690.4083}
2026-01-29 06:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KV24028') HTTP/1.1" 204 0
2026-01-29 06:04:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 24e74bab-d85f-56d2-a137-c66a0588f29e with identifier: BK42255
2026-01-29 06:04:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 24e74bab-d85f-56d2-a137-c66a0588f29e with identifier: BK42255
2026-01-29 06:04:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 24e74bab-d85f-56d2-a137-c66a0588f29e with identifier: BK42255 to the API
2026-01-29 06:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:04:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:04:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BK42255>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:22:38Z',
 'fuel_type': 'diesel',
 'id': '24e74bab-d85f-56d2-a137-c66a0588f29e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK42255',
 'listing': 'auction',
 'location': 'FR, Villenoy',
 'make': 'BMW',
 'model': '4er',
 'odometer': 125132,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 4er 420d Gran Coupé xDrive Advantage',
 'transmission': 'automatic',
 'trim': 'xDrive Advantage',
 'year': 2018}
2026-01-29 06:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BK42255%27 HTTP/1.1" 200 None
2026-01-29 06:04:50 [auto1.fr] INFO: Saving data for BK42255: {'auction_closing_time': 1769703758.0, 'created_time': 1769533542.72136, 'last_price_update_time': 1769666690.734859}
2026-01-29 06:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BK42255') HTTP/1.1" 204 0
2026-01-29 06:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZV05776/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BR39793/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EG37469/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2080425e-c4e4-58ec-9f32-8f0f2a8b0fb1 with identifier: NL71749
2026-01-29 06:04:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2080425e-c4e4-58ec-9f32-8f0f2a8b0fb1 with scrape type 2
2026-01-29 06:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2080425e-c4e4-58ec-9f32-8f0f2a8b0fb1 with scrape type 2
2026-01-29 06:04:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2080425e-c4e4-58ec-9f32-8f0f2a8b0fb1, identifier: NL71749
2026-01-29 06:04:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2080425e-c4e4-58ec-9f32-8f0f2a8b0fb1 with identifier: NL71749
2026-01-29 06:04:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2080425e-c4e4-58ec-9f32-8f0f2a8b0fb1 with identifier: NL71749
2026-01-29 06:04:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine pack', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 22722, 'odometer_reading_unit': 'km', 'registration_date': '2022-03-15', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nl71749', 'expiration_date': '2026-01-29t16:37:26z', 'origin_country_code': 'fr', 'trim': 'shine pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 123, 'id': '2080425e-c4e4-58ec-9f32-8f0f2a8b0fb1', 'current_year_diff': 4, 'age_in_months': 46, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 22722}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 46,
     'auction_title': '',
     'c_o_2_emission_value': 123,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:37:26z',
     'fuel_type': 'petrol',
     'id': '2080425e-c4e4-58ec-9f32-8f0f2a8b0fb1',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nl71749',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 22722,
     'odometer_in_km': 22722,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-03-15',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech shine pack',
     'transmission': 'manual',
     'trim': 'shine pack',
     'year': 2022}
2026-01-29 06:04:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 2080425e-c4e4-58ec-9f32-8f0f2a8b0fb1 spider: auto1.fr
2026-01-29 06:04:51 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 2080425e-c4e4-58ec-9f32-8f0f2a8b0fb1 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine pack', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 22722, 'odometer_reading_unit': 'km', 'registration_date': '2022-03-15', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nl71749', 'expiration_date': '2026-01-29t16:37:26z', 'origin_country_code': 'fr', 'trim': 'shine pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 123, 'id': '2080425e-c4e4-58ec-9f32-8f0f2a8b0fb1', 'current_year_diff': 4, 'age_in_months': 46, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 22722}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 46,
     'auction_title': '',
     'c_o_2_emission_value': 123,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:37:26z',
     'fuel_type': 'petrol',
     'id': '2080425e-c4e4-58ec-9f32-8f0f2a8b0fb1',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nl71749',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 22722,
     'odometer_in_km': 22722,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-03-15',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech shine pack',
     'transmission': 'manual',
     'trim': 'shine pack',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:37:26Z',
 'fuel_type': 'petrol',
 'id': '2080425e-c4e4-58ec-9f32-8f0f2a8b0fb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL71749',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 22722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Shine Pack',
 'transmission': 'manual',
 'trim': 'Shine Pack',
 'year': 2022}
2026-01-29 06:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NL71749%27 HTTP/1.1" 200 None
2026-01-29 06:04:51 [auto1.fr] INFO: Saving data for NL71749: {'auction_closing_time': 1769704646.0, 'created_time': 1769101331.536091, 'last_price_update_time': 1769666691.110305}
2026-01-29 06:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NL71749') HTTP/1.1" 204 0
2026-01-29 06:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CX82590> (referer: https://www.auto1.com/v1/car-details-view/CX82590/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4c2c341-f98d-5615-af74-4776bf8bb268 with identifier: CX82590
2026-01-29 06:04:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4c2c341-f98d-5615-af74-4776bf8bb268 with scrape type 2
2026-01-29 06:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4c2c341-f98d-5615-af74-4776bf8bb268 with scrape type 2
2026-01-29 06:04:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a4c2c341-f98d-5615-af74-4776bf8bb268, identifier: CX82590
2026-01-29 06:04:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a4c2c341-f98d-5615-af74-4776bf8bb268 with identifier: CX82590
2026-01-29 06:04:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a4c2c341-f98d-5615-af74-4776bf8bb268 with identifier: CX82590
2026-01-29 06:04:52 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 94422, 'odometer_reading_unit': 'km', 'registration_date': '2017-10-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cx82590', 'expiration_date': '2026-01-29t16:10:29z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, vénissieux', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': 'a4c2c341-f98d-5615-af74-4776bf8bb268', 'current_year_diff': 9, 'age_in_months': 99, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 94422}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 99,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:10:29z',
     'fuel_type': 'petrol',
     'id': 'a4c2c341-f98d-5615-af74-4776bf8bb268',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cx82590',
     'listing': 'auction',
     'location': 'fr, vénissieux',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 94422,
     'odometer_in_km': 94422,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-10-24',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2017}
2026-01-29 06:04:52 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: a4c2c341-f98d-5615-af74-4776bf8bb268 spider: auto1.fr
2026-01-29 06:04:52 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: a4c2c341-f98d-5615-af74-4776bf8bb268 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 94422, 'odometer_reading_unit': 'km', 'registration_date': '2017-10-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cx82590', 'expiration_date': '2026-01-29t16:10:29z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, vénissieux', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': 'a4c2c341-f98d-5615-af74-4776bf8bb268', 'current_year_diff': 9, 'age_in_months': 99, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 94422}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 99,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:10:29z',
     'fuel_type': 'petrol',
     'id': 'a4c2c341-f98d-5615-af74-4776bf8bb268',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cx82590',
     'listing': 'auction',
     'location': 'fr, vénissieux',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 94422,
     'odometer_in_km': 94422,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-10-24',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:10:29Z',
 'fuel_type': 'petrol',
 'id': 'a4c2c341-f98d-5615-af74-4776bf8bb268',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX82590',
 'listing': 'auction',
 'location': 'FR, Vénissieux',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 94422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2017}
2026-01-29 06:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CX82590%27 HTTP/1.1" 200 None
2026-01-29 06:04:52 [auto1.fr] INFO: Saving data for CX82590: {'auction_closing_time': 1769703029.0, 'created_time': 1769580121.118628, 'last_price_update_time': 1769666692.146633}
2026-01-29 06:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CX82590') HTTP/1.1" 204 0
2026-01-29 06:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LL77312> (referer: https://www.auto1.com/v1/car-details-view/LL77312/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TW73591> (referer: https://www.auto1.com/v1/car-details-view/TW73591/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NZ28607> (referer: https://www.auto1.com/v1/car-details-view/NZ28607/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JJ45702> (referer: https://www.auto1.com/v1/car-details-view/JJ45702/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WU41155> (referer: https://www.auto1.com/v1/car-details-view/WU41155/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KU40350> (referer: https://www.auto1.com/v1/car-details-view/KU40350/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FU78933> (referer: https://www.auto1.com/v1/car-details-view/FU78933/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2b9ee5c-e91f-57a8-97a7-37d1019d3d16 with identifier: LL77312
2026-01-29 06:04:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2b9ee5c-e91f-57a8-97a7-37d1019d3d16 with scrape type 2
2026-01-29 06:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2b9ee5c-e91f-57a8-97a7-37d1019d3d16 with scrape type 2
2026-01-29 06:04:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c2b9ee5c-e91f-57a8-97a7-37d1019d3d16, identifier: LL77312
2026-01-29 06:04:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c2b9ee5c-e91f-57a8-97a7-37d1019d3d16 with identifier: LL77312
2026-01-29 06:04:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c2b9ee5c-e91f-57a8-97a7-37d1019d3d16 with identifier: LL77312
2026-01-29 06:04:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c2b9ee5c-e91f-57a8-97a7-37d1019d3d16 with identifier: LL77312 to the API
2026-01-29 06:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:04:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:04:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LL77312>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 65,
 'expiration_date': '2026-01-29T16:59:35Z',
 'fuel_type': 'electro',
 'id': 'c2b9ee5c-e91f-57a8-97a7-37d1019d3d16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL77312',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'make': 'Dacia',
 'model': 'Spring',
 'odometer': 6637,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-04-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Dacia Spring electric drive 48 kW Expression',
 'transmission': 'automatic',
 'trim': 'Expression',
 'year': 2025}
2026-01-29 06:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LL77312%27 HTTP/1.1" 200 None
2026-01-29 06:04:54 [auto1.fr] INFO: Saving data for LL77312: {'auction_closing_time': 1769705975.0, 'created_time': 1769533461.118105, 'last_price_update_time': 1769666694.555603}
2026-01-29 06:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LL77312') HTTP/1.1" 204 0
2026-01-29 06:04:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4f14bfc-2ec8-5cb5-ab1b-5d0f9154b681 with identifier: TW73591
2026-01-29 06:04:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4f14bfc-2ec8-5cb5-ab1b-5d0f9154b681 with scrape type 2
2026-01-29 06:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4f14bfc-2ec8-5cb5-ab1b-5d0f9154b681 with scrape type 2
2026-01-29 06:04:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c4f14bfc-2ec8-5cb5-ab1b-5d0f9154b681, identifier: TW73591
2026-01-29 06:04:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d164ebd-2c52-5ad9-91c4-8b86225dee7d with identifier: NZ28607
2026-01-29 06:04:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d164ebd-2c52-5ad9-91c4-8b86225dee7d with scrape type 2
2026-01-29 06:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d164ebd-2c52-5ad9-91c4-8b86225dee7d with scrape type 2
2026-01-29 06:04:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3d164ebd-2c52-5ad9-91c4-8b86225dee7d, identifier: NZ28607
2026-01-29 06:04:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4203e5d9-a3d2-53ca-94d8-199d4811ae45 with identifier: JJ45702
2026-01-29 06:04:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4203e5d9-a3d2-53ca-94d8-199d4811ae45 with scrape type 2
2026-01-29 06:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4203e5d9-a3d2-53ca-94d8-199d4811ae45 with scrape type 2
2026-01-29 06:04:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4203e5d9-a3d2-53ca-94d8-199d4811ae45, identifier: JJ45702
2026-01-29 06:04:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c4f14bfc-2ec8-5cb5-ab1b-5d0f9154b681 with identifier: TW73591
2026-01-29 06:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c4f14bfc-2ec8-5cb5-ab1b-5d0f9154b681 with identifier: TW73591
2026-01-29 06:04:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c4f14bfc-2ec8-5cb5-ab1b-5d0f9154b681 with identifier: TW73591 to the API
2026-01-29 06:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:04:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:04:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TW73591>
{'auction_title': '',
 'c_o_2_emission_value': 30,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 299,
 'expiration_date': '2026-01-29T16:07:46Z',
 'fuel_type': 'hybrid',
 'id': 'c4f14bfc-2ec8-5cb5-ab1b-5d0f9154b681',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW73591',
 'listing': 'auction',
 'location': 'FR, MOUGINS',
 'make': 'DS Automobiles',
 'model': 'DS7 Crossback',
 'odometer': 48048,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS Automobiles DS7 Crossback 1.6 E-Tense Hybrid 4x4 Performance '
          'Line Plus',
 'transmission': 'automatic',
 'trim': '4x4 Performance Line Plus',
 'year': 2020}
2026-01-29 06:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TW73591%27 HTTP/1.1" 200 None
2026-01-29 06:04:55 [auto1.fr] INFO: Saving data for TW73591: {'auction_closing_time': 1769702866.0, 'created_time': 1769450452.633962, 'last_price_update_time': 1769666695.269252}
2026-01-29 06:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TW73591') HTTP/1.1" 204 0
2026-01-29 06:04:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3d164ebd-2c52-5ad9-91c4-8b86225dee7d with identifier: NZ28607
2026-01-29 06:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3d164ebd-2c52-5ad9-91c4-8b86225dee7d with identifier: NZ28607
2026-01-29 06:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo' containing 'kangoo'
2026-01-29 06:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 3d164ebd-2c52-5ad9-91c4-8b86225dee7d spider: auto1.fr
2026-01-29 06:04:55 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 3d164ebd-2c52-5ad9-91c4-8b86225dee7d due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo' containing 'kangoo'
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:24:55Z',
 'fuel_type': 'diesel',
 'id': '3d164ebd-2c52-5ad9-91c4-8b86225dee7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ28607',
 'listing': 'auction',
 'location': 'FR, EU',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 158570,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-18',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 Blue dCi Express Extra Série Spéciale',
 'transmission': 'manual',
 'trim': 'Express Extra Série Spéciale',
 'year': 2020}
2026-01-29 06:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NZ28607%27 HTTP/1.1" 200 None
2026-01-29 06:04:55 [auto1.fr] INFO: Saving data for NZ28607: {'auction_closing_time': 1769703895.0, 'created_time': 1769533813.201379, 'last_price_update_time': 1769666695.490756}
2026-01-29 06:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NZ28607') HTTP/1.1" 204 0
2026-01-29 06:04:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4203e5d9-a3d2-53ca-94d8-199d4811ae45 with identifier: JJ45702
2026-01-29 06:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4203e5d9-a3d2-53ca-94d8-199d4811ae45 with identifier: JJ45702
2026-01-29 06:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 95271, 'odometer_reading_unit': 'km', 'registration_date': '2019-12-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jj45702', 'expiration_date': '2026-01-29t16:03:25z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 155, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'la ravoire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 114, 'id': '4203e5d9-a3d2-53ca-94d8-199d4811ae45', 'current_year_diff': 7, 'age_in_months': 73, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 95271}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 73,
     'auction_title': '',
     'c_o_2_emission_value': 114,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 155,
     'expiration_date': '2026-01-29t16:03:25z',
     'fuel_type': 'petrol',
     'id': '4203e5d9-a3d2-53ca-94d8-199d4811ae45',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jj45702',
     'listing': 'auction',
     'location': 'la ravoire',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 95271,
     'odometer_in_km': 95271,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-12-29',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech gt',
     'transmission': 'automatic',
     'trim': 'gt',
     'year': 2019}
2026-01-29 06:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 4203e5d9-a3d2-53ca-94d8-199d4811ae45 spider: auto1.fr
2026-01-29 06:04:55 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 4203e5d9-a3d2-53ca-94d8-199d4811ae45 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 95271, 'odometer_reading_unit': 'km', 'registration_date': '2019-12-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jj45702', 'expiration_date': '2026-01-29t16:03:25z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 155, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'la ravoire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 114, 'id': '4203e5d9-a3d2-53ca-94d8-199d4811ae45', 'current_year_diff': 7, 'age_in_months': 73, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 95271}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 73,
     'auction_title': '',
     'c_o_2_emission_value': 114,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 155,
     'expiration_date': '2026-01-29t16:03:25z',
     'fuel_type': 'petrol',
     'id': '4203e5d9-a3d2-53ca-94d8-199d4811ae45',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jj45702',
     'listing': 'auction',
     'location': 'la ravoire',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 95271,
     'odometer_in_km': 95271,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-12-29',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech gt',
     'transmission': 'automatic',
     'trim': 'gt',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 155,
 'expiration_date': '2026-01-29T16:03:25Z',
 'fuel_type': 'petrol',
 'id': '4203e5d9-a3d2-53ca-94d8-199d4811ae45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ45702',
 'listing': 'auction',
 'location': 'La Ravoire',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 95271,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2019}
2026-01-29 06:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ45702%27 HTTP/1.1" 200 None
2026-01-29 06:04:55 [auto1.fr] INFO: Saving data for JJ45702: {'auction_closing_time': 1769702605.0, 'created_time': 1769447132.577557, 'last_price_update_time': 1769666695.769691}
2026-01-29 06:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JJ45702') HTTP/1.1" 204 0
2026-01-29 06:04:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66a1d9af-a7d0-565c-9818-136ab84c51da with identifier: WU41155
2026-01-29 06:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66a1d9af-a7d0-565c-9818-136ab84c51da with scrape type 2
2026-01-29 06:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66a1d9af-a7d0-565c-9818-136ab84c51da with scrape type 2
2026-01-29 06:04:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 66a1d9af-a7d0-565c-9818-136ab84c51da, identifier: WU41155
2026-01-29 06:04:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1770de6-e8a8-5cc1-9778-734df539cecb with identifier: KU40350
2026-01-29 06:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1770de6-e8a8-5cc1-9778-734df539cecb with scrape type 2
2026-01-29 06:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1770de6-e8a8-5cc1-9778-734df539cecb with scrape type 2
2026-01-29 06:04:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b1770de6-e8a8-5cc1-9778-734df539cecb, identifier: KU40350
2026-01-29 06:04:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36f54bb2-9f0c-54ba-8efb-7f7c35dc6a0d with identifier: FU78933
2026-01-29 06:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36f54bb2-9f0c-54ba-8efb-7f7c35dc6a0d with scrape type 2
2026-01-29 06:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36f54bb2-9f0c-54ba-8efb-7f7c35dc6a0d with scrape type 2
2026-01-29 06:04:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 36f54bb2-9f0c-54ba-8efb-7f7c35dc6a0d, identifier: FU78933
2026-01-29 06:04:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 66a1d9af-a7d0-565c-9818-136ab84c51da with identifier: WU41155
2026-01-29 06:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 66a1d9af-a7d0-565c-9818-136ab84c51da with identifier: WU41155
2026-01-29 06:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech feel', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 95756, 'odometer_reading_unit': 'km', 'registration_date': '2017-06-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wu41155', 'expiration_date': '2026-01-29t16:00:51z', 'origin_country_code': 'fr', 'trim': 'feel', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marseille', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': '66a1d9af-a7d0-565c-9818-136ab84c51da', 'current_year_diff': 9, 'age_in_months': 103, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 95756}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 103,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:00:51z',
     'fuel_type': 'petrol',
     'id': '66a1d9af-a7d0-565c-9818-136ab84c51da',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wu41155',
     'listing': 'auction',
     'location': 'fr, marseille',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 95756,
     'odometer_in_km': 95756,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-06-27',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech feel',
     'transmission': 'manual',
     'trim': 'feel',
     'year': 2017}
2026-01-29 06:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 66a1d9af-a7d0-565c-9818-136ab84c51da spider: auto1.fr
2026-01-29 06:04:56 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 66a1d9af-a7d0-565c-9818-136ab84c51da due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech feel', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 95756, 'odometer_reading_unit': 'km', 'registration_date': '2017-06-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wu41155', 'expiration_date': '2026-01-29t16:00:51z', 'origin_country_code': 'fr', 'trim': 'feel', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marseille', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': '66a1d9af-a7d0-565c-9818-136ab84c51da', 'current_year_diff': 9, 'age_in_months': 103, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 95756}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 103,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:00:51z',
     'fuel_type': 'petrol',
     'id': '66a1d9af-a7d0-565c-9818-136ab84c51da',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wu41155',
     'listing': 'auction',
     'location': 'fr, marseille',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 95756,
     'odometer_in_km': 95756,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-06-27',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech feel',
     'transmission': 'manual',
     'trim': 'feel',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:00:51Z',
 'fuel_type': 'petrol',
 'id': '66a1d9af-a7d0-565c-9818-136ab84c51da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU41155',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 95756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2017}
2026-01-29 06:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU41155%27 HTTP/1.1" 200 None
2026-01-29 06:04:56 [auto1.fr] INFO: Saving data for WU41155: {'auction_closing_time': 1769702451.0, 'created_time': 1769103352.959753, 'last_price_update_time': 1769666696.30125}
2026-01-29 06:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WU41155') HTTP/1.1" 204 0
2026-01-29 06:04:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b1770de6-e8a8-5cc1-9778-734df539cecb with identifier: KU40350
2026-01-29 06:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b1770de6-e8a8-5cc1-9778-734df539cecb with identifier: KU40350
2026-01-29 06:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 189934 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    189934
2026-01-29 06:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b1770de6-e8a8-5cc1-9778-734df539cecb spider: auto1.fr
2026-01-29 06:04:56 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: b1770de6-e8a8-5cc1-9778-734df539cecb due to rule: high_mileage_for_country.json, error: 189934 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    189934
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 160,
 'expiration_date': '2026-01-29T16:39:28Z',
 'fuel_type': 'diesel',
 'id': 'b1770de6-e8a8-5cc1-9778-734df539cecb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU40350',
 'listing': 'auction',
 'location': 'FR, Wambrechies',
 'make': 'Renault',
 'model': 'Talisman',
 'odometer': 189934,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Talisman 1.6 dCi Energy Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2017}
2026-01-29 06:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KU40350%27 HTTP/1.1" 200 None
2026-01-29 06:04:56 [auto1.fr] INFO: Saving data for KU40350: {'auction_closing_time': 1769704768.0, 'created_time': 1769534438.98544, 'last_price_update_time': 1769666696.542983}
2026-01-29 06:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KU40350') HTTP/1.1" 204 0
2026-01-29 06:04:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 36f54bb2-9f0c-54ba-8efb-7f7c35dc6a0d with identifier: FU78933
2026-01-29 06:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 36f54bb2-9f0c-54ba-8efb-7f7c35dc6a0d with identifier: FU78933
2026-01-29 06:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'sprinter' containing 'sprinter'
2026-01-29 06:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 36f54bb2-9f0c-54ba-8efb-7f7c35dc6a0d spider: auto1.fr
2026-01-29 06:04:56 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 36f54bb2-9f0c-54ba-8efb-7f7c35dc6a0d due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'sprinter' containing 'sprinter'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 143,
 'expiration_date': '2026-01-29T16:37:24Z',
 'fuel_type': 'diesel',
 'id': '36f54bb2-9f0c-54ba-8efb-7f7c35dc6a0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU78933',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Mercedes-Benz',
 'model': 'Sprinter',
 'odometer': 73470,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-19',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz Sprinter 314 CDI RWD L2',
 'transmission': 'manual',
 'trim': 'RWD L2',
 'year': 2021}
2026-01-29 06:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FU78933%27 HTTP/1.1" 200 None
2026-01-29 06:04:56 [auto1.fr] INFO: Saving data for FU78933: {'auction_closing_time': 1769704644.0, 'created_time': 1766556076.703647, 'last_price_update_time': 1769666696.785541}
2026-01-29 06:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FU78933') HTTP/1.1" 204 0
2026-01-29 06:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UX67190> (referer: https://www.auto1.com/v1/car-details-view/UX67190/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KC93823/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TT93520/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DN66808/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EW12885/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PK47381/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XA02351> (referer: https://www.auto1.com/v1/car-details-view/XA02351/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d490fd2f-14c1-5d54-b24c-5aa163a74008 with identifier: UX67190
2026-01-29 06:04:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d490fd2f-14c1-5d54-b24c-5aa163a74008 with scrape type 2
2026-01-29 06:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d490fd2f-14c1-5d54-b24c-5aa163a74008 with scrape type 2
2026-01-29 06:04:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d490fd2f-14c1-5d54-b24c-5aa163a74008, identifier: UX67190
2026-01-29 06:04:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d490fd2f-14c1-5d54-b24c-5aa163a74008 with identifier: UX67190
2026-01-29 06:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d490fd2f-14c1-5d54-b24c-5aa163a74008 with identifier: UX67190
2026-01-29 06:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 46172, 'odometer_reading_unit': 'km', 'registration_date': '2021-11-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ux67190', 'expiration_date': '2026-01-29t16:34:44z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marseille', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 125, 'id': 'd490fd2f-14c1-5d54-b24c-5aa163a74008', 'current_year_diff': 5, 'age_in_months': 50, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 46172}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 50,
     'auction_title': '',
     'c_o_2_emission_value': 125,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:34:44z',
     'fuel_type': 'petrol',
     'id': 'd490fd2f-14c1-5d54-b24c-5aa163a74008',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ux67190',
     'listing': 'auction',
     'location': 'fr, marseille',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 46172,
     'odometer_in_km': 46172,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-11-29',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2021}
2026-01-29 06:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: d490fd2f-14c1-5d54-b24c-5aa163a74008 spider: auto1.fr
2026-01-29 06:04:57 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: d490fd2f-14c1-5d54-b24c-5aa163a74008 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 46172, 'odometer_reading_unit': 'km', 'registration_date': '2021-11-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ux67190', 'expiration_date': '2026-01-29t16:34:44z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marseille', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 125, 'id': 'd490fd2f-14c1-5d54-b24c-5aa163a74008', 'current_year_diff': 5, 'age_in_months': 50, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 46172}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 50,
     'auction_title': '',
     'c_o_2_emission_value': 125,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:34:44z',
     'fuel_type': 'petrol',
     'id': 'd490fd2f-14c1-5d54-b24c-5aa163a74008',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ux67190',
     'listing': 'auction',
     'location': 'fr, marseille',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 46172,
     'odometer_in_km': 46172,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-11-29',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:34:44Z',
 'fuel_type': 'petrol',
 'id': 'd490fd2f-14c1-5d54-b24c-5aa163a74008',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX67190',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 46172,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2021}
2026-01-29 06:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UX67190%27 HTTP/1.1" 200 None
2026-01-29 06:04:57 [auto1.fr] INFO: Saving data for UX67190: {'auction_closing_time': 1769704484.0, 'created_time': 1769447790.690536, 'last_price_update_time': 1769666697.265636}
2026-01-29 06:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UX67190') HTTP/1.1" 204 0
2026-01-29 06:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BC93991> (referer: https://www.auto1.com/v1/car-details-view/BC93991/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46070e8e-07dd-5d0b-965a-c6c1f017eccd with identifier: XA02351
2026-01-29 06:04:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46070e8e-07dd-5d0b-965a-c6c1f017eccd with scrape type 2
2026-01-29 06:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46070e8e-07dd-5d0b-965a-c6c1f017eccd with scrape type 2
2026-01-29 06:04:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 46070e8e-07dd-5d0b-965a-c6c1f017eccd, identifier: XA02351
2026-01-29 06:04:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 46070e8e-07dd-5d0b-965a-c6c1f017eccd with identifier: XA02351
2026-01-29 06:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 46070e8e-07dd-5d0b-965a-c6c1f017eccd with identifier: XA02351
2026-01-29 06:04:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 46070e8e-07dd-5d0b-965a-c6c1f017eccd with identifier: XA02351 to the API
2026-01-29 06:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:04:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:04:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XA02351>
{'auction_title': '',
 'c_o_2_emission_value': 42,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 220,
 'expiration_date': '2026-01-29T16:44:00Z',
 'fuel_type': 'hybrid',
 'id': '46070e8e-07dd-5d0b-965a-c6c1f017eccd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA02351',
 'listing': 'auction',
 'location': 'Croissy-Beaubourg',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 134278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 xDrive 25e xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2022}
2026-01-29 06:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XA02351%27 HTTP/1.1" 200 None
2026-01-29 06:04:58 [auto1.fr] INFO: Saving data for XA02351: {'auction_closing_time': 1769705040.0, 'created_time': 1769533732.995106, 'last_price_update_time': 1769666698.253421}
2026-01-29 06:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XA02351') HTTP/1.1" 204 0
2026-01-29 06:04:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b078c02-b2a8-5dd4-97b2-05c1ce74ced9 with identifier: BC93991
2026-01-29 06:04:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b078c02-b2a8-5dd4-97b2-05c1ce74ced9 with scrape type 2
2026-01-29 06:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b078c02-b2a8-5dd4-97b2-05c1ce74ced9 with scrape type 2
2026-01-29 06:04:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6b078c02-b2a8-5dd4-97b2-05c1ce74ced9, identifier: BC93991
2026-01-29 06:04:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6b078c02-b2a8-5dd4-97b2-05c1ce74ced9 with identifier: BC93991
2026-01-29 06:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6b078c02-b2a8-5dd4-97b2-05c1ce74ced9 with identifier: BC93991
2026-01-29 06:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 151651 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    151651
2026-01-29 06:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 6b078c02-b2a8-5dd4-97b2-05c1ce74ced9 spider: auto1.fr
2026-01-29 06:04:58 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 6b078c02-b2a8-5dd4-97b2-05c1ce74ced9 due to rule: high_mileage_for_country.json, error: 151651 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    151651
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:15:58Z',
 'fuel_type': 'diesel',
 'id': '6b078c02-b2a8-5dd4-97b2-05c1ce74ced9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC93991',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 151651,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2020}
2026-01-29 06:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BC93991%27 HTTP/1.1" 200 None
2026-01-29 06:04:58 [auto1.fr] INFO: Saving data for BC93991: {'auction_closing_time': 1769703358.0, 'created_time': 1768064718.945763, 'last_price_update_time': 1769666698.685057}
2026-01-29 06:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BC93991') HTTP/1.1" 204 0
2026-01-29 06:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FJ10816/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZV05776> (referer: https://www.auto1.com/v1/car-details-view/ZV05776/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VG58569> (referer: https://www.auto1.com/v1/car-details-view/VG58569/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BR39793> (referer: https://www.auto1.com/v1/car-details-view/BR39793/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EG37469> (referer: https://www.auto1.com/v1/car-details-view/EG37469/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:04:59 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:04:59 [auto1.fr] INFO: Found listing with ID: DS46649
2026-01-29 06:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS46649%27 HTTP/1.1" 200 None
2026-01-29 06:04:59 [auto1.fr] INFO: Scrape type for DS46649: 0
2026-01-29 06:04:59 [auto1.fr] INFO: Found listing with ID: JM18654
2026-01-29 06:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JM18654%27 HTTP/1.1" 200 None
2026-01-29 06:04:59 [auto1.fr] INFO: Scrape type for JM18654: 2
2026-01-29 06:04:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:04:59 [auto1.fr] INFO: Found listing with ID: BN44470
2026-01-29 06:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BN44470%27 HTTP/1.1" 200 None
2026-01-29 06:04:59 [auto1.fr] INFO: Scrape type for BN44470: 2
2026-01-29 06:04:59 [auto1.fr] INFO: Found listing with ID: ML75206
2026-01-29 06:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ML75206%27 HTTP/1.1" 200 None
2026-01-29 06:04:59 [auto1.fr] INFO: Scrape type for ML75206: 0
2026-01-29 06:04:59 [auto1.fr] INFO: Found listing with ID: UM66379
2026-01-29 06:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UM66379%27 HTTP/1.1" 200 None
2026-01-29 06:04:59 [auto1.fr] INFO: Scrape type for UM66379: 0
2026-01-29 06:04:59 [auto1.fr] INFO: Found listing with ID: LA02782
2026-01-29 06:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LA02782%27 HTTP/1.1" 200 None
2026-01-29 06:04:59 [auto1.fr] INFO: Scrape type for LA02782: 2
2026-01-29 06:04:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a5c76c0-092c-5302-86e3-83f923fe5c4a with identifier: ZV05776
2026-01-29 06:04:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a5c76c0-092c-5302-86e3-83f923fe5c4a with scrape type 2
2026-01-29 06:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a5c76c0-092c-5302-86e3-83f923fe5c4a with scrape type 2
2026-01-29 06:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4a5c76c0-092c-5302-86e3-83f923fe5c4a, identifier: ZV05776
2026-01-29 06:04:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70937b25-a9e2-5d07-acc2-9800b78544ec with identifier: VG58569
2026-01-29 06:04:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70937b25-a9e2-5d07-acc2-9800b78544ec with scrape type 2
2026-01-29 06:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70937b25-a9e2-5d07-acc2-9800b78544ec with scrape type 2
2026-01-29 06:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 70937b25-a9e2-5d07-acc2-9800b78544ec, identifier: VG58569
2026-01-29 06:04:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e4438f4-8796-548a-89e5-ce72b549e421 with identifier: BR39793
2026-01-29 06:04:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e4438f4-8796-548a-89e5-ce72b549e421 with scrape type 2
2026-01-29 06:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e4438f4-8796-548a-89e5-ce72b549e421 with scrape type 2
2026-01-29 06:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7e4438f4-8796-548a-89e5-ce72b549e421, identifier: BR39793
2026-01-29 06:04:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40569879-181f-546d-9af8-0cf7d5d2de48 with identifier: EG37469
2026-01-29 06:04:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40569879-181f-546d-9af8-0cf7d5d2de48 with scrape type 2
2026-01-29 06:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40569879-181f-546d-9af8-0cf7d5d2de48 with scrape type 2
2026-01-29 06:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 40569879-181f-546d-9af8-0cf7d5d2de48, identifier: EG37469
2026-01-29 06:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4a5c76c0-092c-5302-86e3-83f923fe5c4a with identifier: ZV05776
2026-01-29 06:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4a5c76c0-092c-5302-86e3-83f923fe5c4a with identifier: ZV05776
2026-01-29 06:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech active pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 28411, 'odometer_reading_unit': 'km', 'registration_date': '2022-02-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zv05776', 'expiration_date': '2026-01-29t16:35:34z', 'origin_country_code': 'fr', 'trim': 'active pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, asnières-les-bourges', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '4a5c76c0-092c-5302-86e3-83f923fe5c4a', 'current_year_diff': 4, 'age_in_months': 47, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 28411}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 47,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 75,
     'expiration_date': '2026-01-29t16:35:34z',
     'fuel_type': 'petrol',
     'id': '4a5c76c0-092c-5302-86e3-83f923fe5c4a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zv05776',
     'listing': 'auction',
     'location': 'fr, asnières-les-bourges',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 28411,
     'odometer_in_km': 28411,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-02-24',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech active pack',
     'transmission': 'manual',
     'trim': 'active pack',
     'year': 2022}
2026-01-29 06:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 4a5c76c0-092c-5302-86e3-83f923fe5c4a spider: auto1.fr
2026-01-29 06:04:59 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 4a5c76c0-092c-5302-86e3-83f923fe5c4a due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech active pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 28411, 'odometer_reading_unit': 'km', 'registration_date': '2022-02-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zv05776', 'expiration_date': '2026-01-29t16:35:34z', 'origin_country_code': 'fr', 'trim': 'active pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, asnières-les-bourges', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '4a5c76c0-092c-5302-86e3-83f923fe5c4a', 'current_year_diff': 4, 'age_in_months': 47, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 28411}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 47,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 75,
     'expiration_date': '2026-01-29t16:35:34z',
     'fuel_type': 'petrol',
     'id': '4a5c76c0-092c-5302-86e3-83f923fe5c4a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zv05776',
     'listing': 'auction',
     'location': 'fr, asnières-les-bourges',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 28411,
     'odometer_in_km': 28411,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-02-24',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech active pack',
     'transmission': 'manual',
     'trim': 'active pack',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:35:34Z',
 'fuel_type': 'petrol',
 'id': '4a5c76c0-092c-5302-86e3-83f923fe5c4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV05776',
 'listing': 'auction',
 'location': 'FR, Asnières-Les-Bourges',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 28411,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Active Pack',
 'transmission': 'manual',
 'trim': 'Active Pack',
 'year': 2022}
2026-01-29 06:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZV05776%27 HTTP/1.1" 200 None
2026-01-29 06:04:59 [auto1.fr] INFO: Saving data for ZV05776: {'auction_closing_time': 1769704534.0, 'created_time': 1769534001.808514, 'last_price_update_time': 1769666699.98312}
2026-01-29 06:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZV05776') HTTP/1.1" 204 0
2026-01-29 06:05:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 70937b25-a9e2-5d07-acc2-9800b78544ec with identifier: VG58569
2026-01-29 06:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 70937b25-a9e2-5d07-acc2-9800b78544ec with identifier: VG58569
2026-01-29 06:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech style', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 19693, 'odometer_reading_unit': 'km', 'registration_date': '2021-12-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vg58569', 'expiration_date': '2026-01-29t16:12:46z', 'origin_country_code': 'fr', 'trim': 'style', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, saint-denis', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 118, 'id': '70937b25-a9e2-5d07-acc2-9800b78544ec', 'current_year_diff': 5, 'age_in_months': 49, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 19693}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 49,
     'auction_title': '',
     'c_o_2_emission_value': 118,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:12:46z',
     'fuel_type': 'petrol',
     'id': '70937b25-a9e2-5d07-acc2-9800b78544ec',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vg58569',
     'listing': 'auction',
     'location': 'fr, saint-denis',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 19693,
     'odometer_in_km': 19693,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-12-28',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech style',
     'transmission': 'manual',
     'trim': 'style',
     'year': 2021}
2026-01-29 06:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 70937b25-a9e2-5d07-acc2-9800b78544ec spider: auto1.fr
2026-01-29 06:05:00 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 70937b25-a9e2-5d07-acc2-9800b78544ec due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech style', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 19693, 'odometer_reading_unit': 'km', 'registration_date': '2021-12-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vg58569', 'expiration_date': '2026-01-29t16:12:46z', 'origin_country_code': 'fr', 'trim': 'style', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, saint-denis', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 118, 'id': '70937b25-a9e2-5d07-acc2-9800b78544ec', 'current_year_diff': 5, 'age_in_months': 49, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 19693}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 49,
     'auction_title': '',
     'c_o_2_emission_value': 118,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:12:46z',
     'fuel_type': 'petrol',
     'id': '70937b25-a9e2-5d07-acc2-9800b78544ec',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vg58569',
     'listing': 'auction',
     'location': 'fr, saint-denis',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 19693,
     'odometer_in_km': 19693,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-12-28',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech style',
     'transmission': 'manual',
     'trim': 'style',
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:12:46Z',
 'fuel_type': 'petrol',
 'id': '70937b25-a9e2-5d07-acc2-9800b78544ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG58569',
 'listing': 'auction',
 'location': 'FR, Saint-Denis',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 19693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2021}
2026-01-29 06:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG58569%27 HTTP/1.1" 200 None
2026-01-29 06:05:00 [auto1.fr] INFO: Saving data for VG58569: {'auction_closing_time': 1769703166.0, 'created_time': 1769534299.917718, 'last_price_update_time': 1769666700.269491}
2026-01-29 06:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VG58569') HTTP/1.1" 204 0
2026-01-29 06:05:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7e4438f4-8796-548a-89e5-ce72b549e421 with identifier: BR39793
2026-01-29 06:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7e4438f4-8796-548a-89e5-ce72b549e421 with identifier: BR39793
2026-01-29 06:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 162410 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    162410
2026-01-29 06:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 7e4438f4-8796-548a-89e5-ce72b549e421 spider: auto1.fr
2026-01-29 06:05:00 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 7e4438f4-8796-548a-89e5-ce72b549e421 due to rule: high_mileage_for_country.json, error: 162410 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    162410
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:00:41Z',
 'fuel_type': 'petrol',
 'id': '7e4438f4-8796-548a-89e5-ce72b549e421',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR39793',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 162410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.0 TSI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2017}
2026-01-29 06:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BR39793%27 HTTP/1.1" 200 None
2026-01-29 06:05:00 [auto1.fr] INFO: Saving data for BR39793: {'auction_closing_time': 1769702441.0, 'created_time': 1769533808.144601, 'last_price_update_time': 1769666700.499396}
2026-01-29 06:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BR39793') HTTP/1.1" 204 0
2026-01-29 06:05:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 40569879-181f-546d-9af8-0cf7d5d2de48 with identifier: EG37469
2026-01-29 06:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 40569879-181f-546d-9af8-0cf7d5d2de48 with identifier: EG37469
2026-01-29 06:05:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 40569879-181f-546d-9af8-0cf7d5d2de48 with identifier: EG37469 to the API
2026-01-29 06:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:05:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:05:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EG37469>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:37:20Z',
 'fuel_type': 'diesel',
 'id': '40569879-181f-546d-9af8-0cf7d5d2de48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG37469',
 'listing': 'auction',
 'location': 'FR, Warluis',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 93475,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2021}
2026-01-29 06:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EG37469%27 HTTP/1.1" 200 None
2026-01-29 06:05:00 [auto1.fr] INFO: Saving data for EG37469: {'auction_closing_time': 1769704640.0, 'created_time': 1769534114.762331, 'last_price_update_time': 1769666700.841338}
2026-01-29 06:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EG37469') HTTP/1.1" 204 0
2026-01-29 06:05:00 [auto1.fr] INFO: Found listing with ID: RK08247
2026-01-29 06:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RK08247%27 HTTP/1.1" 200 None
2026-01-29 06:05:00 [auto1.fr] INFO: Scrape type for RK08247: 2
2026-01-29 06:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EW12885> (referer: https://www.auto1.com/v1/car-details-view/EW12885/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:00 [auto1.fr] INFO: Found listing with ID: ZU63418
2026-01-29 06:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZU63418%27 HTTP/1.1" 200 None
2026-01-29 06:05:00 [auto1.fr] INFO: Scrape type for ZU63418: 0
2026-01-29 06:05:00 [auto1.fr] INFO: Found listing with ID: KN26981
2026-01-29 06:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KN26981%27 HTTP/1.1" 200 None
2026-01-29 06:05:00 [auto1.fr] INFO: Scrape type for KN26981: 0
2026-01-29 06:05:00 [auto1.fr] INFO: Found listing with ID: UK90783
2026-01-29 06:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UK90783%27 HTTP/1.1" 200 None
2026-01-29 06:05:00 [auto1.fr] INFO: Scrape type for UK90783: 0
2026-01-29 06:05:00 [auto1.fr] INFO: Found listing with ID: XP86000
2026-01-29 06:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XP86000%27 HTTP/1.1" 200 None
2026-01-29 06:05:00 [auto1.fr] INFO: Scrape type for XP86000: 2
2026-01-29 06:05:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PK47381> (referer: https://www.auto1.com/v1/car-details-view/PK47381/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:00 [auto1.fr] INFO: Found listing with ID: FB49059
2026-01-29 06:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB49059%27 HTTP/1.1" 200 None
2026-01-29 06:05:00 [auto1.fr] INFO: Scrape type for FB49059: 2
2026-01-29 06:05:01 [auto1.fr] INFO: Found listing with ID: RN61536
2026-01-29 06:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RN61536%27 HTTP/1.1" 200 None
2026-01-29 06:05:01 [auto1.fr] INFO: Scrape type for RN61536: 2
2026-01-29 06:05:01 [auto1.fr] INFO: Found listing with ID: WU66204
2026-01-29 06:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU66204%27 HTTP/1.1" 200 None
2026-01-29 06:05:01 [auto1.fr] INFO: Scrape type for WU66204: 0
2026-01-29 06:05:01 [auto1.fr] INFO: Found listing with ID: EF00082
2026-01-29 06:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF00082%27 HTTP/1.1" 200 None
2026-01-29 06:05:01 [auto1.fr] INFO: Scrape type for EF00082: 0
2026-01-29 06:05:01 [auto1.fr] INFO: Found listing with ID: PW20444
2026-01-29 06:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PW20444%27 HTTP/1.1" 200 None
2026-01-29 06:05:01 [auto1.fr] INFO: Scrape type for PW20444: 2
2026-01-29 06:05:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a55d547-5595-5c96-a780-add4fea0e6e6 with identifier: EW12885
2026-01-29 06:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a55d547-5595-5c96-a780-add4fea0e6e6 with scrape type 2
2026-01-29 06:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a55d547-5595-5c96-a780-add4fea0e6e6 with scrape type 2
2026-01-29 06:05:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3a55d547-5595-5c96-a780-add4fea0e6e6, identifier: EW12885
2026-01-29 06:05:01 [auto1.fr] INFO: Found listing with ID: VP21377
2026-01-29 06:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VP21377%27 HTTP/1.1" 200 None
2026-01-29 06:05:01 [auto1.fr] INFO: Scrape type for VP21377: 0
2026-01-29 06:05:01 [auto1.fr] INFO: Found listing with ID: PB05664
2026-01-29 06:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PB05664%27 HTTP/1.1" 200 None
2026-01-29 06:05:01 [auto1.fr] INFO: Scrape type for PB05664: 0
2026-01-29 06:05:01 [auto1.fr] INFO: Found listing with ID: TE00938
2026-01-29 06:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TE00938%27 HTTP/1.1" 200 None
2026-01-29 06:05:01 [auto1.fr] INFO: Scrape type for TE00938: 0
2026-01-29 06:05:01 [auto1.fr] INFO: Found listing with ID: JG33606
2026-01-29 06:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG33606%27 HTTP/1.1" 200 None
2026-01-29 06:05:01 [auto1.fr] INFO: Scrape type for JG33606: 2
2026-01-29 06:05:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3a55d547-5595-5c96-a780-add4fea0e6e6 with identifier: EW12885
2026-01-29 06:05:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3a55d547-5595-5c96-a780-add4fea0e6e6 with identifier: EW12885
2026-01-29 06:05:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3a55d547-5595-5c96-a780-add4fea0e6e6 with identifier: EW12885 to the API
2026-01-29 06:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:05:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:05:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EW12885>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:41:06Z',
 'fuel_type': 'diesel',
 'id': '3a55d547-5595-5c96-a780-add4fea0e6e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW12885',
 'listing': 'auction',
 'location': 'FR, Villenoy',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 67885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.5 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2020}
2026-01-29 06:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW12885%27 HTTP/1.1" 200 None
2026-01-29 06:05:02 [auto1.fr] INFO: Saving data for EW12885: {'auction_closing_time': 1769704866.0, 'created_time': 1769534279.385097, 'last_price_update_time': 1769666702.456602}
2026-01-29 06:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EW12885') HTTP/1.1" 204 0
2026-01-29 06:05:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e40198f-d5f1-58c4-b85d-7cdf4a46f0f3 with identifier: PK47381
2026-01-29 06:05:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e40198f-d5f1-58c4-b85d-7cdf4a46f0f3 with scrape type 2
2026-01-29 06:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e40198f-d5f1-58c4-b85d-7cdf4a46f0f3 with scrape type 2
2026-01-29 06:05:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6e40198f-d5f1-58c4-b85d-7cdf4a46f0f3, identifier: PK47381
2026-01-29 06:05:02 [auto1.fr] INFO: Found listing with ID: YJ18843
2026-01-29 06:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YJ18843%27 HTTP/1.1" 200 None
2026-01-29 06:05:02 [auto1.fr] INFO: Scrape type for YJ18843: 0
2026-01-29 06:05:02 [auto1.fr] INFO: Found listing with ID: CT46077
2026-01-29 06:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CT46077%27 HTTP/1.1" 200 None
2026-01-29 06:05:02 [auto1.fr] INFO: Scrape type for CT46077: 0
2026-01-29 06:05:02 [auto1.fr] INFO: Found listing with ID: NR70042
2026-01-29 06:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NR70042%27 HTTP/1.1" 200 None
2026-01-29 06:05:02 [auto1.fr] INFO: Scrape type for NR70042: 2
2026-01-29 06:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6e40198f-d5f1-58c4-b85d-7cdf4a46f0f3 with identifier: PK47381
2026-01-29 06:05:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6e40198f-d5f1-58c4-b85d-7cdf4a46f0f3 with identifier: PK47381
2026-01-29 06:05:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6e40198f-d5f1-58c4-b85d-7cdf4a46f0f3 with identifier: PK47381 to the API
2026-01-29 06:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:05:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:05:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PK47381>
{'auction_title': '',
 'c_o_2_emission_value': 87,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:05:17Z',
 'fuel_type': 'hybrid',
 'id': '6e40198f-d5f1-58c4-b85d-7cdf4a46f0f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK47381',
 'listing': 'auction',
 'location': 'FR, Warluis',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 31905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-02-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 Hybrid Dynamic',
 'transmission': 'automatic',
 'trim': 'Dynamic',
 'year': 2023}
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PK47381%27 HTTP/1.1" 200 None
2026-01-29 06:05:03 [auto1.fr] INFO: Saving data for PK47381: {'auction_closing_time': 1769702717.0, 'created_time': 1769101397.732297, 'last_price_update_time': 1769666703.089738}
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PK47381') HTTP/1.1" 204 0
2026-01-29 06:05:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FJ10816> (referer: https://www.auto1.com/v1/car-details-view/FJ10816/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TT93520> (referer: https://www.auto1.com/v1/car-details-view/TT93520/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KC93823> (referer: https://www.auto1.com/v1/car-details-view/KC93823/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DN66808> (referer: https://www.auto1.com/v1/car-details-view/DN66808/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:03 [auto1.fr] INFO: Found listing with ID: BN10624
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BN10624%27 HTTP/1.1" 200 None
2026-01-29 06:05:03 [auto1.fr] INFO: Scrape type for BN10624: 2
2026-01-29 06:05:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:03 [auto1.fr] INFO: Found listing with ID: TZ22748
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TZ22748%27 HTTP/1.1" 200 None
2026-01-29 06:05:03 [auto1.fr] INFO: Scrape type for TZ22748: 0
2026-01-29 06:05:03 [auto1.fr] INFO: Found listing with ID: MV48741
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MV48741%27 HTTP/1.1" 200 None
2026-01-29 06:05:03 [auto1.fr] INFO: Scrape type for MV48741: 2
2026-01-29 06:05:03 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:05:03 [auto1.fr] INFO: Found listing with ID: DV64570
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DV64570%27 HTTP/1.1" 200 None
2026-01-29 06:05:03 [auto1.fr] INFO: Scrape type for DV64570: 2
2026-01-29 06:05:03 [auto1.fr] INFO: Found listing with ID: EH18565
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EH18565%27 HTTP/1.1" 200 None
2026-01-29 06:05:03 [auto1.fr] INFO: Scrape type for EH18565: 2
2026-01-29 06:05:03 [auto1.fr] INFO: Found listing with ID: CA88476
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA88476%27 HTTP/1.1" 200 None
2026-01-29 06:05:03 [auto1.fr] INFO: Scrape type for CA88476: 0
2026-01-29 06:05:03 [auto1.fr] INFO: Found listing with ID: GP21501
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GP21501%27 HTTP/1.1" 200 None
2026-01-29 06:05:03 [auto1.fr] INFO: Scrape type for GP21501: 0
2026-01-29 06:05:03 [auto1.fr] INFO: Found listing with ID: MK77081
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MK77081%27 HTTP/1.1" 200 None
2026-01-29 06:05:03 [auto1.fr] INFO: Scrape type for MK77081: 2
2026-01-29 06:05:03 [auto1.fr] INFO: Found listing with ID: UA52430
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UA52430%27 HTTP/1.1" 200 None
2026-01-29 06:05:03 [auto1.fr] INFO: Scrape type for UA52430: 0
2026-01-29 06:05:03 [auto1.fr] INFO: Found listing with ID: FV86478
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV86478%27 HTTP/1.1" 200 None
2026-01-29 06:05:03 [auto1.fr] INFO: Scrape type for FV86478: 0
2026-01-29 06:05:03 [auto1.fr] INFO: Found listing with ID: MS42822
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MS42822%27 HTTP/1.1" 200 None
2026-01-29 06:05:03 [auto1.fr] INFO: Scrape type for MS42822: 2
2026-01-29 06:05:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72449dd8-6aa4-5e68-b55f-03da22c1fc06 with identifier: FJ10816
2026-01-29 06:05:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72449dd8-6aa4-5e68-b55f-03da22c1fc06 with scrape type 2
2026-01-29 06:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72449dd8-6aa4-5e68-b55f-03da22c1fc06 with scrape type 2
2026-01-29 06:05:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 72449dd8-6aa4-5e68-b55f-03da22c1fc06, identifier: FJ10816
2026-01-29 06:05:03 [auto1.fr] INFO: Found listing with ID: XR35984
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XR35984%27 HTTP/1.1" 200 None
2026-01-29 06:05:03 [auto1.fr] INFO: Scrape type for XR35984: 0
2026-01-29 06:05:03 [auto1.fr] INFO: Found listing with ID: DL35781
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DL35781%27 HTTP/1.1" 200 None
2026-01-29 06:05:03 [auto1.fr] INFO: Scrape type for DL35781: 0
2026-01-29 06:05:03 [auto1.fr] INFO: Found listing with ID: UB25417
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UB25417%27 HTTP/1.1" 200 None
2026-01-29 06:05:03 [auto1.fr] INFO: Scrape type for UB25417: 0
2026-01-29 06:05:03 [auto1.fr] INFO: Found listing with ID: RZ10736
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RZ10736%27 HTTP/1.1" 200 None
2026-01-29 06:05:03 [auto1.fr] INFO: Scrape type for RZ10736: 0
2026-01-29 06:05:03 [auto1.fr] INFO: Found listing with ID: RT30199
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RT30199%27 HTTP/1.1" 200 None
2026-01-29 06:05:03 [auto1.fr] INFO: Scrape type for RT30199: 2
2026-01-29 06:05:03 [auto1.fr] INFO: Found listing with ID: CA48078
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA48078%27 HTTP/1.1" 200 None
2026-01-29 06:05:03 [auto1.fr] INFO: Scrape type for CA48078: 2
2026-01-29 06:05:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 72449dd8-6aa4-5e68-b55f-03da22c1fc06 with identifier: FJ10816
2026-01-29 06:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 72449dd8-6aa4-5e68-b55f-03da22c1fc06 with identifier: FJ10816
2026-01-29 06:05:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 72449dd8-6aa4-5e68-b55f-03da22c1fc06 with identifier: FJ10816 to the API
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:05:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FJ10816>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-01-29T16:10:32Z',
 'fuel_type': 'petrol',
 'id': '72449dd8-6aa4-5e68-b55f-03da22c1fc06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ10816',
 'listing': 'auction',
 'location': 'FR, Quincieux',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 43870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost Titanium Business',
 'transmission': 'manual',
 'trim': 'Titanium Business',
 'year': 2019}
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ10816%27 HTTP/1.1" 200 None
2026-01-29 06:05:03 [auto1.fr] INFO: Saving data for FJ10816: {'auction_closing_time': 1769703032.0, 'created_time': 1769533766.729084, 'last_price_update_time': 1769666703.904203}
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FJ10816') HTTP/1.1" 204 0
2026-01-29 06:05:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11726022-79bb-5598-93e6-1da223396b67 with identifier: TT93520
2026-01-29 06:05:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11726022-79bb-5598-93e6-1da223396b67 with scrape type 2
2026-01-29 06:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11726022-79bb-5598-93e6-1da223396b67 with scrape type 2
2026-01-29 06:05:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 11726022-79bb-5598-93e6-1da223396b67, identifier: TT93520
2026-01-29 06:05:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 032b1287-1950-56ab-aedb-a0e27b25f41e with identifier: KC93823
2026-01-29 06:05:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 032b1287-1950-56ab-aedb-a0e27b25f41e with scrape type 2
2026-01-29 06:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 032b1287-1950-56ab-aedb-a0e27b25f41e with scrape type 2
2026-01-29 06:05:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 032b1287-1950-56ab-aedb-a0e27b25f41e, identifier: KC93823
2026-01-29 06:05:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fd80741-c043-5acb-a9b8-660103f414cf with identifier: DN66808
2026-01-29 06:05:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fd80741-c043-5acb-a9b8-660103f414cf with scrape type 2
2026-01-29 06:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fd80741-c043-5acb-a9b8-660103f414cf with scrape type 2
2026-01-29 06:05:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5fd80741-c043-5acb-a9b8-660103f414cf, identifier: DN66808
2026-01-29 06:05:04 [auto1.fr] INFO: Found listing with ID: LY40679
2026-01-29 06:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LY40679%27 HTTP/1.1" 200 None
2026-01-29 06:05:04 [auto1.fr] INFO: Scrape type for LY40679: 2
2026-01-29 06:05:04 [auto1.fr] INFO: Found listing with ID: TM33712
2026-01-29 06:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TM33712%27 HTTP/1.1" 200 None
2026-01-29 06:05:04 [auto1.fr] INFO: Scrape type for TM33712: 0
2026-01-29 06:05:04 [auto1.fr] INFO: Found listing with ID: SV21157
2026-01-29 06:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV21157%27 HTTP/1.1" 200 None
2026-01-29 06:05:04 [auto1.fr] INFO: Scrape type for SV21157: 0
2026-01-29 06:05:04 [auto1.fr] INFO: Found listing with ID: EN35537
2026-01-29 06:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EN35537%27 HTTP/1.1" 200 None
2026-01-29 06:05:04 [auto1.fr] INFO: Scrape type for EN35537: 2
2026-01-29 06:05:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 11726022-79bb-5598-93e6-1da223396b67 with identifier: TT93520
2026-01-29 06:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 11726022-79bb-5598-93e6-1da223396b67 with identifier: TT93520
2026-01-29 06:05:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 11726022-79bb-5598-93e6-1da223396b67 with identifier: TT93520 to the API
2026-01-29 06:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:05:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:05:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TT93520>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 100,
 'expiration_date': '2026-01-29T16:13:31Z',
 'fuel_type': 'petrol',
 'id': '11726022-79bb-5598-93e6-1da223396b67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT93520',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 110883,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost B&O Play First Edition',
 'transmission': 'manual',
 'trim': 'B&O Play First Edition',
 'year': 2017}
2026-01-29 06:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TT93520%27 HTTP/1.1" 200 None
2026-01-29 06:05:04 [auto1.fr] INFO: Saving data for TT93520: {'auction_closing_time': 1769703211.0, 'created_time': 1767805931.934219, 'last_price_update_time': 1769666704.861816}
2026-01-29 06:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TT93520') HTTP/1.1" 204 0
2026-01-29 06:05:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 032b1287-1950-56ab-aedb-a0e27b25f41e with identifier: KC93823
2026-01-29 06:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 032b1287-1950-56ab-aedb-a0e27b25f41e with identifier: KC93823
2026-01-29 06:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 137807 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    137807
2026-01-29 06:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 032b1287-1950-56ab-aedb-a0e27b25f41e spider: auto1.fr
2026-01-29 06:05:05 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 032b1287-1950-56ab-aedb-a0e27b25f41e due to rule: high_mileage_for_make.json, error: 137807 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    137807
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:24:24Z',
 'fuel_type': 'diesel',
 'id': '032b1287-1950-56ab-aedb-a0e27b25f41e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC93823',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 137807,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2020}
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KC93823%27 HTTP/1.1" 200 None
2026-01-29 06:05:05 [auto1.fr] INFO: Saving data for KC93823: {'auction_closing_time': 1769703864.0, 'created_time': 1769446861.320234, 'last_price_update_time': 1769666705.117317}
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KC93823') HTTP/1.1" 204 0
2026-01-29 06:05:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5fd80741-c043-5acb-a9b8-660103f414cf with identifier: DN66808
2026-01-29 06:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5fd80741-c043-5acb-a9b8-660103f414cf with identifier: DN66808
2026-01-29 06:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 94079, 'odometer_reading_unit': 'km', 'registration_date': '2019-12-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dn66808', 'expiration_date': '2026-01-29t16:26:04z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, la chapelle longueville', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 96, 'id': '5fd80741-c043-5acb-a9b8-660103f414cf', 'current_year_diff': 7, 'age_in_months': 73, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 94079}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 73,
     'auction_title': '',
     'c_o_2_emission_value': 96,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:26:04z',
     'fuel_type': 'petrol',
     'id': '5fd80741-c043-5acb-a9b8-660103f414cf',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dn66808',
     'listing': 'auction',
     'location': 'fr, la chapelle longueville',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 94079,
     'odometer_in_km': 94079,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-12-23',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech gt line',
     'transmission': 'manual',
     'trim': 'gt line',
     'year': 2019}
2026-01-29 06:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 5fd80741-c043-5acb-a9b8-660103f414cf spider: auto1.fr
2026-01-29 06:05:05 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 5fd80741-c043-5acb-a9b8-660103f414cf due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 94079, 'odometer_reading_unit': 'km', 'registration_date': '2019-12-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dn66808', 'expiration_date': '2026-01-29t16:26:04z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, la chapelle longueville', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 96, 'id': '5fd80741-c043-5acb-a9b8-660103f414cf', 'current_year_diff': 7, 'age_in_months': 73, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 94079}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 73,
     'auction_title': '',
     'c_o_2_emission_value': 96,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:26:04z',
     'fuel_type': 'petrol',
     'id': '5fd80741-c043-5acb-a9b8-660103f414cf',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dn66808',
     'listing': 'auction',
     'location': 'fr, la chapelle longueville',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 94079,
     'odometer_in_km': 94079,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-12-23',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech gt line',
     'transmission': 'manual',
     'trim': 'gt line',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:26:04Z',
 'fuel_type': 'petrol',
 'id': '5fd80741-c043-5acb-a9b8-660103f414cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN66808',
 'listing': 'auction',
 'location': 'FR, LA CHAPELLE LONGUEVILLE',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 94079,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2019}
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DN66808%27 HTTP/1.1" 200 None
2026-01-29 06:05:05 [auto1.fr] INFO: Saving data for DN66808: {'auction_closing_time': 1769703964.0, 'created_time': 1769533595.358838, 'last_price_update_time': 1769666705.370509}
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DN66808') HTTP/1.1" 204 0
2026-01-29 06:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JM18654/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:05 [auto1.fr] INFO: Found listing with ID: XH60310
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XH60310%27 HTTP/1.1" 200 None
2026-01-29 06:05:05 [auto1.fr] INFO: Scrape type for XH60310: 2
2026-01-29 06:05:05 [auto1.fr] INFO: Found listing with ID: NP76609
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NP76609%27 HTTP/1.1" 200 None
2026-01-29 06:05:05 [auto1.fr] INFO: Scrape type for NP76609: 2
2026-01-29 06:05:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BN44470/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:05 [auto1.fr] INFO: Found listing with ID: RU68293
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RU68293%27 HTTP/1.1" 200 None
2026-01-29 06:05:05 [auto1.fr] INFO: Scrape type for RU68293: 0
2026-01-29 06:05:05 [auto1.fr] INFO: Found listing with ID: EA07744
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EA07744%27 HTTP/1.1" 200 None
2026-01-29 06:05:05 [auto1.fr] INFO: Scrape type for EA07744: 2
2026-01-29 06:05:05 [auto1.fr] INFO: Found listing with ID: ZE64183
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZE64183%27 HTTP/1.1" 200 None
2026-01-29 06:05:05 [auto1.fr] INFO: Scrape type for ZE64183: 0
2026-01-29 06:05:05 [auto1.fr] INFO: Found listing with ID: FY73676
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FY73676%27 HTTP/1.1" 200 None
2026-01-29 06:05:05 [auto1.fr] INFO: Scrape type for FY73676: 2
2026-01-29 06:05:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:05 [auto1.fr] INFO: Found listing with ID: ZP73259
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP73259%27 HTTP/1.1" 200 None
2026-01-29 06:05:05 [auto1.fr] INFO: Scrape type for ZP73259: 2
2026-01-29 06:05:05 [auto1.fr] INFO: Found listing with ID: GB33600
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GB33600%27 HTTP/1.1" 200 None
2026-01-29 06:05:05 [auto1.fr] INFO: Scrape type for GB33600: 0
2026-01-29 06:05:05 [auto1.fr] INFO: Found listing with ID: PF08969
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF08969%27 HTTP/1.1" 200 None
2026-01-29 06:05:05 [auto1.fr] INFO: Scrape type for PF08969: 2
2026-01-29 06:05:05 [auto1.fr] INFO: Found listing with ID: UA12528
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UA12528%27 HTTP/1.1" 200 None
2026-01-29 06:05:05 [auto1.fr] INFO: Scrape type for UA12528: 0
2026-01-29 06:05:05 [auto1.fr] INFO: Found listing with ID: YZ78743
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YZ78743%27 HTTP/1.1" 200 None
2026-01-29 06:05:05 [auto1.fr] INFO: Scrape type for YZ78743: 0
2026-01-29 06:05:05 [auto1.fr] INFO: Found listing with ID: BC57384
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BC57384%27 HTTP/1.1" 200 None
2026-01-29 06:05:05 [auto1.fr] INFO: Scrape type for BC57384: 0
2026-01-29 06:05:05 [auto1.fr] INFO: Found listing with ID: HL81867
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL81867%27 HTTP/1.1" 200 None
2026-01-29 06:05:05 [auto1.fr] INFO: Scrape type for HL81867: 2
2026-01-29 06:05:05 [auto1.fr] INFO: Found listing with ID: DH05496
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DH05496%27 HTTP/1.1" 200 None
2026-01-29 06:05:05 [auto1.fr] INFO: Scrape type for DH05496: 0
2026-01-29 06:05:05 [auto1.fr] INFO: Found listing with ID: RB07029
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RB07029%27 HTTP/1.1" 200 None
2026-01-29 06:05:05 [auto1.fr] INFO: Scrape type for RB07029: 2
2026-01-29 06:05:05 [auto1.fr] INFO: Found listing with ID: SH81944
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SH81944%27 HTTP/1.1" 200 None
2026-01-29 06:05:05 [auto1.fr] INFO: Scrape type for SH81944: 0
2026-01-29 06:05:05 [auto1.fr] INFO: Found listing with ID: FW95558
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FW95558%27 HTTP/1.1" 200 None
2026-01-29 06:05:05 [auto1.fr] INFO: Scrape type for FW95558: 2
2026-01-29 06:05:05 [auto1.fr] INFO: Found listing with ID: UD15145
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UD15145%27 HTTP/1.1" 200 None
2026-01-29 06:05:05 [auto1.fr] INFO: Scrape type for UD15145: 2
2026-01-29 06:05:05 [auto1.fr] INFO: Found listing with ID: VP11768
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VP11768%27 HTTP/1.1" 200 None
2026-01-29 06:05:05 [auto1.fr] INFO: Scrape type for VP11768: 0
2026-01-29 06:05:05 [auto1.fr] INFO: Found listing with ID: HX66694
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HX66694%27 HTTP/1.1" 200 None
2026-01-29 06:05:05 [auto1.fr] INFO: Scrape type for HX66694: 0
2026-01-29 06:05:05 [auto1.fr] INFO: Found listing with ID: VV03236
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV03236%27 HTTP/1.1" 200 None
2026-01-29 06:05:05 [auto1.fr] INFO: Scrape type for VV03236: 2
2026-01-29 06:05:05 [auto1.fr] INFO: Found listing with ID: MF63659
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MF63659%27 HTTP/1.1" 200 None
2026-01-29 06:05:05 [auto1.fr] INFO: Scrape type for MF63659: 2
2026-01-29 06:05:05 [auto1.fr] INFO: Found listing with ID: AV62458
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV62458%27 HTTP/1.1" 200 None
2026-01-29 06:05:05 [auto1.fr] INFO: Scrape type for AV62458: 2
2026-01-29 06:05:05 [auto1.fr] INFO: Found listing with ID: EJ57262
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EJ57262%27 HTTP/1.1" 200 None
2026-01-29 06:05:05 [auto1.fr] INFO: Scrape type for EJ57262: 0
2026-01-29 06:05:05 [auto1.fr] INFO: Found listing with ID: ZB90274
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZB90274%27 HTTP/1.1" 200 None
2026-01-29 06:05:05 [auto1.fr] INFO: Scrape type for ZB90274: 0
2026-01-29 06:05:05 [auto1.fr] INFO: Found listing with ID: ZG43153
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG43153%27 HTTP/1.1" 200 None
2026-01-29 06:05:05 [auto1.fr] INFO: Scrape type for ZG43153: 2
2026-01-29 06:05:05 [auto1.fr] INFO: Found listing with ID: HJ74626
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HJ74626%27 HTTP/1.1" 200 None
2026-01-29 06:05:05 [auto1.fr] INFO: Scrape type for HJ74626: 0
2026-01-29 06:05:05 [auto1.fr] INFO: Found listing with ID: TA22737
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA22737%27 HTTP/1.1" 200 None
2026-01-29 06:05:05 [auto1.fr] INFO: Scrape type for TA22737: 0
2026-01-29 06:05:05 [auto1.fr] INFO: Found listing with ID: NL37079
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NL37079%27 HTTP/1.1" 200 None
2026-01-29 06:05:05 [auto1.fr] INFO: Scrape type for NL37079: 2
2026-01-29 06:05:05 [auto1.fr] INFO: Found listing with ID: AS13527
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AS13527%27 HTTP/1.1" 200 None
2026-01-29 06:05:05 [auto1.fr] INFO: Scrape type for AS13527: 2
2026-01-29 06:05:05 [auto1.fr] INFO: Found listing with ID: JJ24826
2026-01-29 06:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ24826%27 HTTP/1.1" 200 None
2026-01-29 06:05:06 [auto1.fr] INFO: Scrape type for JJ24826: 2
2026-01-29 06:05:06 [auto1.fr] INFO: Found listing with ID: JX29082
2026-01-29 06:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JX29082%27 HTTP/1.1" 200 None
2026-01-29 06:05:06 [auto1.fr] INFO: Scrape type for JX29082: 0
2026-01-29 06:05:06 [auto1.fr] INFO: Found listing with ID: AE98993
2026-01-29 06:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AE98993%27 HTTP/1.1" 200 None
2026-01-29 06:05:06 [auto1.fr] INFO: Scrape type for AE98993: 0
2026-01-29 06:05:06 [auto1.fr] INFO: Found listing with ID: AX48091
2026-01-29 06:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX48091%27 HTTP/1.1" 200 None
2026-01-29 06:05:06 [auto1.fr] INFO: Scrape type for AX48091: 0
2026-01-29 06:05:06 [auto1.fr] INFO: Found listing with ID: UB25329
2026-01-29 06:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UB25329%27 HTTP/1.1" 200 None
2026-01-29 06:05:06 [auto1.fr] INFO: Scrape type for UB25329: 0
2026-01-29 06:05:06 [auto1.fr] INFO: Found listing with ID: VE92279
2026-01-29 06:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VE92279%27 HTTP/1.1" 200 None
2026-01-29 06:05:06 [auto1.fr] INFO: Scrape type for VE92279: 2
2026-01-29 06:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RN61536/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FB49059/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RK08247/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XP86000/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LA02782/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PW20444/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JG33606/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NR70042/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EH18565/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MV48741/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BN10624/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:07 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: MJ36371
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MJ36371%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for MJ36371: 2
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: YM42732
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YM42732%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for YM42732: 2
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: LC71898
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LC71898%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for LC71898: 0
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: EH29728
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EH29728%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for EH29728: 0
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: XM33258
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XM33258%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for XM33258: 0
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: GY09679
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GY09679%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for GY09679: 0
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: PL20124
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PL20124%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for PL20124: 2
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: EG40309
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EG40309%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for EG40309: 2
2026-01-29 06:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DV64570/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: FN34513
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FN34513%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for FN34513: 0
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: AC24513
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AC24513%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for AC24513: 0
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: MX13044
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MX13044%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for MX13044: 2
2026-01-29 06:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: PZ56344
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PZ56344%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for PZ56344: 0
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: NY83567
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NY83567%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for NY83567: 2
2026-01-29 06:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EN35537/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: YC52303
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YC52303%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for YC52303: 2
2026-01-29 06:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: SL73241
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL73241%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for SL73241: 0
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: KW93900
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KW93900%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for KW93900: 2
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: LA99813
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LA99813%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for LA99813: 0
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: XL69196
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XL69196%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for XL69196: 2
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: VG16954
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG16954%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for VG16954: 2
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: GJ08325
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GJ08325%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for GJ08325: 0
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: AG58508
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AG58508%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for AG58508: 0
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: UB10911
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UB10911%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for UB10911: 2
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: FL97269
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FL97269%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for FL97269: 2
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: JW57356
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JW57356%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for JW57356: 0
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: NN64978
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NN64978%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for NN64978: 0
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: MA79258
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MA79258%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for MA79258: 0
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: TN94946
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TN94946%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for TN94946: 2
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: SB11289
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SB11289%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for SB11289: 2
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: KE96645
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KE96645%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for KE96645: 2
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: EJ77170
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EJ77170%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for EJ77170: 0
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: SE84757
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SE84757%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for SE84757: 2
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: ZE27516
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZE27516%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for ZE27516: 0
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: ZW51979
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZW51979%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for ZW51979: 0
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: NR64509
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NR64509%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for NR64509: 0
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: HW30174
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HW30174%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for HW30174: 2
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: MD83618
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MD83618%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for MD83618: 0
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: YM64917
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YM64917%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for YM64917: 0
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: BV12142
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BV12142%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for BV12142: 0
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: XU34450
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XU34450%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for XU34450: 0
2026-01-29 06:05:07 [auto1.fr] INFO: Found listing with ID: CY52840
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY52840%27 HTTP/1.1" 200 None
2026-01-29 06:05:07 [auto1.fr] INFO: Scrape type for CY52840: 2
2026-01-29 06:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VE92279/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RK08247> (referer: https://www.auto1.com/v1/car-details-view/RK08247/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NP76609/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JJ24826/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AS13527/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67249d04-20d3-5a58-b757-382089033177 with identifier: RK08247
2026-01-29 06:05:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67249d04-20d3-5a58-b757-382089033177 with scrape type 2
2026-01-29 06:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67249d04-20d3-5a58-b757-382089033177 with scrape type 2
2026-01-29 06:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 67249d04-20d3-5a58-b757-382089033177, identifier: RK08247
2026-01-29 06:05:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 67249d04-20d3-5a58-b757-382089033177 with identifier: RK08247
2026-01-29 06:05:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 67249d04-20d3-5a58-b757-382089033177 with identifier: RK08247
2026-01-29 06:05:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 164144 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164144
2026-01-29 06:05:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 67249d04-20d3-5a58-b757-382089033177 spider: auto1.fr
2026-01-29 06:05:08 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 67249d04-20d3-5a58-b757-382089033177 due to rule: high_mileage_for_country.json, error: 164144 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164144
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:34:41Z',
 'fuel_type': 'petrol',
 'id': '67249d04-20d3-5a58-b757-382089033177',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK08247',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 164144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-22',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.3 TCe Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2022}
2026-01-29 06:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RK08247%27 HTTP/1.1" 200 None
2026-01-29 06:05:08 [auto1.fr] INFO: Saving data for RK08247: {'auction_closing_time': 1769704481.0, 'created_time': 1768844533.956813, 'last_price_update_time': 1769666708.520455}
2026-01-29 06:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RK08247') HTTP/1.1" 204 0
2026-01-29 06:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FB49059> (referer: https://www.auto1.com/v1/car-details-view/FB49059/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RN61536> (referer: https://www.auto1.com/v1/car-details-view/RN61536/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d90c51d7-b900-5d40-b0e0-09429a83adc7 with identifier: FB49059
2026-01-29 06:05:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d90c51d7-b900-5d40-b0e0-09429a83adc7 with scrape type 2
2026-01-29 06:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d90c51d7-b900-5d40-b0e0-09429a83adc7 with scrape type 2
2026-01-29 06:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d90c51d7-b900-5d40-b0e0-09429a83adc7, identifier: FB49059
2026-01-29 06:05:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f31f8adf-fe00-5452-983b-ca298b70ab73 with identifier: RN61536
2026-01-29 06:05:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f31f8adf-fe00-5452-983b-ca298b70ab73 with scrape type 2
2026-01-29 06:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f31f8adf-fe00-5452-983b-ca298b70ab73 with scrape type 2
2026-01-29 06:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f31f8adf-fe00-5452-983b-ca298b70ab73, identifier: RN61536
2026-01-29 06:05:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d90c51d7-b900-5d40-b0e0-09429a83adc7 with identifier: FB49059
2026-01-29 06:05:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d90c51d7-b900-5d40-b0e0-09429a83adc7 with identifier: FB49059
2026-01-29 06:05:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d90c51d7-b900-5d40-b0e0-09429a83adc7 with identifier: FB49059 to the API
2026-01-29 06:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:05:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:05:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FB49059>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 192,
 'expiration_date': '2026-01-29T16:36:11Z',
 'fuel_type': 'petrol',
 'id': 'd90c51d7-b900-5d40-b0e0-09429a83adc7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB49059',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 104848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-01-29 06:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB49059%27 HTTP/1.1" 200 None
2026-01-29 06:05:09 [auto1.fr] INFO: Saving data for FB49059: {'auction_closing_time': 1769704571.0, 'created_time': 1768928561.486846, 'last_price_update_time': 1769666709.241049}
2026-01-29 06:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FB49059') HTTP/1.1" 204 0
2026-01-29 06:05:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f31f8adf-fe00-5452-983b-ca298b70ab73 with identifier: RN61536
2026-01-29 06:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f31f8adf-fe00-5452-983b-ca298b70ab73 with identifier: RN61536
2026-01-29 06:05:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f31f8adf-fe00-5452-983b-ca298b70ab73 with identifier: RN61536 to the API
2026-01-29 06:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:05:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:05:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RN61536>
{'auction_title': '',
 'c_o_2_emission_value': 44,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 245,
 'expiration_date': '2026-01-29T16:45:56Z',
 'fuel_type': 'hybrid',
 'id': 'f31f8adf-fe00-5452-983b-ca298b70ab73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN61536',
 'listing': 'auction',
 'location': 'FR, Villenoy',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 73460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 Sportback 45 TFSIe S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2022}
2026-01-29 06:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RN61536%27 HTTP/1.1" 200 None
2026-01-29 06:05:09 [auto1.fr] INFO: Saving data for RN61536: {'auction_closing_time': 1769705156.0, 'created_time': 1769533521.369269, 'last_price_update_time': 1769666709.667483}
2026-01-29 06:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RN61536') HTTP/1.1" 204 0
2026-01-29 06:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JG33606> (referer: https://www.auto1.com/v1/car-details-view/JG33606/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EG40309/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZG43153/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NL37079/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8454de18-7b2f-5c0a-80e6-bcd6b673533c with identifier: JG33606
2026-01-29 06:05:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8454de18-7b2f-5c0a-80e6-bcd6b673533c with scrape type 2
2026-01-29 06:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8454de18-7b2f-5c0a-80e6-bcd6b673533c with scrape type 2
2026-01-29 06:05:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8454de18-7b2f-5c0a-80e6-bcd6b673533c, identifier: JG33606
2026-01-29 06:05:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8454de18-7b2f-5c0a-80e6-bcd6b673533c with identifier: JG33606
2026-01-29 06:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8454de18-7b2f-5c0a-80e6-bcd6b673533c with identifier: JG33606
2026-01-29 06:05:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8454de18-7b2f-5c0a-80e6-bcd6b673533c with identifier: JG33606 to the API
2026-01-29 06:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:05:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:05:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JG33606>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 65,
 'expiration_date': '2026-01-29T16:43:41Z',
 'fuel_type': 'petrol',
 'id': '8454de18-7b2f-5c0a-80e6-bcd6b673533c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG33606',
 'listing': 'auction',
 'location': 'FR, Marsannay-la-Côte',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 67829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.0 SCe Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2020}
2026-01-29 06:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG33606%27 HTTP/1.1" 200 None
2026-01-29 06:05:10 [auto1.fr] INFO: Saving data for JG33606: {'auction_closing_time': 1769705021.0, 'created_time': 1769580152.113433, 'last_price_update_time': 1769666710.755197}
2026-01-29 06:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JG33606') HTTP/1.1" 204 0
2026-01-29 06:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LA02782> (referer: https://www.auto1.com/v1/car-details-view/LA02782/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XP86000> (referer: https://www.auto1.com/v1/car-details-view/XP86000/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PW20444> (referer: https://www.auto1.com/v1/car-details-view/PW20444/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b5a8d96-0b97-5660-8738-34f96d149971 with identifier: LA02782
2026-01-29 06:05:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b5a8d96-0b97-5660-8738-34f96d149971 with scrape type 2
2026-01-29 06:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b5a8d96-0b97-5660-8738-34f96d149971 with scrape type 2
2026-01-29 06:05:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1b5a8d96-0b97-5660-8738-34f96d149971, identifier: LA02782
2026-01-29 06:05:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1b5a8d96-0b97-5660-8738-34f96d149971 with identifier: LA02782
2026-01-29 06:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1b5a8d96-0b97-5660-8738-34f96d149971 with identifier: LA02782
2026-01-29 06:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 134030 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    134030
2026-01-29 06:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 1b5a8d96-0b97-5660-8738-34f96d149971 spider: auto1.fr
2026-01-29 06:05:11 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 1b5a8d96-0b97-5660-8738-34f96d149971 due to rule: high_mileage_for_make.json, error: 134030 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    134030
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 220,
 'expiration_date': '2026-01-29T16:20:36Z',
 'fuel_type': 'petrol',
 'id': '1b5a8d96-0b97-5660-8738-34f96d149971',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA02782',
 'listing': 'auction',
 'location': 'FR, Metz',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 134030,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.6 TCe Energy Renault Sport Trophy',
 'transmission': 'automatic',
 'trim': 'Sport Trophy',
 'year': 2017}
2026-01-29 06:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LA02782%27 HTTP/1.1" 200 None
2026-01-29 06:05:11 [auto1.fr] INFO: Saving data for LA02782: {'auction_closing_time': 1769703636.0, 'created_time': 1769533590.781739, 'last_price_update_time': 1769666711.17151}
2026-01-29 06:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LA02782') HTTP/1.1" 204 0
2026-01-29 06:05:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9465377-a3e1-50a2-9d10-e9fd6199932a with identifier: XP86000
2026-01-29 06:05:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9465377-a3e1-50a2-9d10-e9fd6199932a with scrape type 2
2026-01-29 06:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9465377-a3e1-50a2-9d10-e9fd6199932a with scrape type 2
2026-01-29 06:05:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e9465377-a3e1-50a2-9d10-e9fd6199932a, identifier: XP86000
2026-01-29 06:05:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0abc673e-2db2-59f4-bcfb-0cdd95545ec3 with identifier: PW20444
2026-01-29 06:05:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0abc673e-2db2-59f4-bcfb-0cdd95545ec3 with scrape type 2
2026-01-29 06:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0abc673e-2db2-59f4-bcfb-0cdd95545ec3 with scrape type 2
2026-01-29 06:05:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0abc673e-2db2-59f4-bcfb-0cdd95545ec3, identifier: PW20444
2026-01-29 06:05:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e9465377-a3e1-50a2-9d10-e9fd6199932a with identifier: XP86000
2026-01-29 06:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e9465377-a3e1-50a2-9d10-e9fd6199932a with identifier: XP86000
2026-01-29 06:05:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e9465377-a3e1-50a2-9d10-e9fd6199932a with identifier: XP86000 to the API
2026-01-29 06:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:05:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:05:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XP86000>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:53:34Z',
 'fuel_type': 'diesel',
 'id': 'e9465377-a3e1-50a2-9d10-e9fd6199932a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP86000',
 'listing': 'auction',
 'location': 'FR, Fouquières-lès-Lens',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 78709,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2026-01-29 06:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XP86000%27 HTTP/1.1" 200 None
2026-01-29 06:05:11 [auto1.fr] INFO: Saving data for XP86000: {'auction_closing_time': 1769705614.0, 'created_time': 1769533321.348579, 'last_price_update_time': 1769666711.728927}
2026-01-29 06:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XP86000') HTTP/1.1" 204 0
2026-01-29 06:05:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0abc673e-2db2-59f4-bcfb-0cdd95545ec3 with identifier: PW20444
2026-01-29 06:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0abc673e-2db2-59f4-bcfb-0cdd95545ec3 with identifier: PW20444
2026-01-29 06:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 e-thp gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'manual', 'odometer': 73502, 'odometer_reading_unit': 'km', 'registration_date': '2018-08-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pw20444', 'expiration_date': '2026-01-29t16:41:08z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 117, 'id': '0abc673e-2db2-59f4-bcfb-0cdd95545ec3', 'current_year_diff': 8, 'age_in_months': 89, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 73502}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 89,
     'auction_title': '',
     'c_o_2_emission_value': 117,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:41:08z',
     'fuel_type': 'petrol',
     'id': '0abc673e-2db2-59f4-bcfb-0cdd95545ec3',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pw20444',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 73502,
     'odometer_in_km': 73502,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-08-28',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 e-thp gt line',
     'transmission': 'manual',
     'trim': 'gt line',
     'year': 2018}
2026-01-29 06:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 0abc673e-2db2-59f4-bcfb-0cdd95545ec3 spider: auto1.fr
2026-01-29 06:05:11 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 0abc673e-2db2-59f4-bcfb-0cdd95545ec3 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 e-thp gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'manual', 'odometer': 73502, 'odometer_reading_unit': 'km', 'registration_date': '2018-08-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pw20444', 'expiration_date': '2026-01-29t16:41:08z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 117, 'id': '0abc673e-2db2-59f4-bcfb-0cdd95545ec3', 'current_year_diff': 8, 'age_in_months': 89, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 73502}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 89,
     'auction_title': '',
     'c_o_2_emission_value': 117,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:41:08z',
     'fuel_type': 'petrol',
     'id': '0abc673e-2db2-59f4-bcfb-0cdd95545ec3',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pw20444',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 73502,
     'odometer_in_km': 73502,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-08-28',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 e-thp gt line',
     'transmission': 'manual',
     'trim': 'gt line',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:41:08Z',
 'fuel_type': 'petrol',
 'id': '0abc673e-2db2-59f4-bcfb-0cdd95545ec3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW20444',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 73502,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 e-THP GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2018}
2026-01-29 06:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PW20444%27 HTTP/1.1" 200 None
2026-01-29 06:05:12 [auto1.fr] INFO: Saving data for PW20444: {'auction_closing_time': 1769704868.0, 'created_time': 1768413655.885049, 'last_price_update_time': 1769666712.022433}
2026-01-29 06:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PW20444') HTTP/1.1" 204 0
2026-01-29 06:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NY83567/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CY52840/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SE84757/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HW30174/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:12 [scrapy.extensions.logstats] INFO: Crawled 433 pages (at 178 pages/min), scraped 88 items (at 37 items/min)
2026-01-29 06:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SB11289/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KE96645/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JJ24826> (referer: https://www.auto1.com/v1/car-details-view/JJ24826/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47889689-f8f8-5064-82c4-c025af007ef9 with identifier: JJ24826
2026-01-29 06:05:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47889689-f8f8-5064-82c4-c025af007ef9 with scrape type 2
2026-01-29 06:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47889689-f8f8-5064-82c4-c025af007ef9 with scrape type 2
2026-01-29 06:05:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 47889689-f8f8-5064-82c4-c025af007ef9, identifier: JJ24826
2026-01-29 06:05:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 47889689-f8f8-5064-82c4-c025af007ef9 with identifier: JJ24826
2026-01-29 06:05:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 47889689-f8f8-5064-82c4-c025af007ef9 with identifier: JJ24826
2026-01-29 06:05:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 20840, 'odometer_reading_unit': 'km', 'registration_date': '2024-03-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jj24826', 'expiration_date': '2026-01-29t16:45:18z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2024, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 123, 'id': '47889689-f8f8-5064-82c4-c025af007ef9', 'current_year_diff': 2, 'age_in_months': 22, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 20840}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 22,
     'auction_title': '',
     'c_o_2_emission_value': 123,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:45:18z',
     'fuel_type': 'petrol',
     'id': '47889689-f8f8-5064-82c4-c025af007ef9',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jj24826',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 20840,
     'odometer_in_km': 20840,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2024-03-28',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2024}
2026-01-29 06:05:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 47889689-f8f8-5064-82c4-c025af007ef9 spider: auto1.fr
2026-01-29 06:05:13 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 47889689-f8f8-5064-82c4-c025af007ef9 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 20840, 'odometer_reading_unit': 'km', 'registration_date': '2024-03-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jj24826', 'expiration_date': '2026-01-29t16:45:18z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2024, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 123, 'id': '47889689-f8f8-5064-82c4-c025af007ef9', 'current_year_diff': 2, 'age_in_months': 22, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 20840}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 22,
     'auction_title': '',
     'c_o_2_emission_value': 123,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:45:18z',
     'fuel_type': 'petrol',
     'id': '47889689-f8f8-5064-82c4-c025af007ef9',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jj24826',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 20840,
     'odometer_in_km': 20840,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2024-03-28',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2024}
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:45:18Z',
 'fuel_type': 'petrol',
 'id': '47889689-f8f8-5064-82c4-c025af007ef9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ24826',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 20840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2024}
2026-01-29 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ24826%27 HTTP/1.1" 200 None
2026-01-29 06:05:13 [auto1.fr] INFO: Saving data for JJ24826: {'auction_closing_time': 1769705118.0, 'created_time': 1769580062.919898, 'last_price_update_time': 1769666713.199631}
2026-01-29 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JJ24826') HTTP/1.1" 204 0
2026-01-29 06:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VE92279> (referer: https://www.auto1.com/v1/car-details-view/VE92279/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AS13527> (referer: https://www.auto1.com/v1/car-details-view/AS13527/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TN94946/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NP76609> (referer: https://www.auto1.com/v1/car-details-view/NP76609/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ee842df-fb48-5f1f-956f-f02c3d778584 with identifier: VE92279
2026-01-29 06:05:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ee842df-fb48-5f1f-956f-f02c3d778584 with scrape type 2
2026-01-29 06:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ee842df-fb48-5f1f-956f-f02c3d778584 with scrape type 2
2026-01-29 06:05:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5ee842df-fb48-5f1f-956f-f02c3d778584, identifier: VE92279
2026-01-29 06:05:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb34a6f8-7faa-5a93-b621-56808c917ba3 with identifier: AS13527
2026-01-29 06:05:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb34a6f8-7faa-5a93-b621-56808c917ba3 with scrape type 2
2026-01-29 06:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb34a6f8-7faa-5a93-b621-56808c917ba3 with scrape type 2
2026-01-29 06:05:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bb34a6f8-7faa-5a93-b621-56808c917ba3, identifier: AS13527
2026-01-29 06:05:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5ee842df-fb48-5f1f-956f-f02c3d778584 with identifier: VE92279
2026-01-29 06:05:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5ee842df-fb48-5f1f-956f-f02c3d778584 with identifier: VE92279
2026-01-29 06:05:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5ee842df-fb48-5f1f-956f-f02c3d778584 with identifier: VE92279 to the API
2026-01-29 06:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:05:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:05:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VE92279>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:23:14Z',
 'fuel_type': 'diesel',
 'id': '5ee842df-fb48-5f1f-956f-f02c3d778584',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE92279',
 'listing': 'auction',
 'location': 'FR, Warluis',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 55369,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi Allure Business',
 'transmission': 'automatic',
 'trim': 'Allure Business',
 'year': 2021}
2026-01-29 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VE92279%27 HTTP/1.1" 200 None
2026-01-29 06:05:13 [auto1.fr] INFO: Saving data for VE92279: {'auction_closing_time': 1769703794.0, 'created_time': 1769534151.643803, 'last_price_update_time': 1769666713.871758}
2026-01-29 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VE92279') HTTP/1.1" 204 0
2026-01-29 06:05:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bb34a6f8-7faa-5a93-b621-56808c917ba3 with identifier: AS13527
2026-01-29 06:05:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bb34a6f8-7faa-5a93-b621-56808c917ba3 with identifier: AS13527
2026-01-29 06:05:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bb34a6f8-7faa-5a93-b621-56808c917ba3 with identifier: AS13527 to the API
2026-01-29 06:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:05:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:05:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AS13527>
{'auction_title': '',
 'c_o_2_emission_value': 86,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:20:53Z',
 'fuel_type': 'diesel',
 'id': 'bb34a6f8-7faa-5a93-b621-56808c917ba3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS13527',
 'listing': 'auction',
 'location': 'FR, Villenoy',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 106097,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.5 Blue-HDi Feel Business',
 'transmission': 'manual',
 'trim': 'Feel Business',
 'year': 2019}
2026-01-29 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AS13527%27 HTTP/1.1" 200 None
2026-01-29 06:05:14 [auto1.fr] INFO: Saving data for AS13527: {'auction_closing_time': 1769703653.0, 'created_time': 1769533893.439425, 'last_price_update_time': 1769666714.220805}
2026-01-29 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AS13527') HTTP/1.1" 204 0
2026-01-29 06:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FL97269/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UB10911/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f57eede8-3fec-5607-b348-2952e8d4d169 with identifier: NP76609
2026-01-29 06:05:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f57eede8-3fec-5607-b348-2952e8d4d169 with scrape type 2
2026-01-29 06:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f57eede8-3fec-5607-b348-2952e8d4d169 with scrape type 2
2026-01-29 06:05:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f57eede8-3fec-5607-b348-2952e8d4d169, identifier: NP76609
2026-01-29 06:05:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f57eede8-3fec-5607-b348-2952e8d4d169 with identifier: NP76609
2026-01-29 06:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f57eede8-3fec-5607-b348-2952e8d4d169 with identifier: NP76609
2026-01-29 06:05:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f57eede8-3fec-5607-b348-2952e8d4d169 with identifier: NP76609 to the API
2026-01-29 06:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:05:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:05:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NP76609>
{'auction_title': '',
 'c_o_2_emission_value': 79,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 381,
 'expiration_date': '2026-01-29T16:30:34Z',
 'fuel_type': 'hybrid',
 'id': 'f57eede8-3fec-5607-b348-2952e8d4d169',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP76609',
 'listing': 'auction',
 'location': 'FR',
 'make': 'Jeep',
 'model': 'Wrangler Unlimited',
 'odometer': 81026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Wrangler Unlimited 2.0 4xe Plug-in Hybrid 80th Anniversary',
 'transmission': 'automatic',
 'trim': '80th Anniversary',
 'year': 2021}
2026-01-29 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NP76609%27 HTTP/1.1" 200 None
2026-01-29 06:05:14 [auto1.fr] INFO: Saving data for NP76609: {'auction_closing_time': 1769704234.0, 'created_time': 1769533952.125527, 'last_price_update_time': 1769666714.744184}
2026-01-29 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NP76609') HTTP/1.1" 204 0
2026-01-29 06:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EN35537> (referer: https://www.auto1.com/v1/car-details-view/EN35537/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d739f91-223a-56b5-8e5b-8849359f4752 with identifier: EN35537
2026-01-29 06:05:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d739f91-223a-56b5-8e5b-8849359f4752 with scrape type 2
2026-01-29 06:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d739f91-223a-56b5-8e5b-8849359f4752 with scrape type 2
2026-01-29 06:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1d739f91-223a-56b5-8e5b-8849359f4752, identifier: EN35537
2026-01-29 06:05:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1d739f91-223a-56b5-8e5b-8849359f4752 with identifier: EN35537
2026-01-29 06:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1d739f91-223a-56b5-8e5b-8849359f4752 with identifier: EN35537
2026-01-29 06:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2026-01-29 06:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 1d739f91-223a-56b5-8e5b-8849359f4752 spider: auto1.fr
2026-01-29 06:05:15 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 1d739f91-223a-56b5-8e5b-8849359f4752 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:11:15Z',
 'fuel_type': 'diesel',
 'id': '1d739f91-223a-56b5-8e5b-8849359f4752',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN35537',
 'listing': 'auction',
 'location': 'FR, Carrières-sous-Poissy',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 60008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Club M',
 'transmission': 'manual',
 'trim': 'Club M',
 'year': 2022}
2026-01-29 06:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EN35537%27 HTTP/1.1" 200 None
2026-01-29 06:05:15 [auto1.fr] INFO: Saving data for EN35537: {'auction_closing_time': 1769703075.0, 'created_time': 1769533523.181538, 'last_price_update_time': 1769666715.424075}
2026-01-29 06:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EN35537') HTTP/1.1" 204 0
2026-01-29 06:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NL37079> (referer: https://www.auto1.com/v1/car-details-view/NL37079/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VG16954/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a2677ab-186c-54c4-aa3d-fa68ca8b74d9 with identifier: NL37079
2026-01-29 06:05:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a2677ab-186c-54c4-aa3d-fa68ca8b74d9 with scrape type 2
2026-01-29 06:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a2677ab-186c-54c4-aa3d-fa68ca8b74d9 with scrape type 2
2026-01-29 06:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4a2677ab-186c-54c4-aa3d-fa68ca8b74d9, identifier: NL37079
2026-01-29 06:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EG40309> (referer: https://www.auto1.com/v1/car-details-view/EG40309/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZG43153> (referer: https://www.auto1.com/v1/car-details-view/ZG43153/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XL69196/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4a2677ab-186c-54c4-aa3d-fa68ca8b74d9 with identifier: NL37079
2026-01-29 06:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4a2677ab-186c-54c4-aa3d-fa68ca8b74d9 with identifier: NL37079
2026-01-29 06:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'renault kangoo 1.2 tce intens', 'price': 0, 'currency': 'eur', 'make': 'renault', 'model': 'kangoo', 'transmission': 'automatic', 'odometer': 105774, 'odometer_reading_unit': 'km', 'registration_date': '2017-07-18', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nl37079', 'expiration_date': '2026-01-29t16:13:30z', 'origin_country_code': 'fr', 'trim': 'intens', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 114, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, saint-saulve', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 144, 'id': '4a2677ab-186c-54c4-aa3d-fa68ca8b74d9', 'current_year_diff': 9, 'age_in_months': 102, 'make_model': 'renault kangoo', 'sanitized_make': 'renault', 'odometer_in_km': 105774}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 102,
     'auction_title': '',
     'c_o_2_emission_value': 144,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 114,
     'expiration_date': '2026-01-29t16:13:30z',
     'fuel_type': 'petrol',
     'id': '4a2677ab-186c-54c4-aa3d-fa68ca8b74d9',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nl37079',
     'listing': 'auction',
     'location': 'fr, saint-saulve',
     'make': 'renault',
     'make_model': 'renault kangoo',
     'model': 'kangoo',
     'odometer': 105774,
     'odometer_in_km': 105774,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-07-18',
     'sanitized_make': 'renault',
     'seats_number': 5,
     'seller_name': None,
     'title': 'renault kangoo 1.2 tce intens',
     'transmission': 'automatic',
     'trim': 'intens',
     'year': 2017}
2026-01-29 06:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 4a2677ab-186c-54c4-aa3d-fa68ca8b74d9 spider: auto1.fr
2026-01-29 06:05:15 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 4a2677ab-186c-54c4-aa3d-fa68ca8b74d9 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'renault kangoo 1.2 tce intens', 'price': 0, 'currency': 'eur', 'make': 'renault', 'model': 'kangoo', 'transmission': 'automatic', 'odometer': 105774, 'odometer_reading_unit': 'km', 'registration_date': '2017-07-18', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nl37079', 'expiration_date': '2026-01-29t16:13:30z', 'origin_country_code': 'fr', 'trim': 'intens', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 114, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, saint-saulve', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 144, 'id': '4a2677ab-186c-54c4-aa3d-fa68ca8b74d9', 'current_year_diff': 9, 'age_in_months': 102, 'make_model': 'renault kangoo', 'sanitized_make': 'renault', 'odometer_in_km': 105774}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 102,
     'auction_title': '',
     'c_o_2_emission_value': 144,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 114,
     'expiration_date': '2026-01-29t16:13:30z',
     'fuel_type': 'petrol',
     'id': '4a2677ab-186c-54c4-aa3d-fa68ca8b74d9',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nl37079',
     'listing': 'auction',
     'location': 'fr, saint-saulve',
     'make': 'renault',
     'make_model': 'renault kangoo',
     'model': 'kangoo',
     'odometer': 105774,
     'odometer_in_km': 105774,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-07-18',
     'sanitized_make': 'renault',
     'seats_number': 5,
     'seller_name': None,
     'title': 'renault kangoo 1.2 tce intens',
     'transmission': 'automatic',
     'trim': 'intens',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 114,
 'expiration_date': '2026-01-29T16:13:30Z',
 'fuel_type': 'petrol',
 'id': '4a2677ab-186c-54c4-aa3d-fa68ca8b74d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL37079',
 'listing': 'auction',
 'location': 'FR, Saint-Saulve',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 105774,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Kangoo 1.2 TCe Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2017}
2026-01-29 06:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NL37079%27 HTTP/1.1" 200 None
2026-01-29 06:05:15 [auto1.fr] INFO: Saving data for NL37079: {'auction_closing_time': 1769703210.0, 'created_time': 1768844312.651864, 'last_price_update_time': 1769666715.944442}
2026-01-29 06:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NL37079') HTTP/1.1" 204 0
2026-01-29 06:05:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HW30174> (referer: https://www.auto1.com/v1/car-details-view/HW30174/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbf50ef1-b350-5804-950b-2171d925805e with identifier: EG40309
2026-01-29 06:05:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbf50ef1-b350-5804-950b-2171d925805e with scrape type 2
2026-01-29 06:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbf50ef1-b350-5804-950b-2171d925805e with scrape type 2
2026-01-29 06:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cbf50ef1-b350-5804-950b-2171d925805e, identifier: EG40309
2026-01-29 06:05:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2551b512-dca6-5126-9547-dfeb8a2bd2e2 with identifier: ZG43153
2026-01-29 06:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2551b512-dca6-5126-9547-dfeb8a2bd2e2 with scrape type 2
2026-01-29 06:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2551b512-dca6-5126-9547-dfeb8a2bd2e2 with scrape type 2
2026-01-29 06:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2551b512-dca6-5126-9547-dfeb8a2bd2e2, identifier: ZG43153
2026-01-29 06:05:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cbf50ef1-b350-5804-950b-2171d925805e with identifier: EG40309
2026-01-29 06:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cbf50ef1-b350-5804-950b-2171d925805e with identifier: EG40309
2026-01-29 06:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 13454, 'odometer_reading_unit': 'km', 'registration_date': '2023-04-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/eg40309', 'expiration_date': '2026-01-29t16:59:46z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 123, 'id': 'cbf50ef1-b350-5804-950b-2171d925805e', 'current_year_diff': 3, 'age_in_months': 33, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 13454}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 33,
     'auction_title': '',
     'c_o_2_emission_value': 123,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:59:46z',
     'fuel_type': 'petrol',
     'id': 'cbf50ef1-b350-5804-950b-2171d925805e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/eg40309',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 13454,
     'odometer_in_km': 13454,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-04-26',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2023}
2026-01-29 06:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: cbf50ef1-b350-5804-950b-2171d925805e spider: auto1.fr
2026-01-29 06:05:16 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: cbf50ef1-b350-5804-950b-2171d925805e due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 13454, 'odometer_reading_unit': 'km', 'registration_date': '2023-04-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/eg40309', 'expiration_date': '2026-01-29t16:59:46z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 123, 'id': 'cbf50ef1-b350-5804-950b-2171d925805e', 'current_year_diff': 3, 'age_in_months': 33, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 13454}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 33,
     'auction_title': '',
     'c_o_2_emission_value': 123,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:59:46z',
     'fuel_type': 'petrol',
     'id': 'cbf50ef1-b350-5804-950b-2171d925805e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/eg40309',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 13454,
     'odometer_in_km': 13454,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-04-26',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:59:46Z',
 'fuel_type': 'petrol',
 'id': 'cbf50ef1-b350-5804-950b-2171d925805e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG40309',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 13454,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-04-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2023}
2026-01-29 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EG40309%27 HTTP/1.1" 200 None
2026-01-29 06:05:16 [auto1.fr] INFO: Saving data for EG40309: {'auction_closing_time': 1769705986.0, 'created_time': 1768669273.3786, 'last_price_update_time': 1769666716.40403}
2026-01-29 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EG40309') HTTP/1.1" 204 0
2026-01-29 06:05:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2551b512-dca6-5126-9547-dfeb8a2bd2e2 with identifier: ZG43153
2026-01-29 06:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2551b512-dca6-5126-9547-dfeb8a2bd2e2 with identifier: ZG43153
2026-01-29 06:05:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2551b512-dca6-5126-9547-dfeb8a2bd2e2 with identifier: ZG43153 to the API
2026-01-29 06:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:05:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:05:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZG43153>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:44:57Z',
 'fuel_type': 'diesel',
 'id': '2551b512-dca6-5126-9547-dfeb8a2bd2e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG43153',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 102744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 CRDi Mild-Hybrid N-Line Edition 2WD',
 'transmission': 'manual',
 'trim': 'N-Line Edition 2WD',
 'year': 2020}
2026-01-29 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG43153%27 HTTP/1.1" 200 None
2026-01-29 06:05:16 [auto1.fr] INFO: Saving data for ZG43153: {'auction_closing_time': 1769705097.0, 'created_time': 1769533745.173642, 'last_price_update_time': 1769666716.761197}
2026-01-29 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZG43153') HTTP/1.1" 204 0
2026-01-29 06:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SB11289> (referer: https://www.auto1.com/v1/car-details-view/SB11289/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KE96645> (referer: https://www.auto1.com/v1/car-details-view/KE96645/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SE84757> (referer: https://www.auto1.com/v1/car-details-view/SE84757/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4bc0121-e4d3-5274-bc94-324607992938 with identifier: HW30174
2026-01-29 06:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4bc0121-e4d3-5274-bc94-324607992938 with scrape type 2
2026-01-29 06:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4bc0121-e4d3-5274-bc94-324607992938 with scrape type 2
2026-01-29 06:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f4bc0121-e4d3-5274-bc94-324607992938, identifier: HW30174
2026-01-29 06:05:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f4bc0121-e4d3-5274-bc94-324607992938 with identifier: HW30174
2026-01-29 06:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f4bc0121-e4d3-5274-bc94-324607992938 with identifier: HW30174
2026-01-29 06:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 vti active', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 71172, 'odometer_reading_unit': 'km', 'registration_date': '2018-01-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hw30174', 'expiration_date': '2026-01-29t16:49:35z', 'origin_country_code': 'fr', 'trim': 'active', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'montévrain', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 104, 'id': 'f4bc0121-e4d3-5274-bc94-324607992938', 'current_year_diff': 8, 'age_in_months': 96, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 71172}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 96,
     'auction_title': '',
     'c_o_2_emission_value': 104,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:49:35z',
     'fuel_type': 'petrol',
     'id': 'f4bc0121-e4d3-5274-bc94-324607992938',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hw30174',
     'listing': 'auction',
     'location': 'montévrain',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 71172,
     'odometer_in_km': 71172,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-01-28',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 vti active',
     'transmission': 'manual',
     'trim': 'active',
     'year': 2018}
2026-01-29 06:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: f4bc0121-e4d3-5274-bc94-324607992938 spider: auto1.fr
2026-01-29 06:05:17 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: f4bc0121-e4d3-5274-bc94-324607992938 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 vti active', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 71172, 'odometer_reading_unit': 'km', 'registration_date': '2018-01-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hw30174', 'expiration_date': '2026-01-29t16:49:35z', 'origin_country_code': 'fr', 'trim': 'active', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'montévrain', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 104, 'id': 'f4bc0121-e4d3-5274-bc94-324607992938', 'current_year_diff': 8, 'age_in_months': 96, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 71172}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 96,
     'auction_title': '',
     'c_o_2_emission_value': 104,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:49:35z',
     'fuel_type': 'petrol',
     'id': 'f4bc0121-e4d3-5274-bc94-324607992938',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hw30174',
     'listing': 'auction',
     'location': 'montévrain',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 71172,
     'odometer_in_km': 71172,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-01-28',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 vti active',
     'transmission': 'manual',
     'trim': 'active',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:49:35Z',
 'fuel_type': 'petrol',
 'id': 'f4bc0121-e4d3-5274-bc94-324607992938',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW30174',
 'listing': 'auction',
 'location': 'Montévrain',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 71172,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2018}
2026-01-29 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HW30174%27 HTTP/1.1" 200 None
2026-01-29 06:05:17 [auto1.fr] INFO: Saving data for HW30174: {'auction_closing_time': 1769705375.0, 'created_time': 1769533549.574573, 'last_price_update_time': 1769666717.117427}
2026-01-29 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HW30174') HTTP/1.1" 204 0
2026-01-29 06:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52892e51-2538-5ef0-b959-945eec6ec0b8 with identifier: SB11289
2026-01-29 06:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52892e51-2538-5ef0-b959-945eec6ec0b8 with scrape type 2
2026-01-29 06:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52892e51-2538-5ef0-b959-945eec6ec0b8 with scrape type 2
2026-01-29 06:05:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 52892e51-2538-5ef0-b959-945eec6ec0b8, identifier: SB11289
2026-01-29 06:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68047fab-e294-559a-8cb1-71b40cd8e288 with identifier: KE96645
2026-01-29 06:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68047fab-e294-559a-8cb1-71b40cd8e288 with scrape type 2
2026-01-29 06:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68047fab-e294-559a-8cb1-71b40cd8e288 with scrape type 2
2026-01-29 06:05:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 68047fab-e294-559a-8cb1-71b40cd8e288, identifier: KE96645
2026-01-29 06:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c14d42e0-58fb-566f-8ea4-7253d26b30ff with identifier: SE84757
2026-01-29 06:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c14d42e0-58fb-566f-8ea4-7253d26b30ff with scrape type 2
2026-01-29 06:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c14d42e0-58fb-566f-8ea4-7253d26b30ff with scrape type 2
2026-01-29 06:05:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c14d42e0-58fb-566f-8ea4-7253d26b30ff, identifier: SE84757
2026-01-29 06:05:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 52892e51-2538-5ef0-b959-945eec6ec0b8 with identifier: SB11289
2026-01-29 06:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 52892e51-2538-5ef0-b959-945eec6ec0b8 with identifier: SB11289
2026-01-29 06:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'orange', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 55000, 'odometer_reading_unit': 'km', 'registration_date': '2020-10-15', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sb11289', 'expiration_date': '2026-01-29t16:38:08z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, villenoy', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 127, 'id': '52892e51-2538-5ef0-b959-945eec6ec0b8', 'current_year_diff': 6, 'age_in_months': 63, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 55000}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 63,
     'auction_title': '',
     'c_o_2_emission_value': 127,
     'category': None,
     'color': 'orange',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:38:08z',
     'fuel_type': 'petrol',
     'id': '52892e51-2538-5ef0-b959-945eec6ec0b8',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sb11289',
     'listing': 'auction',
     'location': 'fr, villenoy',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 55000,
     'odometer_in_km': 55000,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-10-15',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2020}
2026-01-29 06:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 52892e51-2538-5ef0-b959-945eec6ec0b8 spider: auto1.fr
2026-01-29 06:05:17 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 52892e51-2538-5ef0-b959-945eec6ec0b8 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'orange', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 55000, 'odometer_reading_unit': 'km', 'registration_date': '2020-10-15', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sb11289', 'expiration_date': '2026-01-29t16:38:08z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, villenoy', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 127, 'id': '52892e51-2538-5ef0-b959-945eec6ec0b8', 'current_year_diff': 6, 'age_in_months': 63, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 55000}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 63,
     'auction_title': '',
     'c_o_2_emission_value': 127,
     'category': None,
     'color': 'orange',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:38:08z',
     'fuel_type': 'petrol',
     'id': '52892e51-2538-5ef0-b959-945eec6ec0b8',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sb11289',
     'listing': 'auction',
     'location': 'fr, villenoy',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 55000,
     'odometer_in_km': 55000,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-10-15',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:38:08Z',
 'fuel_type': 'petrol',
 'id': '52892e51-2538-5ef0-b959-945eec6ec0b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB11289',
 'listing': 'auction',
 'location': 'FR, Villenoy',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 55000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-01-29 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SB11289%27 HTTP/1.1" 200 None
2026-01-29 06:05:17 [auto1.fr] INFO: Saving data for SB11289: {'auction_closing_time': 1769704688.0, 'created_time': 1767679297.964789, 'last_price_update_time': 1769666717.682473}
2026-01-29 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SB11289') HTTP/1.1" 204 0
2026-01-29 06:05:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 68047fab-e294-559a-8cb1-71b40cd8e288 with identifier: KE96645
2026-01-29 06:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 68047fab-e294-559a-8cb1-71b40cd8e288 with identifier: KE96645
2026-01-29 06:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech allure pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'manual', 'odometer': 39752, 'odometer_reading_unit': 'km', 'registration_date': '2024-01-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ke96645', 'expiration_date': '2026-01-29t16:17:01z', 'origin_country_code': 'fr', 'trim': 'allure pack', 'year': 2024, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, strasbourg', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 138, 'id': '68047fab-e294-559a-8cb1-71b40cd8e288', 'current_year_diff': 2, 'age_in_months': 24, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 39752}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 24,
     'auction_title': '',
     'c_o_2_emission_value': 138,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:17:01z',
     'fuel_type': 'petrol',
     'id': '68047fab-e294-559a-8cb1-71b40cd8e288',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ke96645',
     'listing': 'auction',
     'location': 'fr, strasbourg',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 39752,
     'odometer_in_km': 39752,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2024-01-24',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 puretech allure pack',
     'transmission': 'manual',
     'trim': 'allure pack',
     'year': 2024}
2026-01-29 06:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 68047fab-e294-559a-8cb1-71b40cd8e288 spider: auto1.fr
2026-01-29 06:05:17 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 68047fab-e294-559a-8cb1-71b40cd8e288 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech allure pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'manual', 'odometer': 39752, 'odometer_reading_unit': 'km', 'registration_date': '2024-01-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ke96645', 'expiration_date': '2026-01-29t16:17:01z', 'origin_country_code': 'fr', 'trim': 'allure pack', 'year': 2024, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, strasbourg', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 138, 'id': '68047fab-e294-559a-8cb1-71b40cd8e288', 'current_year_diff': 2, 'age_in_months': 24, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 39752}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 24,
     'auction_title': '',
     'c_o_2_emission_value': 138,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:17:01z',
     'fuel_type': 'petrol',
     'id': '68047fab-e294-559a-8cb1-71b40cd8e288',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ke96645',
     'listing': 'auction',
     'location': 'fr, strasbourg',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 39752,
     'odometer_in_km': 39752,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2024-01-24',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 puretech allure pack',
     'transmission': 'manual',
     'trim': 'allure pack',
     'year': 2024}
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:17:01Z',
 'fuel_type': 'petrol',
 'id': '68047fab-e294-559a-8cb1-71b40cd8e288',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE96645',
 'listing': 'auction',
 'location': 'FR, Strasbourg',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 39752,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-01-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Allure Pack',
 'transmission': 'manual',
 'trim': 'Allure Pack',
 'year': 2024}
2026-01-29 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KE96645%27 HTTP/1.1" 200 None
2026-01-29 06:05:17 [auto1.fr] INFO: Saving data for KE96645: {'auction_closing_time': 1769703421.0, 'created_time': 1769580152.393434, 'last_price_update_time': 1769666717.916024}
2026-01-29 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KE96645') HTTP/1.1" 204 0
2026-01-29 06:05:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c14d42e0-58fb-566f-8ea4-7253d26b30ff with identifier: SE84757
2026-01-29 06:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c14d42e0-58fb-566f-8ea4-7253d26b30ff with identifier: SE84757
2026-01-29 06:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 e-thp gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 89483, 'odometer_reading_unit': 'km', 'registration_date': '2017-03-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/se84757', 'expiration_date': '2026-01-29t16:18:39z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ingrandes sur vienne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 110, 'id': 'c14d42e0-58fb-566f-8ea4-7253d26b30ff', 'current_year_diff': 9, 'age_in_months': 106, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 89483}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 106,
     'auction_title': '',
     'c_o_2_emission_value': 110,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:18:39z',
     'fuel_type': 'petrol',
     'id': 'c14d42e0-58fb-566f-8ea4-7253d26b30ff',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/se84757',
     'listing': 'auction',
     'location': 'fr, ingrandes sur vienne',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 89483,
     'odometer_in_km': 89483,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-03-29',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 e-thp gt line',
     'transmission': 'automatic',
     'trim': 'gt line',
     'year': 2017}
2026-01-29 06:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: c14d42e0-58fb-566f-8ea4-7253d26b30ff spider: auto1.fr
2026-01-29 06:05:18 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: c14d42e0-58fb-566f-8ea4-7253d26b30ff due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 e-thp gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 89483, 'odometer_reading_unit': 'km', 'registration_date': '2017-03-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/se84757', 'expiration_date': '2026-01-29t16:18:39z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ingrandes sur vienne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 110, 'id': 'c14d42e0-58fb-566f-8ea4-7253d26b30ff', 'current_year_diff': 9, 'age_in_months': 106, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 89483}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 106,
     'auction_title': '',
     'c_o_2_emission_value': 110,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:18:39z',
     'fuel_type': 'petrol',
     'id': 'c14d42e0-58fb-566f-8ea4-7253d26b30ff',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/se84757',
     'listing': 'auction',
     'location': 'fr, ingrandes sur vienne',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 89483,
     'odometer_in_km': 89483,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-03-29',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 e-thp gt line',
     'transmission': 'automatic',
     'trim': 'gt line',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:18:39Z',
 'fuel_type': 'petrol',
 'id': 'c14d42e0-58fb-566f-8ea4-7253d26b30ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE84757',
 'listing': 'auction',
 'location': 'FR, Ingrandes sur Vienne',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 89483,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 e-THP GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2017}
2026-01-29 06:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SE84757%27 HTTP/1.1" 200 None
2026-01-29 06:05:18 [auto1.fr] INFO: Saving data for SE84757: {'auction_closing_time': 1769703519.0, 'created_time': 1768323715.64504, 'last_price_update_time': 1769666718.167006}
2026-01-29 06:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SE84757') HTTP/1.1" 204 0
2026-01-29 06:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NY83567> (referer: https://www.auto1.com/v1/car-details-view/NY83567/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CY52840> (referer: https://www.auto1.com/v1/car-details-view/CY52840/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TN94946> (referer: https://www.auto1.com/v1/car-details-view/TN94946/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DV64570> (referer: https://www.auto1.com/v1/car-details-view/DV64570/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a3f6013-7c55-58bb-bc10-55cf9b9d3aea with identifier: NY83567
2026-01-29 06:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a3f6013-7c55-58bb-bc10-55cf9b9d3aea with scrape type 2
2026-01-29 06:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a3f6013-7c55-58bb-bc10-55cf9b9d3aea with scrape type 2
2026-01-29 06:05:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3a3f6013-7c55-58bb-bc10-55cf9b9d3aea, identifier: NY83567
2026-01-29 06:05:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3a3f6013-7c55-58bb-bc10-55cf9b9d3aea with identifier: NY83567
2026-01-29 06:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3a3f6013-7c55-58bb-bc10-55cf9b9d3aea with identifier: NY83567
2026-01-29 06:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'yellow', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech active', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'automatic', 'odometer': 59797, 'odometer_reading_unit': 'km', 'registration_date': '2020-07-22', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ny83567', 'expiration_date': '2026-01-29t16:08:47z', 'origin_country_code': 'fr', 'trim': 'active', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, beaucaire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 131, 'id': '3a3f6013-7c55-58bb-bc10-55cf9b9d3aea', 'current_year_diff': 6, 'age_in_months': 66, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 59797}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 66,
     'auction_title': '',
     'c_o_2_emission_value': 131,
     'category': None,
     'color': 'yellow',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:08:47z',
     'fuel_type': 'petrol',
     'id': '3a3f6013-7c55-58bb-bc10-55cf9b9d3aea',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ny83567',
     'listing': 'auction',
     'location': 'fr, beaucaire',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 59797,
     'odometer_in_km': 59797,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-07-22',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech active',
     'transmission': 'automatic',
     'trim': 'active',
     'year': 2020}
2026-01-29 06:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 3a3f6013-7c55-58bb-bc10-55cf9b9d3aea spider: auto1.fr
2026-01-29 06:05:18 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 3a3f6013-7c55-58bb-bc10-55cf9b9d3aea due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'yellow', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech active', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'automatic', 'odometer': 59797, 'odometer_reading_unit': 'km', 'registration_date': '2020-07-22', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ny83567', 'expiration_date': '2026-01-29t16:08:47z', 'origin_country_code': 'fr', 'trim': 'active', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, beaucaire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 131, 'id': '3a3f6013-7c55-58bb-bc10-55cf9b9d3aea', 'current_year_diff': 6, 'age_in_months': 66, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 59797}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 66,
     'auction_title': '',
     'c_o_2_emission_value': 131,
     'category': None,
     'color': 'yellow',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:08:47z',
     'fuel_type': 'petrol',
     'id': '3a3f6013-7c55-58bb-bc10-55cf9b9d3aea',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ny83567',
     'listing': 'auction',
     'location': 'fr, beaucaire',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 59797,
     'odometer_in_km': 59797,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-07-22',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech active',
     'transmission': 'automatic',
     'trim': 'active',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:08:47Z',
 'fuel_type': 'petrol',
 'id': '3a3f6013-7c55-58bb-bc10-55cf9b9d3aea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY83567',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 59797,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2020}
2026-01-29 06:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NY83567%27 HTTP/1.1" 200 None
2026-01-29 06:05:18 [auto1.fr] INFO: Saving data for NY83567: {'auction_closing_time': 1769702927.0, 'created_time': 1768928521.003045, 'last_price_update_time': 1769666718.663312}
2026-01-29 06:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NY83567') HTTP/1.1" 204 0
2026-01-29 06:05:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41abec46-598a-5c92-a596-f61031ab2a9b with identifier: CY52840
2026-01-29 06:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41abec46-598a-5c92-a596-f61031ab2a9b with scrape type 2
2026-01-29 06:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41abec46-598a-5c92-a596-f61031ab2a9b with scrape type 2
2026-01-29 06:05:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 41abec46-598a-5c92-a596-f61031ab2a9b, identifier: CY52840
2026-01-29 06:05:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 123cee9e-5cb5-5e91-aac4-333a2d1a4416 with identifier: TN94946
2026-01-29 06:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 123cee9e-5cb5-5e91-aac4-333a2d1a4416 with scrape type 2
2026-01-29 06:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 123cee9e-5cb5-5e91-aac4-333a2d1a4416 with scrape type 2
2026-01-29 06:05:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 123cee9e-5cb5-5e91-aac4-333a2d1a4416, identifier: TN94946
2026-01-29 06:05:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f36d5081-392c-58ed-a168-c0bd9486bec1 with identifier: DV64570
2026-01-29 06:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f36d5081-392c-58ed-a168-c0bd9486bec1 with scrape type 2
2026-01-29 06:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f36d5081-392c-58ed-a168-c0bd9486bec1 with scrape type 2
2026-01-29 06:05:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f36d5081-392c-58ed-a168-c0bd9486bec1, identifier: DV64570
2026-01-29 06:05:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 41abec46-598a-5c92-a596-f61031ab2a9b with identifier: CY52840
2026-01-29 06:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 41abec46-598a-5c92-a596-f61031ab2a9b with identifier: CY52840
2026-01-29 06:05:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'renault kadjar 1.2 tce energy intens', 'price': 0, 'currency': 'eur', 'make': 'renault', 'model': 'kadjar', 'transmission': 'automatic', 'odometer': 111811, 'odometer_reading_unit': 'km', 'registration_date': '2019-01-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cy52840', 'expiration_date': '2026-01-29t16:03:12z', 'origin_country_code': 'fr', 'trim': 'intens', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, beaucaire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 134, 'id': '41abec46-598a-5c92-a596-f61031ab2a9b', 'current_year_diff': 7, 'age_in_months': 84, 'make_model': 'renault kadjar', 'sanitized_make': 'renault', 'odometer_in_km': 111811}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 84,
     'auction_title': '',
     'c_o_2_emission_value': 134,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:03:12z',
     'fuel_type': 'petrol',
     'id': '41abec46-598a-5c92-a596-f61031ab2a9b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cy52840',
     'listing': 'auction',
     'location': 'fr, beaucaire',
     'make': 'renault',
     'make_model': 'renault kadjar',
     'model': 'kadjar',
     'odometer': 111811,
     'odometer_in_km': 111811,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-01-29',
     'sanitized_make': 'renault',
     'seats_number': 5,
     'seller_name': None,
     'title': 'renault kadjar 1.2 tce energy intens',
     'transmission': 'automatic',
     'trim': 'intens',
     'year': 2019}
2026-01-29 06:05:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 41abec46-598a-5c92-a596-f61031ab2a9b spider: auto1.fr
2026-01-29 06:05:19 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 41abec46-598a-5c92-a596-f61031ab2a9b due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'renault kadjar 1.2 tce energy intens', 'price': 0, 'currency': 'eur', 'make': 'renault', 'model': 'kadjar', 'transmission': 'automatic', 'odometer': 111811, 'odometer_reading_unit': 'km', 'registration_date': '2019-01-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cy52840', 'expiration_date': '2026-01-29t16:03:12z', 'origin_country_code': 'fr', 'trim': 'intens', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, beaucaire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 134, 'id': '41abec46-598a-5c92-a596-f61031ab2a9b', 'current_year_diff': 7, 'age_in_months': 84, 'make_model': 'renault kadjar', 'sanitized_make': 'renault', 'odometer_in_km': 111811}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 84,
     'auction_title': '',
     'c_o_2_emission_value': 134,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:03:12z',
     'fuel_type': 'petrol',
     'id': '41abec46-598a-5c92-a596-f61031ab2a9b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cy52840',
     'listing': 'auction',
     'location': 'fr, beaucaire',
     'make': 'renault',
     'make_model': 'renault kadjar',
     'model': 'kadjar',
     'odometer': 111811,
     'odometer_in_km': 111811,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-01-29',
     'sanitized_make': 'renault',
     'seats_number': 5,
     'seller_name': None,
     'title': 'renault kadjar 1.2 tce energy intens',
     'transmission': 'automatic',
     'trim': 'intens',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:03:12Z',
 'fuel_type': 'petrol',
 'id': '41abec46-598a-5c92-a596-f61031ab2a9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY52840',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 111811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Kadjar 1.2 TCe Energy Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2019}
2026-01-29 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY52840%27 HTTP/1.1" 200 None
2026-01-29 06:05:19 [auto1.fr] INFO: Saving data for CY52840: {'auction_closing_time': 1769702592.0, 'created_time': 1768496693.820097, 'last_price_update_time': 1769666719.186703}
2026-01-29 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CY52840') HTTP/1.1" 204 0
2026-01-29 06:05:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 123cee9e-5cb5-5e91-aac4-333a2d1a4416 with identifier: TN94946
2026-01-29 06:05:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 123cee9e-5cb5-5e91-aac4-333a2d1a4416 with identifier: TN94946
2026-01-29 06:05:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 123cee9e-5cb5-5e91-aac4-333a2d1a4416 with identifier: TN94946 to the API
2026-01-29 06:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:05:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:05:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TN94946>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:08:11Z',
 'fuel_type': 'diesel',
 'id': '123cee9e-5cb5-5e91-aac4-333a2d1a4416',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN94946',
 'listing': 'auction',
 'location': 'FR, LA CHAPELLE LONGUEVILLE',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 77269,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.5 Blue-HDi Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2021}
2026-01-29 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TN94946%27 HTTP/1.1" 200 None
2026-01-29 06:05:19 [auto1.fr] INFO: Saving data for TN94946: {'auction_closing_time': 1769702891.0, 'created_time': 1768583395.073162, 'last_price_update_time': 1769666719.545581}
2026-01-29 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TN94946') HTTP/1.1" 204 0
2026-01-29 06:05:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f36d5081-392c-58ed-a168-c0bd9486bec1 with identifier: DV64570
2026-01-29 06:05:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f36d5081-392c-58ed-a168-c0bd9486bec1 with identifier: DV64570
2026-01-29 06:05:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f36d5081-392c-58ed-a168-c0bd9486bec1 with identifier: DV64570 to the API
2026-01-29 06:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:05:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:05:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DV64570>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:15:22Z',
 'fuel_type': 'diesel',
 'id': 'f36d5081-392c-58ed-a168-c0bd9486bec1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV64570',
 'listing': 'auction',
 'location': 'Martigues',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 129864,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500X 1.6 JTDM Cross',
 'transmission': 'manual',
 'trim': 'Cross',
 'year': 2017}
2026-01-29 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DV64570%27 HTTP/1.1" 200 None
2026-01-29 06:05:19 [auto1.fr] INFO: Saving data for DV64570: {'auction_closing_time': 1769703322.0, 'created_time': 1769015090.870898, 'last_price_update_time': 1769666719.986215}
2026-01-29 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DV64570') HTTP/1.1" 204 0
2026-01-29 06:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KW93900/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FL97269> (referer: https://www.auto1.com/v1/car-details-view/FL97269/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UB10911> (referer: https://www.auto1.com/v1/car-details-view/UB10911/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 558a12a2-57fc-5611-b119-8fb93f6de9d9 with identifier: FL97269
2026-01-29 06:05:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 558a12a2-57fc-5611-b119-8fb93f6de9d9 with scrape type 2
2026-01-29 06:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 558a12a2-57fc-5611-b119-8fb93f6de9d9 with scrape type 2
2026-01-29 06:05:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 558a12a2-57fc-5611-b119-8fb93f6de9d9, identifier: FL97269
2026-01-29 06:05:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03a4f487-89a1-56f0-9989-6145556768a0 with identifier: UB10911
2026-01-29 06:05:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03a4f487-89a1-56f0-9989-6145556768a0 with scrape type 2
2026-01-29 06:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03a4f487-89a1-56f0-9989-6145556768a0 with scrape type 2
2026-01-29 06:05:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 03a4f487-89a1-56f0-9989-6145556768a0, identifier: UB10911
2026-01-29 06:05:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 558a12a2-57fc-5611-b119-8fb93f6de9d9 with identifier: FL97269
2026-01-29 06:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 558a12a2-57fc-5611-b119-8fb93f6de9d9 with identifier: FL97269
2026-01-29 06:05:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 558a12a2-57fc-5611-b119-8fb93f6de9d9 with identifier: FL97269 to the API
2026-01-29 06:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:05:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:05:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FL97269>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 194,
 'expiration_date': '2026-01-29T16:15:16Z',
 'fuel_type': 'diesel',
 'id': '558a12a2-57fc-5611-b119-8fb93f6de9d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL97269',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 129193,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2020}
2026-01-29 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FL97269%27 HTTP/1.1" 200 None
2026-01-29 06:05:20 [auto1.fr] INFO: Saving data for FL97269: {'auction_closing_time': 1769703316.0, 'created_time': 1769061874.650152, 'last_price_update_time': 1769666720.692488}
2026-01-29 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FL97269') HTTP/1.1" 204 0
2026-01-29 06:05:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 03a4f487-89a1-56f0-9989-6145556768a0 with identifier: UB10911
2026-01-29 06:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 03a4f487-89a1-56f0-9989-6145556768a0 with identifier: UB10911
2026-01-29 06:05:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 03a4f487-89a1-56f0-9989-6145556768a0 with identifier: UB10911 to the API
2026-01-29 06:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:05:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:05:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UB10911>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:19:39Z',
 'fuel_type': 'diesel',
 'id': '03a4f487-89a1-56f0-9989-6145556768a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB10911',
 'listing': 'auction',
 'location': 'FR, Marly-la-ville',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 93684,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2019}
2026-01-29 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UB10911%27 HTTP/1.1" 200 None
2026-01-29 06:05:21 [auto1.fr] INFO: Saving data for UB10911: {'auction_closing_time': 1769703579.0, 'created_time': 1767114212.420484, 'last_price_update_time': 1769666721.070239}
2026-01-29 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UB10911') HTTP/1.1" 204 0
2026-01-29 06:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YC52303/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YM42732/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MX13044/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VG16954> (referer: https://www.auto1.com/v1/car-details-view/VG16954/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XL69196> (referer: https://www.auto1.com/v1/car-details-view/XL69196/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MJ36371/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BN10624> (referer: https://www.auto1.com/v1/car-details-view/BN10624/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22f1d935-2823-5979-aa08-3cfd9963b711 with identifier: VG16954
2026-01-29 06:05:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22f1d935-2823-5979-aa08-3cfd9963b711 with scrape type 2
2026-01-29 06:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22f1d935-2823-5979-aa08-3cfd9963b711 with scrape type 2
2026-01-29 06:05:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 22f1d935-2823-5979-aa08-3cfd9963b711, identifier: VG16954
2026-01-29 06:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 22f1d935-2823-5979-aa08-3cfd9963b711 with identifier: VG16954
2026-01-29 06:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 22f1d935-2823-5979-aa08-3cfd9963b711 with identifier: VG16954
2026-01-29 06:05:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 22f1d935-2823-5979-aa08-3cfd9963b711 with identifier: VG16954 to the API
2026-01-29 06:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:05:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:05:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VG16954>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:22:21Z',
 'fuel_type': 'diesel',
 'id': '22f1d935-2823-5979-aa08-3cfd9963b711',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG16954',
 'listing': 'auction',
 'location': 'FR, \u200bCHEVIGNY-SAINT-SAUVEUR',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 59651,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2021}
2026-01-29 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG16954%27 HTTP/1.1" 200 None
2026-01-29 06:05:22 [auto1.fr] INFO: Saving data for VG16954: {'auction_closing_time': 1769703741.0, 'created_time': 1769534057.370294, 'last_price_update_time': 1769666722.477238}
2026-01-29 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VG16954') HTTP/1.1" 204 0
2026-01-29 06:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PL20124/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0af4a7be-9a86-5af5-8450-cae8d0377162 with identifier: XL69196
2026-01-29 06:05:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0af4a7be-9a86-5af5-8450-cae8d0377162 with scrape type 2
2026-01-29 06:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0af4a7be-9a86-5af5-8450-cae8d0377162 with scrape type 2
2026-01-29 06:05:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0af4a7be-9a86-5af5-8450-cae8d0377162, identifier: XL69196
2026-01-29 06:05:22 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:05:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a014d95f-f71d-5534-b747-67c01f7a75d2 with identifier: BN10624
2026-01-29 06:05:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a014d95f-f71d-5534-b747-67c01f7a75d2 with scrape type 2
2026-01-29 06:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a014d95f-f71d-5534-b747-67c01f7a75d2 with scrape type 2
2026-01-29 06:05:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a014d95f-f71d-5534-b747-67c01f7a75d2, identifier: BN10624
2026-01-29 06:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0af4a7be-9a86-5af5-8450-cae8d0377162 with identifier: XL69196
2026-01-29 06:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0af4a7be-9a86-5af5-8450-cae8d0377162 with identifier: XL69196
2026-01-29 06:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 e-thp gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 143359, 'odometer_reading_unit': 'km', 'registration_date': '2020-02-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xl69196', 'expiration_date': '2026-01-29t16:10:34z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, tarnos', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': '0af4a7be-9a86-5af5-8450-cae8d0377162', 'current_year_diff': 6, 'age_in_months': 71, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 143359}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 71,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:10:34z',
     'fuel_type': 'petrol',
     'id': '0af4a7be-9a86-5af5-8450-cae8d0377162',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xl69196',
     'listing': 'auction',
     'location': 'fr, tarnos',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 143359,
     'odometer_in_km': 143359,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-02-24',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 e-thp gt line',
     'transmission': 'automatic',
     'trim': 'gt line',
     'year': 2020}
2026-01-29 06:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 0af4a7be-9a86-5af5-8450-cae8d0377162 spider: auto1.fr
2026-01-29 06:05:22 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 0af4a7be-9a86-5af5-8450-cae8d0377162 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 e-thp gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 143359, 'odometer_reading_unit': 'km', 'registration_date': '2020-02-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xl69196', 'expiration_date': '2026-01-29t16:10:34z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, tarnos', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': '0af4a7be-9a86-5af5-8450-cae8d0377162', 'current_year_diff': 6, 'age_in_months': 71, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 143359}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 71,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:10:34z',
     'fuel_type': 'petrol',
     'id': '0af4a7be-9a86-5af5-8450-cae8d0377162',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xl69196',
     'listing': 'auction',
     'location': 'fr, tarnos',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 143359,
     'odometer_in_km': 143359,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-02-24',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 e-thp gt line',
     'transmission': 'automatic',
     'trim': 'gt line',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:10:34Z',
 'fuel_type': 'petrol',
 'id': '0af4a7be-9a86-5af5-8450-cae8d0377162',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL69196',
 'listing': 'auction',
 'location': 'FR, TARNOS',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 143359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 e-THP GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2020}
2026-01-29 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XL69196%27 HTTP/1.1" 200 None
2026-01-29 06:05:22 [auto1.fr] INFO: Saving data for XL69196: {'auction_closing_time': 1769703034.0, 'created_time': 1769015628.926541, 'last_price_update_time': 1769666722.927372}
2026-01-29 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XL69196') HTTP/1.1" 204 0
2026-01-29 06:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a014d95f-f71d-5534-b747-67c01f7a75d2 with identifier: BN10624
2026-01-29 06:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a014d95f-f71d-5534-b747-67c01f7a75d2 with identifier: BN10624
2026-01-29 06:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 171962 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    171962
2026-01-29 06:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: a014d95f-f71d-5534-b747-67c01f7a75d2 spider: auto1.fr
2026-01-29 06:05:23 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: a014d95f-f71d-5534-b747-67c01f7a75d2 due to rule: high_mileage_for_country.json, error: 171962 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    171962
{'auction_title': '',
 'c_o_2_emission_value': 87,
 'category': 'Taxi',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'engine_horse_power': 122,
 'expiration_date': '2026-01-29T16:01:59Z',
 'fuel_type': 'hybrid',
 'id': 'a014d95f-f71d-5534-b747-67c01f7a75d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN10624',
 'listing': 'auction',
 'location': 'FR, Ambérieu en Bugey',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 171962,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota C-HR 1.8 Hybrid Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2018}
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BN10624%27 HTTP/1.1" 200 None
2026-01-29 06:05:23 [auto1.fr] INFO: Saving data for BN10624: {'auction_closing_time': 1769702519.0, 'created_time': 1769580126.97333, 'last_price_update_time': 1769666723.209017}
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BN10624') HTTP/1.1" 204 0
2026-01-29 06:05:23 [auto1.fr] INFO: Found listing with ID: NX59160
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NX59160%27 HTTP/1.1" 200 None
2026-01-29 06:05:23 [auto1.fr] INFO: Scrape type for NX59160: 0
2026-01-29 06:05:23 [auto1.fr] INFO: Found listing with ID: RT50690
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RT50690%27 HTTP/1.1" 200 None
2026-01-29 06:05:23 [auto1.fr] INFO: Scrape type for RT50690: 0
2026-01-29 06:05:23 [auto1.fr] INFO: Found listing with ID: FS22101
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FS22101%27 HTTP/1.1" 200 None
2026-01-29 06:05:23 [auto1.fr] INFO: Scrape type for FS22101: 0
2026-01-29 06:05:23 [auto1.fr] INFO: Found listing with ID: PK42431
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PK42431%27 HTTP/1.1" 200 None
2026-01-29 06:05:23 [auto1.fr] INFO: Scrape type for PK42431: 0
2026-01-29 06:05:23 [auto1.fr] INFO: Found listing with ID: PX63835
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX63835%27 HTTP/1.1" 200 None
2026-01-29 06:05:23 [auto1.fr] INFO: Scrape type for PX63835: 0
2026-01-29 06:05:23 [auto1.fr] INFO: Found listing with ID: RV67653
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RV67653%27 HTTP/1.1" 200 None
2026-01-29 06:05:23 [auto1.fr] INFO: Scrape type for RV67653: 2
2026-01-29 06:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MV48741> (referer: https://www.auto1.com/v1/car-details-view/MV48741/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:23 [auto1.fr] INFO: Found listing with ID: JC35560
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JC35560%27 HTTP/1.1" 200 None
2026-01-29 06:05:23 [auto1.fr] INFO: Scrape type for JC35560: 2
2026-01-29 06:05:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:23 [auto1.fr] INFO: Found listing with ID: VL01915
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL01915%27 HTTP/1.1" 200 None
2026-01-29 06:05:23 [auto1.fr] INFO: Scrape type for VL01915: 0
2026-01-29 06:05:23 [auto1.fr] INFO: Found listing with ID: BF17425
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BF17425%27 HTTP/1.1" 200 None
2026-01-29 06:05:23 [auto1.fr] INFO: Scrape type for BF17425: 0
2026-01-29 06:05:23 [auto1.fr] INFO: Found listing with ID: KG88980
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KG88980%27 HTTP/1.1" 200 None
2026-01-29 06:05:23 [auto1.fr] INFO: Scrape type for KG88980: 0
2026-01-29 06:05:23 [auto1.fr] INFO: Found listing with ID: YM07032
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YM07032%27 HTTP/1.1" 200 None
2026-01-29 06:05:23 [auto1.fr] INFO: Scrape type for YM07032: 0
2026-01-29 06:05:23 [auto1.fr] INFO: Found listing with ID: YL65277
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YL65277%27 HTTP/1.1" 200 None
2026-01-29 06:05:23 [auto1.fr] INFO: Scrape type for YL65277: 2
2026-01-29 06:05:23 [auto1.fr] INFO: Found listing with ID: YS99236
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS99236%27 HTTP/1.1" 200 None
2026-01-29 06:05:23 [auto1.fr] INFO: Scrape type for YS99236: 2
2026-01-29 06:05:23 [auto1.fr] INFO: Found listing with ID: RR16791
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RR16791%27 HTTP/1.1" 200 None
2026-01-29 06:05:23 [auto1.fr] INFO: Scrape type for RR16791: 2
2026-01-29 06:05:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bec4cfa-5e0b-5536-a3c0-fed297576a17 with identifier: MV48741
2026-01-29 06:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bec4cfa-5e0b-5536-a3c0-fed297576a17 with scrape type 2
2026-01-29 06:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bec4cfa-5e0b-5536-a3c0-fed297576a17 with scrape type 2
2026-01-29 06:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7bec4cfa-5e0b-5536-a3c0-fed297576a17, identifier: MV48741
2026-01-29 06:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7bec4cfa-5e0b-5536-a3c0-fed297576a17 with identifier: MV48741
2026-01-29 06:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7bec4cfa-5e0b-5536-a3c0-fed297576a17 with identifier: MV48741
2026-01-29 06:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech like', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 62906, 'odometer_reading_unit': 'km', 'registration_date': '2021-08-25', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mv48741', 'expiration_date': '2026-01-29t16:54:18z', 'origin_country_code': 'fr', 'trim': 'like', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 119, 'id': '7bec4cfa-5e0b-5536-a3c0-fed297576a17', 'current_year_diff': 5, 'age_in_months': 53, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 62906}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 53,
     'auction_title': '',
     'c_o_2_emission_value': 119,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 75,
     'expiration_date': '2026-01-29t16:54:18z',
     'fuel_type': 'petrol',
     'id': '7bec4cfa-5e0b-5536-a3c0-fed297576a17',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mv48741',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 62906,
     'odometer_in_km': 62906,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-08-25',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech like',
     'transmission': 'manual',
     'trim': 'like',
     'year': 2021}
2026-01-29 06:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 7bec4cfa-5e0b-5536-a3c0-fed297576a17 spider: auto1.fr
2026-01-29 06:05:23 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 7bec4cfa-5e0b-5536-a3c0-fed297576a17 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech like', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 62906, 'odometer_reading_unit': 'km', 'registration_date': '2021-08-25', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mv48741', 'expiration_date': '2026-01-29t16:54:18z', 'origin_country_code': 'fr', 'trim': 'like', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 119, 'id': '7bec4cfa-5e0b-5536-a3c0-fed297576a17', 'current_year_diff': 5, 'age_in_months': 53, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 62906}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 53,
     'auction_title': '',
     'c_o_2_emission_value': 119,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 75,
     'expiration_date': '2026-01-29t16:54:18z',
     'fuel_type': 'petrol',
     'id': '7bec4cfa-5e0b-5536-a3c0-fed297576a17',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mv48741',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 62906,
     'odometer_in_km': 62906,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-08-25',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech like',
     'transmission': 'manual',
     'trim': 'like',
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:54:18Z',
 'fuel_type': 'petrol',
 'id': '7bec4cfa-5e0b-5536-a3c0-fed297576a17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV48741',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 62906,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-08-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Like',
 'transmission': 'manual',
 'trim': 'Like',
 'year': 2021}
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MV48741%27 HTTP/1.1" 200 None
2026-01-29 06:05:23 [auto1.fr] INFO: Saving data for MV48741: {'auction_closing_time': 1769705658.0, 'created_time': 1769534080.752856, 'last_price_update_time': 1769666723.79619}
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MV48741') HTTP/1.1" 204 0
2026-01-29 06:05:23 [auto1.fr] INFO: Found listing with ID: ER82069
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER82069%27 HTTP/1.1" 200 None
2026-01-29 06:05:23 [auto1.fr] INFO: Scrape type for ER82069: 2
2026-01-29 06:05:23 [auto1.fr] INFO: Found listing with ID: RT01484
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RT01484%27 HTTP/1.1" 200 None
2026-01-29 06:05:23 [auto1.fr] INFO: Scrape type for RT01484: 0
2026-01-29 06:05:23 [auto1.fr] INFO: Found listing with ID: JM41616
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JM41616%27 HTTP/1.1" 200 None
2026-01-29 06:05:23 [auto1.fr] INFO: Scrape type for JM41616: 2
2026-01-29 06:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AV62458/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:23 [auto1.fr] INFO: Found listing with ID: UG95289
2026-01-29 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG95289%27 HTTP/1.1" 200 None
2026-01-29 06:05:24 [auto1.fr] INFO: Scrape type for UG95289: 0
2026-01-29 06:05:24 [auto1.fr] INFO: Found listing with ID: WK50593
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WK50593%27 HTTP/1.1" 200 None
2026-01-29 06:05:24 [auto1.fr] INFO: Scrape type for WK50593: 0
2026-01-29 06:05:24 [auto1.fr] INFO: Found listing with ID: TP13118
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TP13118%27 HTTP/1.1" 200 None
2026-01-29 06:05:24 [auto1.fr] INFO: Scrape type for TP13118: 2
2026-01-29 06:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:24 [auto1.fr] INFO: Found listing with ID: ER78720
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER78720%27 HTTP/1.1" 200 None
2026-01-29 06:05:24 [auto1.fr] INFO: Scrape type for ER78720: 0
2026-01-29 06:05:24 [auto1.fr] INFO: Found listing with ID: NH07713
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH07713%27 HTTP/1.1" 200 None
2026-01-29 06:05:24 [auto1.fr] INFO: Scrape type for NH07713: 0
2026-01-29 06:05:24 [auto1.fr] INFO: Found listing with ID: KT86932
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KT86932%27 HTTP/1.1" 200 None
2026-01-29 06:05:24 [auto1.fr] INFO: Scrape type for KT86932: 2
2026-01-29 06:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VV03236/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EH18565> (referer: https://www.auto1.com/v1/car-details-view/EH18565/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:24 [auto1.fr] INFO: Found listing with ID: ZZ58048
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZZ58048%27 HTTP/1.1" 200 None
2026-01-29 06:05:24 [auto1.fr] INFO: Scrape type for ZZ58048: 0
2026-01-29 06:05:24 [auto1.fr] INFO: Found listing with ID: SZ18371
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SZ18371%27 HTTP/1.1" 200 None
2026-01-29 06:05:24 [auto1.fr] INFO: Scrape type for SZ18371: 0
2026-01-29 06:05:24 [auto1.fr] INFO: Found listing with ID: MH94137
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MH94137%27 HTTP/1.1" 200 None
2026-01-29 06:05:24 [auto1.fr] INFO: Scrape type for MH94137: 2
2026-01-29 06:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:24 [auto1.fr] INFO: Found listing with ID: GC52902
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GC52902%27 HTTP/1.1" 200 None
2026-01-29 06:05:24 [auto1.fr] INFO: Scrape type for GC52902: 0
2026-01-29 06:05:24 [auto1.fr] INFO: Found listing with ID: BD43776
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BD43776%27 HTTP/1.1" 200 None
2026-01-29 06:05:24 [auto1.fr] INFO: Scrape type for BD43776: 2
2026-01-29 06:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NR70042> (referer: https://www.auto1.com/v1/car-details-view/NR70042/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:24 [auto1.fr] INFO: Found listing with ID: LF62744
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LF62744%27 HTTP/1.1" 200 None
2026-01-29 06:05:24 [auto1.fr] INFO: Scrape type for LF62744: 0
2026-01-29 06:05:24 [auto1.fr] INFO: Found listing with ID: SE10295
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SE10295%27 HTTP/1.1" 200 None
2026-01-29 06:05:24 [auto1.fr] INFO: Scrape type for SE10295: 0
2026-01-29 06:05:24 [auto1.fr] INFO: Found listing with ID: PX17956
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX17956%27 HTTP/1.1" 200 None
2026-01-29 06:05:24 [auto1.fr] INFO: Scrape type for PX17956: 0
2026-01-29 06:05:24 [auto1.fr] INFO: Found listing with ID: JY81893
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JY81893%27 HTTP/1.1" 200 None
2026-01-29 06:05:24 [auto1.fr] INFO: Scrape type for JY81893: 0
2026-01-29 06:05:24 [auto1.fr] INFO: Found listing with ID: MV88058
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MV88058%27 HTTP/1.1" 200 None
2026-01-29 06:05:24 [auto1.fr] INFO: Scrape type for MV88058: 2
2026-01-29 06:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:24 [auto1.fr] INFO: Found listing with ID: TM68848
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TM68848%27 HTTP/1.1" 200 None
2026-01-29 06:05:24 [auto1.fr] INFO: Scrape type for TM68848: 2
2026-01-29 06:05:24 [auto1.fr] INFO: Found listing with ID: XC27114
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XC27114%27 HTTP/1.1" 200 None
2026-01-29 06:05:24 [auto1.fr] INFO: Scrape type for XC27114: 2
2026-01-29 06:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 800a79fe-ee54-5ae7-a361-eac058a36423 with identifier: EH18565
2026-01-29 06:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 800a79fe-ee54-5ae7-a361-eac058a36423 with scrape type 2
2026-01-29 06:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 800a79fe-ee54-5ae7-a361-eac058a36423 with scrape type 2
2026-01-29 06:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 800a79fe-ee54-5ae7-a361-eac058a36423, identifier: EH18565
2026-01-29 06:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MF63659/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 800a79fe-ee54-5ae7-a361-eac058a36423 with identifier: EH18565
2026-01-29 06:05:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 800a79fe-ee54-5ae7-a361-eac058a36423 with identifier: EH18565
2026-01-29 06:05:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 800a79fe-ee54-5ae7-a361-eac058a36423 with identifier: EH18565 to the API
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EH18565>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:20:45Z',
 'fuel_type': 'diesel',
 'id': '800a79fe-ee54-5ae7-a361-eac058a36423',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH18565',
 'listing': 'auction',
 'location': 'FR, TARNOS',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 112074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.5 Blue-HDi Origins',
 'transmission': 'automatic',
 'trim': 'Origins',
 'year': 2019}
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EH18565%27 HTTP/1.1" 200 None
2026-01-29 06:05:24 [auto1.fr] INFO: Saving data for EH18565: {'auction_closing_time': 1769703645.0, 'created_time': 1768496710.571342, 'last_price_update_time': 1769666724.767699}
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EH18565') HTTP/1.1" 204 0
2026-01-29 06:05:24 [auto1.fr] INFO: Found listing with ID: CU87504
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CU87504%27 HTTP/1.1" 200 None
2026-01-29 06:05:24 [auto1.fr] INFO: Scrape type for CU87504: 2
2026-01-29 06:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe57e71b-d91b-520c-9a34-0a0d2e12f4ac with identifier: NR70042
2026-01-29 06:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe57e71b-d91b-520c-9a34-0a0d2e12f4ac with scrape type 2
2026-01-29 06:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe57e71b-d91b-520c-9a34-0a0d2e12f4ac with scrape type 2
2026-01-29 06:05:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fe57e71b-d91b-520c-9a34-0a0d2e12f4ac, identifier: NR70042
2026-01-29 06:05:25 [auto1.fr] INFO: Found listing with ID: SM33771
2026-01-29 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SM33771%27 HTTP/1.1" 200 None
2026-01-29 06:05:25 [auto1.fr] INFO: Scrape type for SM33771: 0
2026-01-29 06:05:25 [auto1.fr] INFO: Found listing with ID: PS19366
2026-01-29 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PS19366%27 HTTP/1.1" 200 None
2026-01-29 06:05:25 [auto1.fr] INFO: Scrape type for PS19366: 2
2026-01-29 06:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UD15145/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fe57e71b-d91b-520c-9a34-0a0d2e12f4ac with identifier: NR70042
2026-01-29 06:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fe57e71b-d91b-520c-9a34-0a0d2e12f4ac with identifier: NR70042
2026-01-29 06:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel mokka x 1.2 turbo elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'mokka x', 'transmission': 'automatic', 'odometer': 34981, 'odometer_reading_unit': 'km', 'registration_date': '2023-05-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nr70042', 'expiration_date': '2026-01-29t16:02:07z', 'origin_country_code': 'fr', 'trim': 'elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 133, 'id': 'fe57e71b-d91b-520c-9a34-0a0d2e12f4ac', 'current_year_diff': 3, 'age_in_months': 32, 'make_model': 'opel mokka x', 'sanitized_make': 'opel', 'odometer_in_km': 34981}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 32,
     'auction_title': '',
     'c_o_2_emission_value': 133,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:02:07z',
     'fuel_type': 'petrol',
     'id': 'fe57e71b-d91b-520c-9a34-0a0d2e12f4ac',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nr70042',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'opel',
     'make_model': 'opel mokka x',
     'model': 'mokka x',
     'odometer': 34981,
     'odometer_in_km': 34981,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-05-24',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel mokka x 1.2 turbo elegance',
     'transmission': 'automatic',
     'trim': 'elegance',
     'year': 2023}
2026-01-29 06:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: fe57e71b-d91b-520c-9a34-0a0d2e12f4ac spider: auto1.fr
2026-01-29 06:05:25 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: fe57e71b-d91b-520c-9a34-0a0d2e12f4ac due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel mokka x 1.2 turbo elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'mokka x', 'transmission': 'automatic', 'odometer': 34981, 'odometer_reading_unit': 'km', 'registration_date': '2023-05-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nr70042', 'expiration_date': '2026-01-29t16:02:07z', 'origin_country_code': 'fr', 'trim': 'elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 133, 'id': 'fe57e71b-d91b-520c-9a34-0a0d2e12f4ac', 'current_year_diff': 3, 'age_in_months': 32, 'make_model': 'opel mokka x', 'sanitized_make': 'opel', 'odometer_in_km': 34981}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 32,
     'auction_title': '',
     'c_o_2_emission_value': 133,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:02:07z',
     'fuel_type': 'petrol',
     'id': 'fe57e71b-d91b-520c-9a34-0a0d2e12f4ac',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nr70042',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'opel',
     'make_model': 'opel mokka x',
     'model': 'mokka x',
     'odometer': 34981,
     'odometer_in_km': 34981,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-05-24',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel mokka x 1.2 turbo elegance',
     'transmission': 'automatic',
     'trim': 'elegance',
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:02:07Z',
 'fuel_type': 'petrol',
 'id': 'fe57e71b-d91b-520c-9a34-0a0d2e12f4ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR70042',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 34981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-05-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka X 1.2 Turbo Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2023}
2026-01-29 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NR70042%27 HTTP/1.1" 200 None
2026-01-29 06:05:25 [auto1.fr] INFO: Saving data for NR70042: {'auction_closing_time': 1769702527.0, 'created_time': 1768585274.282032, 'last_price_update_time': 1769666725.271983}
2026-01-29 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NR70042') HTTP/1.1" 204 0
2026-01-29 06:05:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:25 [auto1.fr] INFO: Found listing with ID: CG42513
2026-01-29 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CG42513%27 HTTP/1.1" 200 None
2026-01-29 06:05:25 [auto1.fr] INFO: Scrape type for CG42513: 0
2026-01-29 06:05:25 [auto1.fr] INFO: Found listing with ID: WN24520
2026-01-29 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WN24520%27 HTTP/1.1" 200 None
2026-01-29 06:05:25 [auto1.fr] INFO: Scrape type for WN24520: 2
2026-01-29 06:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KW93900> (referer: https://www.auto1.com/v1/car-details-view/KW93900/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 788cb129-6d83-55af-96cf-c263142cb7af with identifier: KW93900
2026-01-29 06:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 788cb129-6d83-55af-96cf-c263142cb7af with scrape type 2
2026-01-29 06:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 788cb129-6d83-55af-96cf-c263142cb7af with scrape type 2
2026-01-29 06:05:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 788cb129-6d83-55af-96cf-c263142cb7af, identifier: KW93900
2026-01-29 06:05:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 788cb129-6d83-55af-96cf-c263142cb7af with identifier: KW93900
2026-01-29 06:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 788cb129-6d83-55af-96cf-c263142cb7af with identifier: KW93900
2026-01-29 06:05:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 788cb129-6d83-55af-96cf-c263142cb7af with identifier: KW93900 to the API
2026-01-29 06:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:05:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:05:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KW93900>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:23:02Z',
 'fuel_type': 'petrol',
 'id': '788cb129-6d83-55af-96cf-c263142cb7af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW93900',
 'listing': 'auction',
 'location': 'FR, TARNOS',
 'make': 'Renault',
 'model': 'Arkana',
 'odometer': 36968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Arkana 1.3 TCe Mild-Hybrid Techno',
 'transmission': 'automatic',
 'trim': 'Techno',
 'year': 2022}
2026-01-29 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KW93900%27 HTTP/1.1" 200 None
2026-01-29 06:05:25 [auto1.fr] INFO: Saving data for KW93900: {'auction_closing_time': 1769703782.0, 'created_time': 1769533750.540554, 'last_price_update_time': 1769666725.858108}
2026-01-29 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KW93900') HTTP/1.1" 204 0
2026-01-29 06:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FW95558/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YM42732> (referer: https://www.auto1.com/v1/car-details-view/YM42732/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MX13044> (referer: https://www.auto1.com/v1/car-details-view/MX13044/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb7a210e-3229-530e-a9cd-be386bb106d2 with identifier: YM42732
2026-01-29 06:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb7a210e-3229-530e-a9cd-be386bb106d2 with scrape type 2
2026-01-29 06:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb7a210e-3229-530e-a9cd-be386bb106d2 with scrape type 2
2026-01-29 06:05:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: eb7a210e-3229-530e-a9cd-be386bb106d2, identifier: YM42732
2026-01-29 06:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6032b4da-d47a-5321-8923-f2dd95b1a613 with identifier: MX13044
2026-01-29 06:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6032b4da-d47a-5321-8923-f2dd95b1a613 with scrape type 2
2026-01-29 06:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6032b4da-d47a-5321-8923-f2dd95b1a613 with scrape type 2
2026-01-29 06:05:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6032b4da-d47a-5321-8923-f2dd95b1a613, identifier: MX13044
2026-01-29 06:05:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: eb7a210e-3229-530e-a9cd-be386bb106d2 with identifier: YM42732
2026-01-29 06:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: eb7a210e-3229-530e-a9cd-be386bb106d2 with identifier: YM42732
2026-01-29 06:05:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: eb7a210e-3229-530e-a9cd-be386bb106d2 with identifier: YM42732 to the API
2026-01-29 06:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:05:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:05:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YM42732>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:40:03Z',
 'fuel_type': 'petrol',
 'id': 'eb7a210e-3229-530e-a9cd-be386bb106d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM42732',
 'listing': 'auction',
 'location': 'FR, MIRAMAS',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 40753,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2020}
2026-01-29 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YM42732%27 HTTP/1.1" 200 None
2026-01-29 06:05:26 [auto1.fr] INFO: Saving data for YM42732: {'auction_closing_time': 1769704803.0, 'created_time': 1769533951.829592, 'last_price_update_time': 1769666726.451827}
2026-01-29 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YM42732') HTTP/1.1" 204 0
2026-01-29 06:05:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6032b4da-d47a-5321-8923-f2dd95b1a613 with identifier: MX13044
2026-01-29 06:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6032b4da-d47a-5321-8923-f2dd95b1a613 with identifier: MX13044
2026-01-29 06:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c4 cactus 1.2 e-thp feel', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c4 cactus', 'transmission': 'manual', 'odometer': 68019, 'odometer_reading_unit': 'km', 'registration_date': '2019-03-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mx13044', 'expiration_date': '2026-01-29t16:20:37z', 'origin_country_code': 'fr', 'trim': 'feel', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marseille', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 106, 'id': '6032b4da-d47a-5321-8923-f2dd95b1a613', 'current_year_diff': 7, 'age_in_months': 82, 'make_model': 'citroen c4 cactus', 'sanitized_make': 'citroen', 'odometer_in_km': 68019}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 82,
     'auction_title': '',
     'c_o_2_emission_value': 106,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:20:37z',
     'fuel_type': 'petrol',
     'id': '6032b4da-d47a-5321-8923-f2dd95b1a613',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mx13044',
     'listing': 'auction',
     'location': 'fr, marseille',
     'make': 'citroen',
     'make_model': 'citroen c4 cactus',
     'model': 'c4 cactus',
     'odometer': 68019,
     'odometer_in_km': 68019,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-03-27',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c4 cactus 1.2 e-thp feel',
     'transmission': 'manual',
     'trim': 'feel',
     'year': 2019}
2026-01-29 06:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 6032b4da-d47a-5321-8923-f2dd95b1a613 spider: auto1.fr
2026-01-29 06:05:26 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 6032b4da-d47a-5321-8923-f2dd95b1a613 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c4 cactus 1.2 e-thp feel', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c4 cactus', 'transmission': 'manual', 'odometer': 68019, 'odometer_reading_unit': 'km', 'registration_date': '2019-03-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mx13044', 'expiration_date': '2026-01-29t16:20:37z', 'origin_country_code': 'fr', 'trim': 'feel', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marseille', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 106, 'id': '6032b4da-d47a-5321-8923-f2dd95b1a613', 'current_year_diff': 7, 'age_in_months': 82, 'make_model': 'citroen c4 cactus', 'sanitized_make': 'citroen', 'odometer_in_km': 68019}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 82,
     'auction_title': '',
     'c_o_2_emission_value': 106,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:20:37z',
     'fuel_type': 'petrol',
     'id': '6032b4da-d47a-5321-8923-f2dd95b1a613',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mx13044',
     'listing': 'auction',
     'location': 'fr, marseille',
     'make': 'citroen',
     'make_model': 'citroen c4 cactus',
     'model': 'c4 cactus',
     'odometer': 68019,
     'odometer_in_km': 68019,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-03-27',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c4 cactus 1.2 e-thp feel',
     'transmission': 'manual',
     'trim': 'feel',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:20:37Z',
 'fuel_type': 'petrol',
 'id': '6032b4da-d47a-5321-8923-f2dd95b1a613',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX13044',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 68019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 e-THP Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2019}
2026-01-29 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MX13044%27 HTTP/1.1" 200 None
2026-01-29 06:05:26 [auto1.fr] INFO: Saving data for MX13044: {'auction_closing_time': 1769703637.0, 'created_time': 1768844216.52271, 'last_price_update_time': 1769666726.685377}
2026-01-29 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MX13044') HTTP/1.1" 204 0
2026-01-29 06:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YC52303> (referer: https://www.auto1.com/v1/car-details-view/YC52303/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RB07029/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BN44470> (referer: https://www.auto1.com/v1/car-details-view/BN44470/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d0dd50e-5e4c-5d0d-8f89-5f5057ac4a84 with identifier: YC52303
2026-01-29 06:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d0dd50e-5e4c-5d0d-8f89-5f5057ac4a84 with scrape type 2
2026-01-29 06:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d0dd50e-5e4c-5d0d-8f89-5f5057ac4a84 with scrape type 2
2026-01-29 06:05:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4d0dd50e-5e4c-5d0d-8f89-5f5057ac4a84, identifier: YC52303
2026-01-29 06:05:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4d0dd50e-5e4c-5d0d-8f89-5f5057ac4a84 with identifier: YC52303
2026-01-29 06:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4d0dd50e-5e4c-5d0d-8f89-5f5057ac4a84 with identifier: YC52303
2026-01-29 06:05:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4d0dd50e-5e4c-5d0d-8f89-5f5057ac4a84 with identifier: YC52303 to the API
2026-01-29 06:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:05:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YC52303>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:13:06Z',
 'fuel_type': 'diesel',
 'id': '4d0dd50e-5e4c-5d0d-8f89-5f5057ac4a84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC52303',
 'listing': 'auction',
 'location': 'FR, Evreux',
 'make': 'Opel',
 'model': 'Grandland X',
 'odometer': 105254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Grandland X 1.5 CDTI Opel 2020',
 'transmission': 'automatic',
 'trim': '2020',
 'year': 2020}
2026-01-29 06:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YC52303%27 HTTP/1.1" 200 None
2026-01-29 06:05:27 [auto1.fr] INFO: Saving data for YC52303: {'auction_closing_time': 1769703186.0, 'created_time': 1769580134.19676, 'last_price_update_time': 1769666727.222694}
2026-01-29 06:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YC52303') HTTP/1.1" 204 0
2026-01-29 06:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2f530bc-1a7e-54aa-8fa5-baa964bb0548 with identifier: BN44470
2026-01-29 06:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2f530bc-1a7e-54aa-8fa5-baa964bb0548 with scrape type 2
2026-01-29 06:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2f530bc-1a7e-54aa-8fa5-baa964bb0548 with scrape type 2
2026-01-29 06:05:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d2f530bc-1a7e-54aa-8fa5-baa964bb0548, identifier: BN44470
2026-01-29 06:05:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d2f530bc-1a7e-54aa-8fa5-baa964bb0548 with identifier: BN44470
2026-01-29 06:05:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d2f530bc-1a7e-54aa-8fa5-baa964bb0548 with identifier: BN44470
2026-01-29 06:05:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d2f530bc-1a7e-54aa-8fa5-baa964bb0548 with identifier: BN44470 to the API
2026-01-29 06:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:05:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BN44470>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:26:51Z',
 'fuel_type': 'petrol',
 'id': 'd2f530bc-1a7e-54aa-8fa5-baa964bb0548',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN44470',
 'listing': 'auction',
 'location': 'FR, Ambarès-et-Lagrave',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 11133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-08-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Kamiq 1.5 TSI ACT Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2023}
2026-01-29 06:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BN44470%27 HTTP/1.1" 200 None
2026-01-29 06:05:27 [auto1.fr] INFO: Saving data for BN44470: {'auction_closing_time': 1769704011.0, 'created_time': 1769533318.179689, 'last_price_update_time': 1769666727.662838}
2026-01-29 06:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BN44470') HTTP/1.1" 204 0
2026-01-29 06:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JM18654> (referer: https://www.auto1.com/v1/car-details-view/JM18654/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JM41616/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a24f0a9c-5050-5cb7-a221-061a802e744c with identifier: JM18654
2026-01-29 06:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a24f0a9c-5050-5cb7-a221-061a802e744c with scrape type 2
2026-01-29 06:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a24f0a9c-5050-5cb7-a221-061a802e744c with scrape type 2
2026-01-29 06:05:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a24f0a9c-5050-5cb7-a221-061a802e744c, identifier: JM18654
2026-01-29 06:05:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a24f0a9c-5050-5cb7-a221-061a802e744c with identifier: JM18654
2026-01-29 06:05:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a24f0a9c-5050-5cb7-a221-061a802e744c with identifier: JM18654
2026-01-29 06:05:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a24f0a9c-5050-5cb7-a221-061a802e744c with identifier: JM18654 to the API
2026-01-29 06:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:05:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:05:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JM18654>
{'auction_title': '',
 'c_o_2_emission_value': 28,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 224,
 'expiration_date': '2026-01-29T16:29:06Z',
 'fuel_type': 'hybrid',
 'id': 'a24f0a9c-5050-5cb7-a221-061a802e744c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM18654',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 26041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Hybrid 225 GT',
 'transmission': 'automatic',
 'trim': '225 GT',
 'year': 2024}
2026-01-29 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JM18654%27 HTTP/1.1" 200 None
2026-01-29 06:05:28 [auto1.fr] INFO: Saving data for JM18654: {'auction_closing_time': 1769704146.0, 'created_time': 1769534117.940139, 'last_price_update_time': 1769666728.208782}
2026-01-29 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JM18654') HTTP/1.1" 204 0
2026-01-29 06:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BD43776/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RV67653/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KT86932/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TP13118/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VV03236> (referer: https://www.auto1.com/v1/car-details-view/VV03236/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b914483-b782-5419-b7e7-0ed9b18c2ca6 with identifier: VV03236
2026-01-29 06:05:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b914483-b782-5419-b7e7-0ed9b18c2ca6 with scrape type 2
2026-01-29 06:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b914483-b782-5419-b7e7-0ed9b18c2ca6 with scrape type 2
2026-01-29 06:05:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4b914483-b782-5419-b7e7-0ed9b18c2ca6, identifier: VV03236
2026-01-29 06:05:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4b914483-b782-5419-b7e7-0ed9b18c2ca6 with identifier: VV03236
2026-01-29 06:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4b914483-b782-5419-b7e7-0ed9b18c2ca6 with identifier: VV03236
2026-01-29 06:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 168009, 'odometer_reading_unit': 'km', 'registration_date': '2018-02-12', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vv03236', 'expiration_date': '2026-01-29t16:47:19z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, muret', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': '4b914483-b782-5419-b7e7-0ed9b18c2ca6', 'current_year_diff': 8, 'age_in_months': 95, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 168009}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 95,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:47:19z',
     'fuel_type': 'petrol',
     'id': '4b914483-b782-5419-b7e7-0ed9b18c2ca6',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vv03236',
     'listing': 'auction',
     'location': 'fr, muret',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 168009,
     'odometer_in_km': 168009,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-02-12',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2018}
2026-01-29 06:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 4b914483-b782-5419-b7e7-0ed9b18c2ca6 spider: auto1.fr
2026-01-29 06:05:28 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 4b914483-b782-5419-b7e7-0ed9b18c2ca6 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 168009, 'odometer_reading_unit': 'km', 'registration_date': '2018-02-12', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vv03236', 'expiration_date': '2026-01-29t16:47:19z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, muret', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': '4b914483-b782-5419-b7e7-0ed9b18c2ca6', 'current_year_diff': 8, 'age_in_months': 95, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 168009}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 95,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:47:19z',
     'fuel_type': 'petrol',
     'id': '4b914483-b782-5419-b7e7-0ed9b18c2ca6',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vv03236',
     'listing': 'auction',
     'location': 'fr, muret',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 168009,
     'odometer_in_km': 168009,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-02-12',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:47:19Z',
 'fuel_type': 'petrol',
 'id': '4b914483-b782-5419-b7e7-0ed9b18c2ca6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV03236',
 'listing': 'auction',
 'location': 'FR, Muret',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 168009,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2018}
2026-01-29 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV03236%27 HTTP/1.1" 200 None
2026-01-29 06:05:28 [auto1.fr] INFO: Saving data for VV03236: {'auction_closing_time': 1769705239.0, 'created_time': 1769534443.400465, 'last_price_update_time': 1769666728.927103}
2026-01-29 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VV03236') HTTP/1.1" 204 0
2026-01-29 06:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CU87504/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JM14902/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WN24520/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MF63659> (referer: https://www.auto1.com/v1/car-details-view/MF63659/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UD15145> (referer: https://www.auto1.com/v1/car-details-view/UD15145/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a18e6c4f-b936-567c-980f-5ea57fc6e42d with identifier: MF63659
2026-01-29 06:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a18e6c4f-b936-567c-980f-5ea57fc6e42d with scrape type 2
2026-01-29 06:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a18e6c4f-b936-567c-980f-5ea57fc6e42d with scrape type 2
2026-01-29 06:05:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a18e6c4f-b936-567c-980f-5ea57fc6e42d, identifier: MF63659
2026-01-29 06:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a18e6c4f-b936-567c-980f-5ea57fc6e42d with identifier: MF63659
2026-01-29 06:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a18e6c4f-b936-567c-980f-5ea57fc6e42d with identifier: MF63659
2026-01-29 06:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 puretech allure pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'manual', 'odometer': 101860, 'odometer_reading_unit': 'km', 'registration_date': '2022-07-14', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mf63659', 'expiration_date': '2026-01-29t16:55:37z', 'origin_country_code': 'fr', 'trim': 'allure pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 128, 'id': 'a18e6c4f-b936-567c-980f-5ea57fc6e42d', 'current_year_diff': 4, 'age_in_months': 42, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 101860}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 42,
     'auction_title': '',
     'c_o_2_emission_value': 128,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:55:37z',
     'fuel_type': 'petrol',
     'id': 'a18e6c4f-b936-567c-980f-5ea57fc6e42d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mf63659',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 101860,
     'odometer_in_km': 101860,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-07-14',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 1.2 puretech allure pack',
     'transmission': 'manual',
     'trim': 'allure pack',
     'year': 2022}
2026-01-29 06:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: a18e6c4f-b936-567c-980f-5ea57fc6e42d spider: auto1.fr
2026-01-29 06:05:29 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: a18e6c4f-b936-567c-980f-5ea57fc6e42d due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 puretech allure pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'manual', 'odometer': 101860, 'odometer_reading_unit': 'km', 'registration_date': '2022-07-14', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mf63659', 'expiration_date': '2026-01-29t16:55:37z', 'origin_country_code': 'fr', 'trim': 'allure pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 128, 'id': 'a18e6c4f-b936-567c-980f-5ea57fc6e42d', 'current_year_diff': 4, 'age_in_months': 42, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 101860}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 42,
     'auction_title': '',
     'c_o_2_emission_value': 128,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:55:37z',
     'fuel_type': 'petrol',
     'id': 'a18e6c4f-b936-567c-980f-5ea57fc6e42d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mf63659',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 101860,
     'odometer_in_km': 101860,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-07-14',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 1.2 puretech allure pack',
     'transmission': 'manual',
     'trim': 'allure pack',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:55:37Z',
 'fuel_type': 'petrol',
 'id': 'a18e6c4f-b936-567c-980f-5ea57fc6e42d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF63659',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 101860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.2 PureTech Allure Pack',
 'transmission': 'manual',
 'trim': 'Allure Pack',
 'year': 2022}
2026-01-29 06:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MF63659%27 HTTP/1.1" 200 None
2026-01-29 06:05:29 [auto1.fr] INFO: Saving data for MF63659: {'auction_closing_time': 1769705737.0, 'created_time': 1769534690.373504, 'last_price_update_time': 1769666729.795459}
2026-01-29 06:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MF63659') HTTP/1.1" 204 0
2026-01-29 06:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MV88058/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a53543d8-a19f-53b4-8f71-5f7e4355757c with identifier: UD15145
2026-01-29 06:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a53543d8-a19f-53b4-8f71-5f7e4355757c with scrape type 2
2026-01-29 06:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a53543d8-a19f-53b4-8f71-5f7e4355757c with scrape type 2
2026-01-29 06:05:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a53543d8-a19f-53b4-8f71-5f7e4355757c, identifier: UD15145
2026-01-29 06:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a53543d8-a19f-53b4-8f71-5f7e4355757c with identifier: UD15145
2026-01-29 06:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a53543d8-a19f-53b4-8f71-5f7e4355757c with identifier: UD15145
2026-01-29 06:05:30 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'manual', 'odometer': 84000, 'odometer_reading_unit': 'km', 'registration_date': '2018-10-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ud15145', 'expiration_date': '2026-01-29t16:06:30z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, saint aignan de grandlieu', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 117, 'id': 'a53543d8-a19f-53b4-8f71-5f7e4355757c', 'current_year_diff': 8, 'age_in_months': 87, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 84000}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 87,
     'auction_title': '',
     'c_o_2_emission_value': 117,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:06:30z',
     'fuel_type': 'petrol',
     'id': 'a53543d8-a19f-53b4-8f71-5f7e4355757c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ud15145',
     'listing': 'auction',
     'location': 'fr, saint aignan de grandlieu',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 84000,
     'odometer_in_km': 84000,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-10-28',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2018}
2026-01-29 06:05:30 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: a53543d8-a19f-53b4-8f71-5f7e4355757c spider: auto1.fr
2026-01-29 06:05:30 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: a53543d8-a19f-53b4-8f71-5f7e4355757c due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'manual', 'odometer': 84000, 'odometer_reading_unit': 'km', 'registration_date': '2018-10-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ud15145', 'expiration_date': '2026-01-29t16:06:30z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, saint aignan de grandlieu', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 117, 'id': 'a53543d8-a19f-53b4-8f71-5f7e4355757c', 'current_year_diff': 8, 'age_in_months': 87, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 84000}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 87,
     'auction_title': '',
     'c_o_2_emission_value': 117,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:06:30z',
     'fuel_type': 'petrol',
     'id': 'a53543d8-a19f-53b4-8f71-5f7e4355757c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ud15145',
     'listing': 'auction',
     'location': 'fr, saint aignan de grandlieu',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 84000,
     'odometer_in_km': 84000,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-10-28',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:06:30Z',
 'fuel_type': 'petrol',
 'id': 'a53543d8-a19f-53b4-8f71-5f7e4355757c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD15145',
 'listing': 'auction',
 'location': 'FR, Saint Aignan de Grandlieu',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 84000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2018}
2026-01-29 06:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UD15145%27 HTTP/1.1" 200 None
2026-01-29 06:05:30 [auto1.fr] INFO: Saving data for UD15145: {'auction_closing_time': 1769702790.0, 'created_time': 1768413644.06047, 'last_price_update_time': 1769666730.182486}
2026-01-29 06:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UD15145') HTTP/1.1" 204 0
2026-01-29 06:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TM68848/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MH94137/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RB07029> (referer: https://www.auto1.com/v1/car-details-view/RB07029/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AV62458> (referer: https://www.auto1.com/v1/car-details-view/AV62458/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 313223a2-a778-5e81-9d57-92447fc92a1c with identifier: RB07029
2026-01-29 06:05:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 313223a2-a778-5e81-9d57-92447fc92a1c with scrape type 2
2026-01-29 06:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 313223a2-a778-5e81-9d57-92447fc92a1c with scrape type 2
2026-01-29 06:05:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 313223a2-a778-5e81-9d57-92447fc92a1c, identifier: RB07029
2026-01-29 06:05:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 313223a2-a778-5e81-9d57-92447fc92a1c with identifier: RB07029
2026-01-29 06:05:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 313223a2-a778-5e81-9d57-92447fc92a1c with identifier: RB07029
2026-01-29 06:05:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 151565 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    151565
2026-01-29 06:05:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 313223a2-a778-5e81-9d57-92447fc92a1c spider: auto1.fr
2026-01-29 06:05:31 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 313223a2-a778-5e81-9d57-92447fc92a1c due to rule: high_mileage_for_country.json, error: 151565 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    151565
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:33:09Z',
 'fuel_type': 'diesel',
 'id': '313223a2-a778-5e81-9d57-92447fc92a1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB07029',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 151565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi Road Trip',
 'transmission': 'automatic',
 'trim': 'Road Trip',
 'year': 2021}
2026-01-29 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RB07029%27 HTTP/1.1" 200 None
2026-01-29 06:05:31 [auto1.fr] INFO: Saving data for RB07029: {'auction_closing_time': 1769704389.0, 'created_time': 1769534127.373493, 'last_price_update_time': 1769666731.559553}
2026-01-29 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RB07029') HTTP/1.1" 204 0
2026-01-29 06:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JM41616> (referer: https://www.auto1.com/v1/car-details-view/JM41616/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d4ad5bb-d5e2-5c7f-941b-c7a7d07879b5 with identifier: AV62458
2026-01-29 06:05:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d4ad5bb-d5e2-5c7f-941b-c7a7d07879b5 with scrape type 2
2026-01-29 06:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d4ad5bb-d5e2-5c7f-941b-c7a7d07879b5 with scrape type 2
2026-01-29 06:05:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8d4ad5bb-d5e2-5c7f-941b-c7a7d07879b5, identifier: AV62458
2026-01-29 06:05:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8d4ad5bb-d5e2-5c7f-941b-c7a7d07879b5 with identifier: AV62458
2026-01-29 06:05:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8d4ad5bb-d5e2-5c7f-941b-c7a7d07879b5 with identifier: AV62458
2026-01-29 06:05:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'master' containing 'master'
2026-01-29 06:05:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 8d4ad5bb-d5e2-5c7f-941b-c7a7d07879b5 spider: auto1.fr
2026-01-29 06:05:31 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 8d4ad5bb-d5e2-5c7f-941b-c7a7d07879b5 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'master' containing 'master'
{'auction_title': '',
 'c_o_2_emission_value': 249,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.3L',
 'engine_horse_power': 135,
 'expiration_date': '2026-01-29T16:35:12Z',
 'fuel_type': 'diesel',
 'id': '8d4ad5bb-d5e2-5c7f-941b-c7a7d07879b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV62458',
 'listing': 'auction',
 'location': 'FR, Ingrandes sur Vienne',
 'make': 'Renault',
 'model': 'Master',
 'odometer': 129750,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-30',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Renault Master 2.3 dCi L3H2 3,5 Grand Confort',
 'transmission': 'manual',
 'trim': 'L3H2 3,5 Grand Confort',
 'year': 2020}
2026-01-29 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV62458%27 HTTP/1.1" 200 None
2026-01-29 06:05:31 [auto1.fr] INFO: Saving data for AV62458: {'auction_closing_time': 1769704512.0, 'created_time': 1769580048.383503, 'last_price_update_time': 1769666731.896968}
2026-01-29 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AV62458') HTTP/1.1" 204 0
2026-01-29 06:05:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2575aca-b3c4-5f8e-a524-e09036092fdb with identifier: JM41616
2026-01-29 06:05:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2575aca-b3c4-5f8e-a524-e09036092fdb with scrape type 2
2026-01-29 06:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2575aca-b3c4-5f8e-a524-e09036092fdb with scrape type 2
2026-01-29 06:05:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e2575aca-b3c4-5f8e-a524-e09036092fdb, identifier: JM41616
2026-01-29 06:05:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e2575aca-b3c4-5f8e-a524-e09036092fdb with identifier: JM41616
2026-01-29 06:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e2575aca-b3c4-5f8e-a524-e09036092fdb with identifier: JM41616
2026-01-29 06:05:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e2575aca-b3c4-5f8e-a524-e09036092fdb with identifier: JM41616 to the API
2026-01-29 06:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:05:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:05:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JM41616>
{'auction_title': '',
 'c_o_2_emission_value': 47,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 292,
 'expiration_date': '2026-01-29T16:56:28Z',
 'fuel_type': 'hybrid',
 'id': 'e2575aca-b3c4-5f8e-a524-e09036092fdb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM41616',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 130089,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive 30e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-01-29 06:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JM41616%27 HTTP/1.1" 200 None
2026-01-29 06:05:32 [auto1.fr] INFO: Saving data for JM41616: {'auction_closing_time': 1769705788.0, 'created_time': 1769190386.831265, 'last_price_update_time': 1769666732.359722}
2026-01-29 06:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JM41616') HTTP/1.1" 204 0
2026-01-29 06:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FW95558> (referer: https://www.auto1.com/v1/car-details-view/FW95558/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PS19366/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ER82069/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d7170b7-2bc6-5697-b08e-f9ae6a570c76 with identifier: FW95558
2026-01-29 06:05:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d7170b7-2bc6-5697-b08e-f9ae6a570c76 with scrape type 2
2026-01-29 06:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d7170b7-2bc6-5697-b08e-f9ae6a570c76 with scrape type 2
2026-01-29 06:05:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8d7170b7-2bc6-5697-b08e-f9ae6a570c76, identifier: FW95558
2026-01-29 06:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8d7170b7-2bc6-5697-b08e-f9ae6a570c76 with identifier: FW95558
2026-01-29 06:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8d7170b7-2bc6-5697-b08e-f9ae6a570c76 with identifier: FW95558
2026-01-29 06:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 188075 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    188075
2026-01-29 06:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 8d7170b7-2bc6-5697-b08e-f9ae6a570c76 spider: auto1.fr
2026-01-29 06:05:33 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 8d7170b7-2bc6-5697-b08e-f9ae6a570c76 due to rule: high_mileage_for_country.json, error: 188075 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    188075
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 235,
 'expiration_date': '2026-01-29T16:38:47Z',
 'fuel_type': 'diesel',
 'id': '8d7170b7-2bc6-5697-b08e-f9ae6a570c76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW95558',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 188075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D5 Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2018}
2026-01-29 06:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FW95558%27 HTTP/1.1" 200 None
2026-01-29 06:05:33 [auto1.fr] INFO: Saving data for FW95558: {'auction_closing_time': 1769704727.0, 'created_time': 1769493712.794512, 'last_price_update_time': 1769666733.23985}
2026-01-29 06:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FW95558') HTTP/1.1" 204 0
2026-01-29 06:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TP13118> (referer: https://www.auto1.com/v1/car-details-view/TP13118/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89dcf9c3-2396-5b2b-96fd-9a46ff523ce1 with identifier: TP13118
2026-01-29 06:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89dcf9c3-2396-5b2b-96fd-9a46ff523ce1 with scrape type 2
2026-01-29 06:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89dcf9c3-2396-5b2b-96fd-9a46ff523ce1 with scrape type 2
2026-01-29 06:05:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 89dcf9c3-2396-5b2b-96fd-9a46ff523ce1, identifier: TP13118
2026-01-29 06:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 89dcf9c3-2396-5b2b-96fd-9a46ff523ce1 with identifier: TP13118
2026-01-29 06:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 89dcf9c3-2396-5b2b-96fd-9a46ff523ce1 with identifier: TP13118
2026-01-29 06:05:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 89dcf9c3-2396-5b2b-96fd-9a46ff523ce1 with identifier: TP13118 to the API
2026-01-29 06:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:05:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TP13118>
{'auction_title': '',
 'c_o_2_emission_value': 64,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 320,
 'expiration_date': '2026-01-29T16:09:08Z',
 'fuel_type': 'hybrid',
 'id': '89dcf9c3-2396-5b2b-96fd-9a46ff523ce1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP13118',
 'listing': 'auction',
 'location': 'Strasbourg',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 102809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 350e 4Matic Executive',
 'transmission': 'automatic',
 'trim': '4Matic Executive',
 'year': 2017}
2026-01-29 06:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TP13118%27 HTTP/1.1" 200 None
2026-01-29 06:05:33 [auto1.fr] INFO: Saving data for TP13118: {'auction_closing_time': 1769702948.0, 'created_time': 1769533508.620257, 'last_price_update_time': 1769666733.801402}
2026-01-29 06:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TP13118') HTTP/1.1" 204 0
2026-01-29 06:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CU87504> (referer: https://www.auto1.com/v1/car-details-view/CU87504/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XC27114/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 041634c8-c144-5c0d-904f-6cd4a511a9ed with identifier: CU87504
2026-01-29 06:05:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 041634c8-c144-5c0d-904f-6cd4a511a9ed with scrape type 2
2026-01-29 06:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 041634c8-c144-5c0d-904f-6cd4a511a9ed with scrape type 2
2026-01-29 06:05:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 041634c8-c144-5c0d-904f-6cd4a511a9ed, identifier: CU87504
2026-01-29 06:05:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 041634c8-c144-5c0d-904f-6cd4a511a9ed with identifier: CU87504
2026-01-29 06:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 041634c8-c144-5c0d-904f-6cd4a511a9ed with identifier: CU87504
2026-01-29 06:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 168915 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168915
2026-01-29 06:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 041634c8-c144-5c0d-904f-6cd4a511a9ed spider: auto1.fr
2026-01-29 06:05:34 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 041634c8-c144-5c0d-904f-6cd4a511a9ed due to rule: high_mileage_for_country.json, error: 168915 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168915
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:11:47Z',
 'fuel_type': 'diesel',
 'id': '041634c8-c144-5c0d-904f-6cd4a511a9ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU87504',
 'listing': 'auction',
 'location': 'FR, Warluis',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 168915,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford C-Max 2.0 TDCi Titanium X',
 'transmission': 'automatic',
 'trim': 'Titanium X',
 'year': 2017}
2026-01-29 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CU87504%27 HTTP/1.1" 200 None
2026-01-29 06:05:34 [auto1.fr] INFO: Saving data for CU87504: {'auction_closing_time': 1769703107.0, 'created_time': 1768644168.878599, 'last_price_update_time': 1769666734.959365}
2026-01-29 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CU87504') HTTP/1.1" 204 0
2026-01-29 06:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JM14902> (referer: https://www.auto1.com/v1/car-details-view/JM14902/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c5c011d-18ef-5969-bfbf-f04dc01b0207 with identifier: JM14902
2026-01-29 06:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c5c011d-18ef-5969-bfbf-f04dc01b0207 with scrape type 2
2026-01-29 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c5c011d-18ef-5969-bfbf-f04dc01b0207 with scrape type 2
2026-01-29 06:05:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7c5c011d-18ef-5969-bfbf-f04dc01b0207, identifier: JM14902
2026-01-29 06:05:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7c5c011d-18ef-5969-bfbf-f04dc01b0207 with identifier: JM14902
2026-01-29 06:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7c5c011d-18ef-5969-bfbf-f04dc01b0207 with identifier: JM14902
2026-01-29 06:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'fiat 500 1.2 s', 'price': 0, 'currency': 'eur', 'make': 'fiat', 'model': '500', 'transmission': 'manual', 'odometer': 150918, 'odometer_reading_unit': 'km', 'registration_date': '2018-03-14', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jm14902', 'expiration_date': '2026-01-29t16:42:24z', 'origin_country_code': 'fr', 'trim': 's', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 70, 'doors_number': 3, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marseille', 'category': None, 'seats_number': 4, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 115, 'id': '7c5c011d-18ef-5969-bfbf-f04dc01b0207', 'current_year_diff': 8, 'age_in_months': 94, 'make_model': 'fiat 500', 'sanitized_make': 'fiat', 'odometer_in_km': 150918}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 94,
     'auction_title': '',
     'c_o_2_emission_value': 115,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 3,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 70,
     'expiration_date': '2026-01-29t16:42:24z',
     'fuel_type': 'petrol',
     'id': '7c5c011d-18ef-5969-bfbf-f04dc01b0207',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jm14902',
     'listing': 'auction',
     'location': 'fr, marseille',
     'make': 'fiat',
     'make_model': 'fiat 500',
     'model': '500',
     'odometer': 150918,
     'odometer_in_km': 150918,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-03-14',
     'sanitized_make': 'fiat',
     'seats_number': 4,
     'seller_name': None,
     'title': 'fiat 500 1.2 s',
     'transmission': 'manual',
     'trim': 's',
     'year': 2018}
2026-01-29 06:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 7c5c011d-18ef-5969-bfbf-f04dc01b0207 spider: auto1.fr
2026-01-29 06:05:35 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 7c5c011d-18ef-5969-bfbf-f04dc01b0207 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'fiat 500 1.2 s', 'price': 0, 'currency': 'eur', 'make': 'fiat', 'model': '500', 'transmission': 'manual', 'odometer': 150918, 'odometer_reading_unit': 'km', 'registration_date': '2018-03-14', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jm14902', 'expiration_date': '2026-01-29t16:42:24z', 'origin_country_code': 'fr', 'trim': 's', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 70, 'doors_number': 3, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marseille', 'category': None, 'seats_number': 4, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 115, 'id': '7c5c011d-18ef-5969-bfbf-f04dc01b0207', 'current_year_diff': 8, 'age_in_months': 94, 'make_model': 'fiat 500', 'sanitized_make': 'fiat', 'odometer_in_km': 150918}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 94,
     'auction_title': '',
     'c_o_2_emission_value': 115,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 3,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 70,
     'expiration_date': '2026-01-29t16:42:24z',
     'fuel_type': 'petrol',
     'id': '7c5c011d-18ef-5969-bfbf-f04dc01b0207',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jm14902',
     'listing': 'auction',
     'location': 'fr, marseille',
     'make': 'fiat',
     'make_model': 'fiat 500',
     'model': '500',
     'odometer': 150918,
     'odometer_in_km': 150918,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-03-14',
     'sanitized_make': 'fiat',
     'seats_number': 4,
     'seller_name': None,
     'title': 'fiat 500 1.2 s',
     'transmission': 'manual',
     'trim': 's',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-01-29T16:42:24Z',
 'fuel_type': 'petrol',
 'id': '7c5c011d-18ef-5969-bfbf-f04dc01b0207',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM14902',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Fiat',
 'model': '500',
 'odometer': 150918,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-14',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2018}
2026-01-29 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JM14902%27 HTTP/1.1" 200 None
2026-01-29 06:05:35 [auto1.fr] INFO: Saving data for JM14902: {'auction_closing_time': 1769704944.0, 'created_time': 1768928447.708504, 'last_price_update_time': 1769666735.37467}
2026-01-29 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JM14902') HTTP/1.1" 204 0
2026-01-29 06:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TM68848> (referer: https://www.auto1.com/v1/car-details-view/TM68848/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7212ed7b-157a-56b7-86b0-1bc5cc525110 with identifier: TM68848
2026-01-29 06:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7212ed7b-157a-56b7-86b0-1bc5cc525110 with scrape type 2
2026-01-29 06:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7212ed7b-157a-56b7-86b0-1bc5cc525110 with scrape type 2
2026-01-29 06:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7212ed7b-157a-56b7-86b0-1bc5cc525110, identifier: TM68848
2026-01-29 06:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7212ed7b-157a-56b7-86b0-1bc5cc525110 with identifier: TM68848
2026-01-29 06:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7212ed7b-157a-56b7-86b0-1bc5cc525110 with identifier: TM68848
2026-01-29 06:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech graphic', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 76454, 'odometer_reading_unit': 'km', 'registration_date': '2018-03-05', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/tm68848', 'expiration_date': '2026-01-29t16:56:45z', 'origin_country_code': 'fr', 'trim': 'graphic', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, décines-charpieu', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': '7212ed7b-157a-56b7-86b0-1bc5cc525110', 'current_year_diff': 8, 'age_in_months': 94, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 76454}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 94,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:56:45z',
     'fuel_type': 'petrol',
     'id': '7212ed7b-157a-56b7-86b0-1bc5cc525110',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/tm68848',
     'listing': 'auction',
     'location': 'fr, décines-charpieu',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 76454,
     'odometer_in_km': 76454,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-03-05',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech graphic',
     'transmission': 'manual',
     'trim': 'graphic',
     'year': 2018}
2026-01-29 06:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 7212ed7b-157a-56b7-86b0-1bc5cc525110 spider: auto1.fr
2026-01-29 06:05:36 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 7212ed7b-157a-56b7-86b0-1bc5cc525110 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech graphic', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 76454, 'odometer_reading_unit': 'km', 'registration_date': '2018-03-05', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/tm68848', 'expiration_date': '2026-01-29t16:56:45z', 'origin_country_code': 'fr', 'trim': 'graphic', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, décines-charpieu', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': '7212ed7b-157a-56b7-86b0-1bc5cc525110', 'current_year_diff': 8, 'age_in_months': 94, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 76454}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 94,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:56:45z',
     'fuel_type': 'petrol',
     'id': '7212ed7b-157a-56b7-86b0-1bc5cc525110',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/tm68848',
     'listing': 'auction',
     'location': 'fr, décines-charpieu',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 76454,
     'odometer_in_km': 76454,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-03-05',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech graphic',
     'transmission': 'manual',
     'trim': 'graphic',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:56:45Z',
 'fuel_type': 'petrol',
 'id': '7212ed7b-157a-56b7-86b0-1bc5cc525110',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM68848',
 'listing': 'auction',
 'location': 'FR, Décines-Charpieu',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 76454,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Graphic',
 'transmission': 'manual',
 'trim': 'Graphic',
 'year': 2018}
2026-01-29 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TM68848%27 HTTP/1.1" 200 None
2026-01-29 06:05:36 [auto1.fr] INFO: Saving data for TM68848: {'auction_closing_time': 1769705805.0, 'created_time': 1769533384.305234, 'last_price_update_time': 1769666736.402988}
2026-01-29 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TM68848') HTTP/1.1" 204 0
2026-01-29 06:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MV88058> (referer: https://www.auto1.com/v1/car-details-view/MV88058/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d7bb3e7-f5a5-594d-9db7-7f030e939284 with identifier: MV88058
2026-01-29 06:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d7bb3e7-f5a5-594d-9db7-7f030e939284 with scrape type 2
2026-01-29 06:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d7bb3e7-f5a5-594d-9db7-7f030e939284 with scrape type 2
2026-01-29 06:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7d7bb3e7-f5a5-594d-9db7-7f030e939284, identifier: MV88058
2026-01-29 06:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7d7bb3e7-f5a5-594d-9db7-7f030e939284 with identifier: MV88058
2026-01-29 06:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7d7bb3e7-f5a5-594d-9db7-7f030e939284 with identifier: MV88058
2026-01-29 06:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 143487 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    143487
2026-01-29 06:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 7d7bb3e7-f5a5-594d-9db7-7f030e939284 spider: auto1.fr
2026-01-29 06:05:37 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 7d7bb3e7-f5a5-594d-9db7-7f030e939284 due to rule: high_mileage_for_make.json, error: 143487 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    143487
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-01-29T16:20:08Z',
 'fuel_type': 'diesel',
 'id': '7d7bb3e7-f5a5-594d-9db7-7f030e939284',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV88058',
 'listing': 'auction',
 'location': 'FR, Quincieux',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 143487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 2.0 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2018}
2026-01-29 06:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MV88058%27 HTTP/1.1" 200 None
2026-01-29 06:05:37 [auto1.fr] INFO: Saving data for MV88058: {'auction_closing_time': 1769703608.0, 'created_time': 1769061990.314005, 'last_price_update_time': 1769666737.426812}
2026-01-29 06:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MV88058') HTTP/1.1" 204 0
2026-01-29 06:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YS99236/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BD43776> (referer: https://www.auto1.com/v1/car-details-view/BD43776/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79879279-87c6-5626-b702-73621144d94f with identifier: BD43776
2026-01-29 06:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79879279-87c6-5626-b702-73621144d94f with scrape type 2
2026-01-29 06:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79879279-87c6-5626-b702-73621144d94f with scrape type 2
2026-01-29 06:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 79879279-87c6-5626-b702-73621144d94f, identifier: BD43776
2026-01-29 06:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 79879279-87c6-5626-b702-73621144d94f with identifier: BD43776
2026-01-29 06:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 79879279-87c6-5626-b702-73621144d94f with identifier: BD43776
2026-01-29 06:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 79879279-87c6-5626-b702-73621144d94f with identifier: BD43776 to the API
2026-01-29 06:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BD43776>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 258,
 'expiration_date': '2026-01-29T16:45:00Z',
 'fuel_type': 'diesel',
 'id': '79879279-87c6-5626-b702-73621144d94f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD43776',
 'listing': 'auction',
 'location': 'FR, Quincieux',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 82260,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 350 d 4Matic Executive',
 'transmission': 'automatic',
 'trim': '4Matic Executive',
 'year': 2017}
2026-01-29 06:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BD43776%27 HTTP/1.1" 200 None
2026-01-29 06:05:37 [auto1.fr] INFO: Saving data for BD43776: {'auction_closing_time': 1769705100.0, 'created_time': 1768889226.42899, 'last_price_update_time': 1769666737.979546}
2026-01-29 06:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BD43776') HTTP/1.1" 204 0
2026-01-29 06:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PL20124> (referer: https://www.auto1.com/v1/car-details-view/PL20124/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da0eb857-ca4e-52c6-9ac6-69cbe864d861 with identifier: PL20124
2026-01-29 06:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da0eb857-ca4e-52c6-9ac6-69cbe864d861 with scrape type 2
2026-01-29 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da0eb857-ca4e-52c6-9ac6-69cbe864d861 with scrape type 2
2026-01-29 06:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: da0eb857-ca4e-52c6-9ac6-69cbe864d861, identifier: PL20124
2026-01-29 06:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: da0eb857-ca4e-52c6-9ac6-69cbe864d861 with identifier: PL20124
2026-01-29 06:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: da0eb857-ca4e-52c6-9ac6-69cbe864d861 with identifier: PL20124
2026-01-29 06:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech active pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 20846, 'odometer_reading_unit': 'km', 'registration_date': '2022-03-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pl20124', 'expiration_date': '2026-01-29t16:10:40z', 'origin_country_code': 'fr', 'trim': 'active pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 119, 'id': 'da0eb857-ca4e-52c6-9ac6-69cbe864d861', 'current_year_diff': 4, 'age_in_months': 46, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 20846}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 46,
     'auction_title': '',
     'c_o_2_emission_value': 119,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 75,
     'expiration_date': '2026-01-29t16:10:40z',
     'fuel_type': 'petrol',
     'id': 'da0eb857-ca4e-52c6-9ac6-69cbe864d861',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pl20124',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 20846,
     'odometer_in_km': 20846,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-03-28',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech active pack',
     'transmission': 'manual',
     'trim': 'active pack',
     'year': 2022}
2026-01-29 06:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: da0eb857-ca4e-52c6-9ac6-69cbe864d861 spider: auto1.fr
2026-01-29 06:05:39 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: da0eb857-ca4e-52c6-9ac6-69cbe864d861 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech active pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 20846, 'odometer_reading_unit': 'km', 'registration_date': '2022-03-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pl20124', 'expiration_date': '2026-01-29t16:10:40z', 'origin_country_code': 'fr', 'trim': 'active pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 119, 'id': 'da0eb857-ca4e-52c6-9ac6-69cbe864d861', 'current_year_diff': 4, 'age_in_months': 46, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 20846}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 46,
     'auction_title': '',
     'c_o_2_emission_value': 119,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 75,
     'expiration_date': '2026-01-29t16:10:40z',
     'fuel_type': 'petrol',
     'id': 'da0eb857-ca4e-52c6-9ac6-69cbe864d861',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pl20124',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 20846,
     'odometer_in_km': 20846,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-03-28',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech active pack',
     'transmission': 'manual',
     'trim': 'active pack',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:10:40Z',
 'fuel_type': 'petrol',
 'id': 'da0eb857-ca4e-52c6-9ac6-69cbe864d861',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL20124',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 20846,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Active Pack',
 'transmission': 'manual',
 'trim': 'Active Pack',
 'year': 2022}
2026-01-29 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PL20124%27 HTTP/1.1" 200 None
2026-01-29 06:05:39 [auto1.fr] INFO: Saving data for PL20124: {'auction_closing_time': 1769703040.0, 'created_time': 1769190253.88477, 'last_price_update_time': 1769666739.325166}
2026-01-29 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PL20124') HTTP/1.1" 204 0
2026-01-29 06:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RR16791/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WN24520> (referer: https://www.auto1.com/v1/car-details-view/WN24520/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93ee8572-f814-55ad-bc8b-cdbaf865d6d4 with identifier: WN24520
2026-01-29 06:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93ee8572-f814-55ad-bc8b-cdbaf865d6d4 with scrape type 2
2026-01-29 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93ee8572-f814-55ad-bc8b-cdbaf865d6d4 with scrape type 2
2026-01-29 06:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 93ee8572-f814-55ad-bc8b-cdbaf865d6d4, identifier: WN24520
2026-01-29 06:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 93ee8572-f814-55ad-bc8b-cdbaf865d6d4 with identifier: WN24520
2026-01-29 06:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 93ee8572-f814-55ad-bc8b-cdbaf865d6d4 with identifier: WN24520
2026-01-29 06:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 mild-hybrid gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'automatic', 'odometer': 27380, 'odometer_reading_unit': 'km', 'registration_date': '2024-08-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wn24520', 'expiration_date': '2026-01-29t16:15:43z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2024, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'avignon', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 104, 'id': '93ee8572-f814-55ad-bc8b-cdbaf865d6d4', 'current_year_diff': 2, 'age_in_months': 17, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 27380}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 17,
     'auction_title': '',
     'c_o_2_emission_value': 104,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:15:43z',
     'fuel_type': 'petrol',
     'id': '93ee8572-f814-55ad-bc8b-cdbaf865d6d4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wn24520',
     'listing': 'auction',
     'location': 'avignon',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 27380,
     'odometer_in_km': 27380,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2024-08-27',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 mild-hybrid gt',
     'transmission': 'automatic',
     'trim': 'gt',
     'year': 2024}
2026-01-29 06:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 93ee8572-f814-55ad-bc8b-cdbaf865d6d4 spider: auto1.fr
2026-01-29 06:05:39 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 93ee8572-f814-55ad-bc8b-cdbaf865d6d4 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 mild-hybrid gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'automatic', 'odometer': 27380, 'odometer_reading_unit': 'km', 'registration_date': '2024-08-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wn24520', 'expiration_date': '2026-01-29t16:15:43z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2024, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'avignon', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 104, 'id': '93ee8572-f814-55ad-bc8b-cdbaf865d6d4', 'current_year_diff': 2, 'age_in_months': 17, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 27380}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 17,
     'auction_title': '',
     'c_o_2_emission_value': 104,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:15:43z',
     'fuel_type': 'petrol',
     'id': '93ee8572-f814-55ad-bc8b-cdbaf865d6d4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wn24520',
     'listing': 'auction',
     'location': 'avignon',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 27380,
     'odometer_in_km': 27380,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2024-08-27',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 mild-hybrid gt',
     'transmission': 'automatic',
     'trim': 'gt',
     'year': 2024}
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:15:43Z',
 'fuel_type': 'petrol',
 'id': '93ee8572-f814-55ad-bc8b-cdbaf865d6d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN24520',
 'listing': 'auction',
 'location': 'Avignon',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 27380,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-08-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 Mild-Hybrid GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2024}
2026-01-29 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WN24520%27 HTTP/1.1" 200 None
2026-01-29 06:05:39 [auto1.fr] INFO: Saving data for WN24520: {'auction_closing_time': 1769703343.0, 'created_time': 1769533958.518152, 'last_price_update_time': 1769666739.771462}
2026-01-29 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WN24520') HTTP/1.1" 204 0
2026-01-29 06:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PS19366> (referer: https://www.auto1.com/v1/car-details-view/PS19366/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd024639-4e79-536a-b0b9-425c63234417 with identifier: PS19366
2026-01-29 06:05:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd024639-4e79-536a-b0b9-425c63234417 with scrape type 2
2026-01-29 06:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd024639-4e79-536a-b0b9-425c63234417 with scrape type 2
2026-01-29 06:05:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cd024639-4e79-536a-b0b9-425c63234417, identifier: PS19366
2026-01-29 06:05:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cd024639-4e79-536a-b0b9-425c63234417 with identifier: PS19366
2026-01-29 06:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cd024639-4e79-536a-b0b9-425c63234417 with identifier: PS19366
2026-01-29 06:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'renault captur 1.2 tce energy intens', 'price': 0, 'currency': 'eur', 'make': 'renault', 'model': 'captur', 'transmission': 'automatic', 'odometer': 33730, 'odometer_reading_unit': 'km', 'registration_date': '2017-10-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ps19366', 'expiration_date': '2026-01-29t16:36:26z', 'origin_country_code': 'fr', 'trim': 'intens', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 120, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marseille', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 125, 'id': 'cd024639-4e79-536a-b0b9-425c63234417', 'current_year_diff': 9, 'age_in_months': 99, 'make_model': 'renault captur', 'sanitized_make': 'renault', 'odometer_in_km': 33730}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 99,
     'auction_title': '',
     'c_o_2_emission_value': 125,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 120,
     'expiration_date': '2026-01-29t16:36:26z',
     'fuel_type': 'petrol',
     'id': 'cd024639-4e79-536a-b0b9-425c63234417',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ps19366',
     'listing': 'auction',
     'location': 'fr, marseille',
     'make': 'renault',
     'make_model': 'renault captur',
     'model': 'captur',
     'odometer': 33730,
     'odometer_in_km': 33730,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-10-23',
     'sanitized_make': 'renault',
     'seats_number': 5,
     'seller_name': None,
     'title': 'renault captur 1.2 tce energy intens',
     'transmission': 'automatic',
     'trim': 'intens',
     'year': 2017}
2026-01-29 06:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: cd024639-4e79-536a-b0b9-425c63234417 spider: auto1.fr
2026-01-29 06:05:40 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: cd024639-4e79-536a-b0b9-425c63234417 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'renault captur 1.2 tce energy intens', 'price': 0, 'currency': 'eur', 'make': 'renault', 'model': 'captur', 'transmission': 'automatic', 'odometer': 33730, 'odometer_reading_unit': 'km', 'registration_date': '2017-10-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ps19366', 'expiration_date': '2026-01-29t16:36:26z', 'origin_country_code': 'fr', 'trim': 'intens', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 120, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marseille', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 125, 'id': 'cd024639-4e79-536a-b0b9-425c63234417', 'current_year_diff': 9, 'age_in_months': 99, 'make_model': 'renault captur', 'sanitized_make': 'renault', 'odometer_in_km': 33730}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 99,
     'auction_title': '',
     'c_o_2_emission_value': 125,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 120,
     'expiration_date': '2026-01-29t16:36:26z',
     'fuel_type': 'petrol',
     'id': 'cd024639-4e79-536a-b0b9-425c63234417',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ps19366',
     'listing': 'auction',
     'location': 'fr, marseille',
     'make': 'renault',
     'make_model': 'renault captur',
     'model': 'captur',
     'odometer': 33730,
     'odometer_in_km': 33730,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-10-23',
     'sanitized_make': 'renault',
     'seats_number': 5,
     'seller_name': None,
     'title': 'renault captur 1.2 tce energy intens',
     'transmission': 'automatic',
     'trim': 'intens',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:36:26Z',
 'fuel_type': 'petrol',
 'id': 'cd024639-4e79-536a-b0b9-425c63234417',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS19366',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 33730,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.2 TCe Energy Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2017}
2026-01-29 06:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PS19366%27 HTTP/1.1" 200 None
2026-01-29 06:05:41 [auto1.fr] INFO: Saving data for PS19366: {'auction_closing_time': 1769704586.0, 'created_time': 1769534442.226812, 'last_price_update_time': 1769666741.001505}
2026-01-29 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PS19366') HTTP/1.1" 204 0
2026-01-29 06:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KT86932> (referer: https://www.auto1.com/v1/car-details-view/KT86932/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e255ba99-5338-5b92-b8ee-90a5af24016c with identifier: KT86932
2026-01-29 06:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e255ba99-5338-5b92-b8ee-90a5af24016c with scrape type 2
2026-01-29 06:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e255ba99-5338-5b92-b8ee-90a5af24016c with scrape type 2
2026-01-29 06:05:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e255ba99-5338-5b92-b8ee-90a5af24016c, identifier: KT86932
2026-01-29 06:05:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e255ba99-5338-5b92-b8ee-90a5af24016c with identifier: KT86932
2026-01-29 06:05:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e255ba99-5338-5b92-b8ee-90a5af24016c with identifier: KT86932
2026-01-29 06:05:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 79378, 'odometer_reading_unit': 'km', 'registration_date': '2018-10-25', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kt86932', 'expiration_date': '2026-01-29t16:16:48z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ergué-gabéric', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 114, 'id': 'e255ba99-5338-5b92-b8ee-90a5af24016c', 'current_year_diff': 8, 'age_in_months': 87, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 79378}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 87,
     'auction_title': '',
     'c_o_2_emission_value': 114,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:16:48z',
     'fuel_type': 'petrol',
     'id': 'e255ba99-5338-5b92-b8ee-90a5af24016c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kt86932',
     'listing': 'auction',
     'location': 'fr, ergué-gabéric',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 79378,
     'odometer_in_km': 79378,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-10-25',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'automatic',
     'trim': 'allure',
     'year': 2018}
2026-01-29 06:05:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: e255ba99-5338-5b92-b8ee-90a5af24016c spider: auto1.fr
2026-01-29 06:05:41 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: e255ba99-5338-5b92-b8ee-90a5af24016c due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 79378, 'odometer_reading_unit': 'km', 'registration_date': '2018-10-25', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kt86932', 'expiration_date': '2026-01-29t16:16:48z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ergué-gabéric', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 114, 'id': 'e255ba99-5338-5b92-b8ee-90a5af24016c', 'current_year_diff': 8, 'age_in_months': 87, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 79378}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 87,
     'auction_title': '',
     'c_o_2_emission_value': 114,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:16:48z',
     'fuel_type': 'petrol',
     'id': 'e255ba99-5338-5b92-b8ee-90a5af24016c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kt86932',
     'listing': 'auction',
     'location': 'fr, ergué-gabéric',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 79378,
     'odometer_in_km': 79378,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-10-25',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'automatic',
     'trim': 'allure',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:16:48Z',
 'fuel_type': 'petrol',
 'id': 'e255ba99-5338-5b92-b8ee-90a5af24016c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT86932',
 'listing': 'auction',
 'location': 'FR, Ergué-Gabéric',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 79378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2018}
2026-01-29 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KT86932%27 HTTP/1.1" 200 None
2026-01-29 06:05:41 [auto1.fr] INFO: Saving data for KT86932: {'auction_closing_time': 1769703408.0, 'created_time': 1769533954.245491, 'last_price_update_time': 1769666741.531139}
2026-01-29 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KT86932') HTTP/1.1" 204 0
2026-01-29 06:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MH94137> (referer: https://www.auto1.com/v1/car-details-view/MH94137/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10a05c8e-a9dd-54e0-9bed-ad993da74049 with identifier: MH94137
2026-01-29 06:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10a05c8e-a9dd-54e0-9bed-ad993da74049 with scrape type 2
2026-01-29 06:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10a05c8e-a9dd-54e0-9bed-ad993da74049 with scrape type 2
2026-01-29 06:05:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 10a05c8e-a9dd-54e0-9bed-ad993da74049, identifier: MH94137
2026-01-29 06:05:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 10a05c8e-a9dd-54e0-9bed-ad993da74049 with identifier: MH94137
2026-01-29 06:05:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 10a05c8e-a9dd-54e0-9bed-ad993da74049 with identifier: MH94137
2026-01-29 06:05:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 10a05c8e-a9dd-54e0-9bed-ad993da74049 with identifier: MH94137 to the API
2026-01-29 06:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:05:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:05:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MH94137>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:37:18Z',
 'fuel_type': 'petrol',
 'id': '10a05c8e-a9dd-54e0-9bed-ad993da74049',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH94137',
 'listing': 'auction',
 'location': 'FR, Marly-la-ville',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 95337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.5 TSI ACT Life 1st',
 'transmission': 'manual',
 'trim': 'Life 1st',
 'year': 2021}
2026-01-29 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MH94137%27 HTTP/1.1" 200 None
2026-01-29 06:05:42 [auto1.fr] INFO: Saving data for MH94137: {'auction_closing_time': 1769704638.0, 'created_time': 1769533627.10347, 'last_price_update_time': 1769666742.071507}
2026-01-29 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MH94137') HTTP/1.1" 204 0
2026-01-29 06:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HL81867/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ER82069> (referer: https://www.auto1.com/v1/car-details-view/ER82069/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00e7bd73-9fb9-552f-bd30-7cde7f8df687 with identifier: ER82069
2026-01-29 06:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00e7bd73-9fb9-552f-bd30-7cde7f8df687 with scrape type 2
2026-01-29 06:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00e7bd73-9fb9-552f-bd30-7cde7f8df687 with scrape type 2
2026-01-29 06:05:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 00e7bd73-9fb9-552f-bd30-7cde7f8df687, identifier: ER82069
2026-01-29 06:05:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 00e7bd73-9fb9-552f-bd30-7cde7f8df687 with identifier: ER82069
2026-01-29 06:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 00e7bd73-9fb9-552f-bd30-7cde7f8df687 with identifier: ER82069
2026-01-29 06:05:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 00e7bd73-9fb9-552f-bd30-7cde7f8df687 with identifier: ER82069 to the API
2026-01-29 06:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:05:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:05:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ER82069>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 184,
 'expiration_date': '2026-01-29T16:24:09Z',
 'fuel_type': 'hybrid',
 'id': '00e7bd73-9fb9-552f-bd30-7cde7f8df687',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER82069',
 'listing': 'auction',
 'location': 'FR, Houecourt',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 93600,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota C-HR 2.0 Hybrid Team D',
 'transmission': 'automatic',
 'trim': 'Team D',
 'year': 2021}
2026-01-29 06:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER82069%27 HTTP/1.1" 200 None
2026-01-29 06:05:44 [auto1.fr] INFO: Saving data for ER82069: {'auction_closing_time': 1769703849.0, 'created_time': 1768496707.778926, 'last_price_update_time': 1769666744.89067}
2026-01-29 06:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ER82069') HTTP/1.1" 204 0
2026-01-29 06:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PF08969/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YL65277/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XC27114> (referer: https://www.auto1.com/v1/car-details-view/XC27114/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MJ36371> (referer: https://www.auto1.com/v1/car-details-view/MJ36371/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 483a6e25-7501-556b-a679-1bdfbc4542eb with identifier: XC27114
2026-01-29 06:05:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 483a6e25-7501-556b-a679-1bdfbc4542eb with scrape type 2
2026-01-29 06:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 483a6e25-7501-556b-a679-1bdfbc4542eb with scrape type 2
2026-01-29 06:05:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 483a6e25-7501-556b-a679-1bdfbc4542eb, identifier: XC27114
2026-01-29 06:05:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 483a6e25-7501-556b-a679-1bdfbc4542eb with identifier: XC27114
2026-01-29 06:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 483a6e25-7501-556b-a679-1bdfbc4542eb with identifier: XC27114
2026-01-29 06:05:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 483a6e25-7501-556b-a679-1bdfbc4542eb with identifier: XC27114 to the API
2026-01-29 06:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:05:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:05:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XC27114>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:58:13Z',
 'fuel_type': 'diesel',
 'id': '483a6e25-7501-556b-a679-1bdfbc4542eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC27114',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 107741,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-26',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.6 Blue-HDi Business +',
 'transmission': 'automatic',
 'trim': 'Business +',
 'year': 2017}
2026-01-29 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XC27114%27 HTTP/1.1" 200 None
2026-01-29 06:05:46 [auto1.fr] INFO: Saving data for XC27114: {'auction_closing_time': 1769705893.0, 'created_time': 1769580131.657903, 'last_price_update_time': 1769666746.325165}
2026-01-29 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XC27114') HTTP/1.1" 204 0
2026-01-29 06:05:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b25e2fc6-3815-5314-9d66-6cc60a3d7e17 with identifier: MJ36371
2026-01-29 06:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b25e2fc6-3815-5314-9d66-6cc60a3d7e17 with scrape type 2
2026-01-29 06:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b25e2fc6-3815-5314-9d66-6cc60a3d7e17 with scrape type 2
2026-01-29 06:05:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b25e2fc6-3815-5314-9d66-6cc60a3d7e17, identifier: MJ36371
2026-01-29 06:05:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b25e2fc6-3815-5314-9d66-6cc60a3d7e17 with identifier: MJ36371
2026-01-29 06:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b25e2fc6-3815-5314-9d66-6cc60a3d7e17 with identifier: MJ36371
2026-01-29 06:05:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b25e2fc6-3815-5314-9d66-6cc60a3d7e17 with identifier: MJ36371 to the API
2026-01-29 06:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:05:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:05:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MJ36371>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:21:29Z',
 'fuel_type': 'diesel',
 'id': 'b25e2fc6-3815-5314-9d66-6cc60a3d7e17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ36371',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 91097,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2021}
2026-01-29 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MJ36371%27 HTTP/1.1" 200 None
2026-01-29 06:05:46 [auto1.fr] INFO: Saving data for MJ36371: {'auction_closing_time': 1769703689.0, 'created_time': 1768475705.765569, 'last_price_update_time': 1769666746.729688}
2026-01-29 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MJ36371') HTTP/1.1" 204 0
2026-01-29 06:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:46 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:05:46 [auto1.fr] INFO: Found listing with ID: EH89908
2026-01-29 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EH89908%27 HTTP/1.1" 200 None
2026-01-29 06:05:46 [auto1.fr] INFO: Scrape type for EH89908: 0
2026-01-29 06:05:46 [auto1.fr] INFO: Found listing with ID: HL33309
2026-01-29 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL33309%27 HTTP/1.1" 200 None
2026-01-29 06:05:46 [auto1.fr] INFO: Scrape type for HL33309: 0
2026-01-29 06:05:46 [auto1.fr] INFO: Found listing with ID: VB36819
2026-01-29 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VB36819%27 HTTP/1.1" 200 None
2026-01-29 06:05:46 [auto1.fr] INFO: Scrape type for VB36819: 2
2026-01-29 06:05:46 [auto1.fr] INFO: Found listing with ID: XW92143
2026-01-29 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XW92143%27 HTTP/1.1" 200 None
2026-01-29 06:05:46 [auto1.fr] INFO: Scrape type for XW92143: 0
2026-01-29 06:05:46 [auto1.fr] INFO: Found listing with ID: HN13933
2026-01-29 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HN13933%27 HTTP/1.1" 200 None
2026-01-29 06:05:46 [auto1.fr] INFO: Scrape type for HN13933: 0
2026-01-29 06:05:46 [auto1.fr] INFO: Found listing with ID: LH89172
2026-01-29 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LH89172%27 HTTP/1.1" 200 None
2026-01-29 06:05:46 [auto1.fr] INFO: Scrape type for LH89172: 0
2026-01-29 06:05:46 [auto1.fr] INFO: Found listing with ID: YH64690
2026-01-29 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YH64690%27 HTTP/1.1" 200 None
2026-01-29 06:05:46 [auto1.fr] INFO: Scrape type for YH64690: 2
2026-01-29 06:05:46 [auto1.fr] INFO: Found listing with ID: JK27396
2026-01-29 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JK27396%27 HTTP/1.1" 200 None
2026-01-29 06:05:46 [auto1.fr] INFO: Scrape type for JK27396: 2
2026-01-29 06:05:46 [auto1.fr] INFO: Found listing with ID: YY35231
2026-01-29 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YY35231%27 HTTP/1.1" 200 None
2026-01-29 06:05:47 [auto1.fr] INFO: Scrape type for YY35231: 0
2026-01-29 06:05:47 [auto1.fr] INFO: Found listing with ID: KS02830
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KS02830%27 HTTP/1.1" 200 None
2026-01-29 06:05:47 [auto1.fr] INFO: Scrape type for KS02830: 0
2026-01-29 06:05:47 [auto1.fr] INFO: Found listing with ID: KK69084
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KK69084%27 HTTP/1.1" 200 None
2026-01-29 06:05:47 [auto1.fr] INFO: Scrape type for KK69084: 2
2026-01-29 06:05:47 [auto1.fr] INFO: Found listing with ID: SU63674
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SU63674%27 HTTP/1.1" 200 None
2026-01-29 06:05:47 [auto1.fr] INFO: Scrape type for SU63674: 0
2026-01-29 06:05:47 [auto1.fr] INFO: Found listing with ID: KJ04594
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KJ04594%27 HTTP/1.1" 200 None
2026-01-29 06:05:47 [auto1.fr] INFO: Scrape type for KJ04594: 0
2026-01-29 06:05:47 [auto1.fr] INFO: Found listing with ID: KX09817
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KX09817%27 HTTP/1.1" 200 None
2026-01-29 06:05:47 [auto1.fr] INFO: Scrape type for KX09817: 2
2026-01-29 06:05:47 [auto1.fr] INFO: Found listing with ID: XH68171
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XH68171%27 HTTP/1.1" 200 None
2026-01-29 06:05:47 [auto1.fr] INFO: Scrape type for XH68171: 0
2026-01-29 06:05:47 [auto1.fr] INFO: Found listing with ID: SV32269
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV32269%27 HTTP/1.1" 200 None
2026-01-29 06:05:47 [auto1.fr] INFO: Scrape type for SV32269: 2
2026-01-29 06:05:47 [auto1.fr] INFO: Found listing with ID: AR66543
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AR66543%27 HTTP/1.1" 200 None
2026-01-29 06:05:47 [auto1.fr] INFO: Scrape type for AR66543: 2
2026-01-29 06:05:47 [auto1.fr] INFO: Found listing with ID: SY49295
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SY49295%27 HTTP/1.1" 200 None
2026-01-29 06:05:47 [auto1.fr] INFO: Scrape type for SY49295: 0
2026-01-29 06:05:47 [auto1.fr] INFO: Found listing with ID: CE56263
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CE56263%27 HTTP/1.1" 200 None
2026-01-29 06:05:47 [auto1.fr] INFO: Scrape type for CE56263: 2
2026-01-29 06:05:47 [auto1.fr] INFO: Found listing with ID: ZH82252
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZH82252%27 HTTP/1.1" 200 None
2026-01-29 06:05:47 [auto1.fr] INFO: Scrape type for ZH82252: 2
2026-01-29 06:05:47 [auto1.fr] INFO: Found listing with ID: VJ29462
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VJ29462%27 HTTP/1.1" 200 None
2026-01-29 06:05:47 [auto1.fr] INFO: Scrape type for VJ29462: 0
2026-01-29 06:05:47 [auto1.fr] INFO: Found listing with ID: GS14408
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GS14408%27 HTTP/1.1" 200 None
2026-01-29 06:05:47 [auto1.fr] INFO: Scrape type for GS14408: 0
2026-01-29 06:05:47 [auto1.fr] INFO: Found listing with ID: TC17155
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TC17155%27 HTTP/1.1" 200 None
2026-01-29 06:05:47 [auto1.fr] INFO: Scrape type for TC17155: 2
2026-01-29 06:05:47 [auto1.fr] INFO: Found listing with ID: XN32532
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XN32532%27 HTTP/1.1" 200 None
2026-01-29 06:05:47 [auto1.fr] INFO: Scrape type for XN32532: 0
2026-01-29 06:05:47 [auto1.fr] INFO: Found listing with ID: LK16188
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LK16188%27 HTTP/1.1" 200 None
2026-01-29 06:05:47 [auto1.fr] INFO: Scrape type for LK16188: 0
2026-01-29 06:05:47 [auto1.fr] INFO: Found listing with ID: AW25132
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW25132%27 HTTP/1.1" 200 None
2026-01-29 06:05:47 [auto1.fr] INFO: Scrape type for AW25132: 2
2026-01-29 06:05:47 [auto1.fr] INFO: Found listing with ID: BM28872
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BM28872%27 HTTP/1.1" 200 None
2026-01-29 06:05:47 [auto1.fr] INFO: Scrape type for BM28872: 0
2026-01-29 06:05:47 [auto1.fr] INFO: Found listing with ID: WG41054
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WG41054%27 HTTP/1.1" 200 None
2026-01-29 06:05:47 [auto1.fr] INFO: Scrape type for WG41054: 2
2026-01-29 06:05:47 [auto1.fr] INFO: Found listing with ID: RY70552
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RY70552%27 HTTP/1.1" 200 None
2026-01-29 06:05:47 [auto1.fr] INFO: Scrape type for RY70552: 2
2026-01-29 06:05:47 [auto1.fr] INFO: Found listing with ID: UB45320
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UB45320%27 HTTP/1.1" 200 None
2026-01-29 06:05:47 [auto1.fr] INFO: Scrape type for UB45320: 2
2026-01-29 06:05:47 [auto1.fr] INFO: Found listing with ID: AK86019
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AK86019%27 HTTP/1.1" 200 None
2026-01-29 06:05:47 [auto1.fr] INFO: Scrape type for AK86019: 0
2026-01-29 06:05:47 [auto1.fr] INFO: Found listing with ID: MF09861
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MF09861%27 HTTP/1.1" 200 None
2026-01-29 06:05:47 [auto1.fr] INFO: Scrape type for MF09861: 2
2026-01-29 06:05:47 [auto1.fr] INFO: Found listing with ID: AN32060
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AN32060%27 HTTP/1.1" 200 None
2026-01-29 06:05:47 [auto1.fr] INFO: Scrape type for AN32060: 0
2026-01-29 06:05:47 [auto1.fr] INFO: Found listing with ID: YC78844
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YC78844%27 HTTP/1.1" 200 None
2026-01-29 06:05:47 [auto1.fr] INFO: Scrape type for YC78844: 2
2026-01-29 06:05:47 [auto1.fr] INFO: Found listing with ID: UZ98634
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UZ98634%27 HTTP/1.1" 200 None
2026-01-29 06:05:47 [auto1.fr] INFO: Scrape type for UZ98634: 2
2026-01-29 06:05:47 [auto1.fr] INFO: Found listing with ID: DR10042
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DR10042%27 HTTP/1.1" 200 None
2026-01-29 06:05:47 [auto1.fr] INFO: Scrape type for DR10042: 2
2026-01-29 06:05:47 [auto1.fr] INFO: Found listing with ID: YC02819
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YC02819%27 HTTP/1.1" 200 None
2026-01-29 06:05:47 [auto1.fr] INFO: Scrape type for YC02819: 0
2026-01-29 06:05:47 [auto1.fr] INFO: Found listing with ID: LZ94750
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LZ94750%27 HTTP/1.1" 200 None
2026-01-29 06:05:47 [auto1.fr] INFO: Scrape type for LZ94750: 2
2026-01-29 06:05:47 [auto1.fr] INFO: Found listing with ID: JE80286
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JE80286%27 HTTP/1.1" 200 None
2026-01-29 06:05:47 [auto1.fr] INFO: Scrape type for JE80286: 0
2026-01-29 06:05:47 [auto1.fr] INFO: Found listing with ID: UU52843
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UU52843%27 HTTP/1.1" 200 None
2026-01-29 06:05:47 [auto1.fr] INFO: Scrape type for UU52843: 0
2026-01-29 06:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RV67653> (referer: https://www.auto1.com/v1/car-details-view/RV67653/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f590577-94d6-59af-8ee8-5b735a6bbd77 with identifier: RV67653
2026-01-29 06:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f590577-94d6-59af-8ee8-5b735a6bbd77 with scrape type 2
2026-01-29 06:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f590577-94d6-59af-8ee8-5b735a6bbd77 with scrape type 2
2026-01-29 06:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0f590577-94d6-59af-8ee8-5b735a6bbd77, identifier: RV67653
2026-01-29 06:05:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0f590577-94d6-59af-8ee8-5b735a6bbd77 with identifier: RV67653
2026-01-29 06:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0f590577-94d6-59af-8ee8-5b735a6bbd77 with identifier: RV67653
2026-01-29 06:05:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0f590577-94d6-59af-8ee8-5b735a6bbd77 with identifier: RV67653 to the API
2026-01-29 06:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:05:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:05:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RV67653>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:04:22Z',
 'fuel_type': 'diesel',
 'id': '0f590577-94d6-59af-8ee8-5b735a6bbd77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV67653',
 'listing': 'auction',
 'location': 'Rodez',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 71553,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2021}
2026-01-29 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RV67653%27 HTTP/1.1" 200 None
2026-01-29 06:05:48 [auto1.fr] INFO: Saving data for RV67653: {'auction_closing_time': 1769702662.0, 'created_time': 1769015257.745444, 'last_price_update_time': 1769666748.448511}
2026-01-29 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RV67653') HTTP/1.1" 204 0
2026-01-29 06:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JC35560/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EA07744/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZP73259/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LY40679/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XH60310/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HL81867> (referer: https://www.auto1.com/v1/car-details-view/HL81867/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:05:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5e539cf-914b-5c82-a282-d2e109c600ce with identifier: HL81867
2026-01-29 06:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5e539cf-914b-5c82-a282-d2e109c600ce with scrape type 2
2026-01-29 06:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5e539cf-914b-5c82-a282-d2e109c600ce with scrape type 2
2026-01-29 06:06:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b5e539cf-914b-5c82-a282-d2e109c600ce, identifier: HL81867
2026-01-29 06:06:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b5e539cf-914b-5c82-a282-d2e109c600ce with identifier: HL81867
2026-01-29 06:06:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b5e539cf-914b-5c82-a282-d2e109c600ce with identifier: HL81867
2026-01-29 06:06:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b5e539cf-914b-5c82-a282-d2e109c600ce with identifier: HL81867 to the API
2026-01-29 06:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:06:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:06:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HL81867>
{'auction_title': '',
 'c_o_2_emission_value': 84,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:33:05Z',
 'fuel_type': 'hybrid',
 'id': 'b5e539cf-914b-5c82-a282-d2e109c600ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL81867',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 109030,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 Hybrid Collection',
 'transmission': 'automatic',
 'trim': 'Collection',
 'year': 2018}
2026-01-29 06:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL81867%27 HTTP/1.1" 200 None
2026-01-29 06:06:00 [auto1.fr] INFO: Saving data for HL81867: {'auction_closing_time': 1769704385.0, 'created_time': 1768905594.58018, 'last_price_update_time': 1769666760.347813}
2026-01-29 06:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HL81867') HTTP/1.1" 204 0
2026-01-29 06:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PF08969> (referer: https://www.auto1.com/v1/car-details-view/PF08969/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd394e07-ac2d-5a8b-92f2-ff83383c64b0 with identifier: PF08969
2026-01-29 06:06:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd394e07-ac2d-5a8b-92f2-ff83383c64b0 with scrape type 2
2026-01-29 06:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd394e07-ac2d-5a8b-92f2-ff83383c64b0 with scrape type 2
2026-01-29 06:06:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fd394e07-ac2d-5a8b-92f2-ff83383c64b0, identifier: PF08969
2026-01-29 06:06:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fd394e07-ac2d-5a8b-92f2-ff83383c64b0 with identifier: PF08969
2026-01-29 06:06:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fd394e07-ac2d-5a8b-92f2-ff83383c64b0 with identifier: PF08969
2026-01-29 06:06:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fd394e07-ac2d-5a8b-92f2-ff83383c64b0 with identifier: PF08969 to the API
2026-01-29 06:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:06:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:06:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PF08969>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-01-29T16:36:48Z',
 'fuel_type': 'petrol',
 'id': 'fd394e07-ac2d-5a8b-92f2-ff83383c64b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF08969',
 'listing': 'auction',
 'location': 'FR, Périgny',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 110497,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 0.9 Energy Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2017}
2026-01-29 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF08969%27 HTTP/1.1" 200 None
2026-01-29 06:06:01 [auto1.fr] INFO: Saving data for PF08969: {'auction_closing_time': 1769704608.0, 'created_time': 1769534239.336498, 'last_price_update_time': 1769666761.017181}
2026-01-29 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PF08969') HTTP/1.1" 204 0
2026-01-29 06:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CA48078/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RR16791> (referer: https://www.auto1.com/v1/car-details-view/RR16791/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05d4f95e-d44b-5c18-b22a-a51a356988b7 with identifier: RR16791
2026-01-29 06:06:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05d4f95e-d44b-5c18-b22a-a51a356988b7 with scrape type 2
2026-01-29 06:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05d4f95e-d44b-5c18-b22a-a51a356988b7 with scrape type 2
2026-01-29 06:06:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 05d4f95e-d44b-5c18-b22a-a51a356988b7, identifier: RR16791
2026-01-29 06:06:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 05d4f95e-d44b-5c18-b22a-a51a356988b7 with identifier: RR16791
2026-01-29 06:06:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 05d4f95e-d44b-5c18-b22a-a51a356988b7 with identifier: RR16791
2026-01-29 06:06:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 164482 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164482
2026-01-29 06:06:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 05d4f95e-d44b-5c18-b22a-a51a356988b7 spider: auto1.fr
2026-01-29 06:06:02 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 05d4f95e-d44b-5c18-b22a-a51a356988b7 due to rule: high_mileage_for_country.json, error: 164482 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164482
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:16:03Z',
 'fuel_type': 'diesel',
 'id': '05d4f95e-d44b-5c18-b22a-a51a356988b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR16791',
 'listing': 'auction',
 'location': 'FR, LE HAVRE',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 164482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-26',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2019}
2026-01-29 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RR16791%27 HTTP/1.1" 200 None
2026-01-29 06:06:02 [auto1.fr] INFO: Saving data for RR16791: {'auction_closing_time': 1769703363.0, 'created_time': 1769190278.659061, 'last_price_update_time': 1769666762.874556}
2026-01-29 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RR16791') HTTP/1.1" 204 0
2026-01-29 06:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DR10042/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MK77081/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EA07744> (referer: https://www.auto1.com/v1/car-details-view/EA07744/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 807b8166-52e7-5e0b-a4ee-02ba47bfcaba with identifier: EA07744
2026-01-29 06:06:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 807b8166-52e7-5e0b-a4ee-02ba47bfcaba with scrape type 2
2026-01-29 06:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 807b8166-52e7-5e0b-a4ee-02ba47bfcaba with scrape type 2
2026-01-29 06:06:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 807b8166-52e7-5e0b-a4ee-02ba47bfcaba, identifier: EA07744
2026-01-29 06:06:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 807b8166-52e7-5e0b-a4ee-02ba47bfcaba with identifier: EA07744
2026-01-29 06:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 807b8166-52e7-5e0b-a4ee-02ba47bfcaba with identifier: EA07744
2026-01-29 06:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 115100, 'odometer_reading_unit': 'km', 'registration_date': '2017-10-12', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ea07744', 'expiration_date': '2026-01-29t16:40:22z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, beaucaire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 110, 'id': '807b8166-52e7-5e0b-a4ee-02ba47bfcaba', 'current_year_diff': 9, 'age_in_months': 99, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 115100}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 99,
     'auction_title': '',
     'c_o_2_emission_value': 110,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:40:22z',
     'fuel_type': 'petrol',
     'id': '807b8166-52e7-5e0b-a4ee-02ba47bfcaba',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ea07744',
     'listing': 'auction',
     'location': 'fr, beaucaire',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 115100,
     'odometer_in_km': 115100,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-10-12',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'automatic',
     'trim': 'allure',
     'year': 2017}
2026-01-29 06:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 807b8166-52e7-5e0b-a4ee-02ba47bfcaba spider: auto1.fr
2026-01-29 06:06:05 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 807b8166-52e7-5e0b-a4ee-02ba47bfcaba due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 115100, 'odometer_reading_unit': 'km', 'registration_date': '2017-10-12', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ea07744', 'expiration_date': '2026-01-29t16:40:22z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, beaucaire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 110, 'id': '807b8166-52e7-5e0b-a4ee-02ba47bfcaba', 'current_year_diff': 9, 'age_in_months': 99, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 115100}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 99,
     'auction_title': '',
     'c_o_2_emission_value': 110,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:40:22z',
     'fuel_type': 'petrol',
     'id': '807b8166-52e7-5e0b-a4ee-02ba47bfcaba',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ea07744',
     'listing': 'auction',
     'location': 'fr, beaucaire',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 115100,
     'odometer_in_km': 115100,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-10-12',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'automatic',
     'trim': 'allure',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:40:22Z',
 'fuel_type': 'petrol',
 'id': '807b8166-52e7-5e0b-a4ee-02ba47bfcaba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA07744',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 115100,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2017}
2026-01-29 06:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EA07744%27 HTTP/1.1" 200 None
2026-01-29 06:06:05 [auto1.fr] INFO: Saving data for EA07744: {'auction_closing_time': 1769704822.0, 'created_time': 1769446970.814267, 'last_price_update_time': 1769666765.961336}
2026-01-29 06:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EA07744') HTTP/1.1" 204 0
2026-01-29 06:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LZ94750/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZP73259> (referer: https://www.auto1.com/v1/car-details-view/ZP73259/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b307cb5e-0b0f-5651-af7c-5acacb6b204d with identifier: ZP73259
2026-01-29 06:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b307cb5e-0b0f-5651-af7c-5acacb6b204d with scrape type 2
2026-01-29 06:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b307cb5e-0b0f-5651-af7c-5acacb6b204d with scrape type 2
2026-01-29 06:06:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b307cb5e-0b0f-5651-af7c-5acacb6b204d, identifier: ZP73259
2026-01-29 06:06:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b307cb5e-0b0f-5651-af7c-5acacb6b204d with identifier: ZP73259
2026-01-29 06:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b307cb5e-0b0f-5651-af7c-5acacb6b204d with identifier: ZP73259
2026-01-29 06:06:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b307cb5e-0b0f-5651-af7c-5acacb6b204d with identifier: ZP73259 to the API
2026-01-29 06:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:06:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZP73259>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 117,
 'expiration_date': '2026-01-29T16:20:13Z',
 'fuel_type': 'petrol',
 'id': 'b307cb5e-0b0f-5651-af7c-5acacb6b204d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP73259',
 'listing': 'auction',
 'location': 'FR, Toulouse',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 68956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Juke 1.0 DIG-T N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2020}
2026-01-29 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP73259%27 HTTP/1.1" 200 None
2026-01-29 06:06:08 [auto1.fr] INFO: Saving data for ZP73259: {'auction_closing_time': 1769703613.0, 'created_time': 1769016870.107661, 'last_price_update_time': 1769666768.692033}
2026-01-29 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZP73259') HTTP/1.1" 204 0
2026-01-29 06:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LY40679> (referer: https://www.auto1.com/v1/car-details-view/LY40679/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XH60310> (referer: https://www.auto1.com/v1/car-details-view/XH60310/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71dadfb1-c1bd-5881-9abf-df15be6cff6f with identifier: LY40679
2026-01-29 06:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71dadfb1-c1bd-5881-9abf-df15be6cff6f with scrape type 2
2026-01-29 06:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71dadfb1-c1bd-5881-9abf-df15be6cff6f with scrape type 2
2026-01-29 06:06:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 71dadfb1-c1bd-5881-9abf-df15be6cff6f, identifier: LY40679
2026-01-29 06:06:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 71dadfb1-c1bd-5881-9abf-df15be6cff6f with identifier: LY40679
2026-01-29 06:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 71dadfb1-c1bd-5881-9abf-df15be6cff6f with identifier: LY40679
2026-01-29 06:06:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 71dadfb1-c1bd-5881-9abf-df15be6cff6f with identifier: LY40679 to the API
2026-01-29 06:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:06:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:06:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LY40679>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:20:22Z',
 'fuel_type': 'diesel',
 'id': '71dadfb1-c1bd-5881-9abf-df15be6cff6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY40679',
 'listing': 'auction',
 'location': 'FR, Ambarès-et-Lagrave',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 104383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-08-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Citroen C3 1.5 Blue-HDi Société Feel Business R',
 'transmission': 'manual',
 'trim': 'Société Feel Business R',
 'year': 2021}
2026-01-29 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LY40679%27 HTTP/1.1" 200 None
2026-01-29 06:06:10 [auto1.fr] INFO: Saving data for LY40679: {'auction_closing_time': 1769703622.0, 'created_time': 1769580148.579708, 'last_price_update_time': 1769666770.147016}
2026-01-29 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LY40679') HTTP/1.1" 204 0
2026-01-29 06:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JC35560> (referer: https://www.auto1.com/v1/car-details-view/JC35560/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YL65277> (referer: https://www.auto1.com/v1/car-details-view/YL65277/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5e85b73-f314-5ef7-997f-f6b0821f2599 with identifier: XH60310
2026-01-29 06:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5e85b73-f314-5ef7-997f-f6b0821f2599 with scrape type 2
2026-01-29 06:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5e85b73-f314-5ef7-997f-f6b0821f2599 with scrape type 2
2026-01-29 06:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c5e85b73-f314-5ef7-997f-f6b0821f2599, identifier: XH60310
2026-01-29 06:06:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c5e85b73-f314-5ef7-997f-f6b0821f2599 with identifier: XH60310
2026-01-29 06:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c5e85b73-f314-5ef7-997f-f6b0821f2599 with identifier: XH60310
2026-01-29 06:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 153477 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    153477
2026-01-29 06:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c5e85b73-f314-5ef7-997f-f6b0821f2599 spider: auto1.fr
2026-01-29 06:06:10 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: c5e85b73-f314-5ef7-997f-f6b0821f2599 due to rule: high_mileage_for_country.json, error: 153477 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    153477
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:30:55Z',
 'fuel_type': 'petrol',
 'id': 'c5e85b73-f314-5ef7-997f-f6b0821f2599',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH60310',
 'listing': 'auction',
 'location': 'FR, TARNOS',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 153477,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 35 TFSI S Line',
 'transmission': 'automatic',
 'trim': 'S Line',
 'year': 2019}
2026-01-29 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XH60310%27 HTTP/1.1" 200 None
2026-01-29 06:06:10 [auto1.fr] INFO: Saving data for XH60310: {'auction_closing_time': 1769704255.0, 'created_time': 1769061933.58161, 'last_price_update_time': 1769666770.447635}
2026-01-29 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XH60310') HTTP/1.1" 204 0
2026-01-29 06:06:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26248f51-dfae-53f8-bd7c-115facd6688d with identifier: JC35560
2026-01-29 06:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26248f51-dfae-53f8-bd7c-115facd6688d with scrape type 2
2026-01-29 06:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26248f51-dfae-53f8-bd7c-115facd6688d with scrape type 2
2026-01-29 06:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 26248f51-dfae-53f8-bd7c-115facd6688d, identifier: JC35560
2026-01-29 06:06:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1dee6d81-4174-57d8-9091-941f8f345d52 with identifier: YL65277
2026-01-29 06:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dee6d81-4174-57d8-9091-941f8f345d52 with scrape type 2
2026-01-29 06:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1dee6d81-4174-57d8-9091-941f8f345d52 with scrape type 2
2026-01-29 06:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1dee6d81-4174-57d8-9091-941f8f345d52, identifier: YL65277
2026-01-29 06:06:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 26248f51-dfae-53f8-bd7c-115facd6688d with identifier: JC35560
2026-01-29 06:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 26248f51-dfae-53f8-bd7c-115facd6688d with identifier: JC35560
2026-01-29 06:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'vivaro' containing 'vivaro'
2026-01-29 06:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 26248f51-dfae-53f8-bd7c-115facd6688d spider: auto1.fr
2026-01-29 06:06:10 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 26248f51-dfae-53f8-bd7c-115facd6688d due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'vivaro' containing 'vivaro'
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:47:16Z',
 'fuel_type': 'diesel',
 'id': '26248f51-dfae-53f8-bd7c-115facd6688d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC35560',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 44612,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-26',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Opel Vivaro 1.5 CDTI M Edition L2',
 'transmission': 'manual',
 'trim': 'M Edition L2',
 'year': 2022}
2026-01-29 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JC35560%27 HTTP/1.1" 200 None
2026-01-29 06:06:10 [auto1.fr] INFO: Saving data for JC35560: {'auction_closing_time': 1769705236.0, 'created_time': 1769448883.865411, 'last_price_update_time': 1769666770.861195}
2026-01-29 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JC35560') HTTP/1.1" 204 0
2026-01-29 06:06:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1dee6d81-4174-57d8-9091-941f8f345d52 with identifier: YL65277
2026-01-29 06:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1dee6d81-4174-57d8-9091-941f8f345d52 with identifier: YL65277
2026-01-29 06:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 166147 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    166147
2026-01-29 06:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 1dee6d81-4174-57d8-9091-941f8f345d52 spider: auto1.fr
2026-01-29 06:06:11 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 1dee6d81-4174-57d8-9091-941f8f345d52 due to rule: high_mileage_for_country.json, error: 166147 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    166147
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 170,
 'expiration_date': '2026-01-29T16:15:16Z',
 'fuel_type': 'diesel',
 'id': '1dee6d81-4174-57d8-9091-941f8f345d52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL65277',
 'listing': 'auction',
 'location': 'FR, TARNOS',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 166147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic Business',
 'transmission': 'automatic',
 'trim': '4Matic Business',
 'year': 2017}
2026-01-29 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YL65277%27 HTTP/1.1" 200 None
2026-01-29 06:06:11 [auto1.fr] INFO: Saving data for YL65277: {'auction_closing_time': 1769703316.0, 'created_time': 1769101797.29439, 'last_price_update_time': 1769666771.138943}
2026-01-29 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YL65277') HTTP/1.1" 204 0
2026-01-29 06:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CA48078> (referer: https://www.auto1.com/v1/car-details-view/CA48078/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d573bac8-6206-5bcd-ab62-c0a82076da0e with identifier: CA48078
2026-01-29 06:06:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d573bac8-6206-5bcd-ab62-c0a82076da0e with scrape type 2
2026-01-29 06:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d573bac8-6206-5bcd-ab62-c0a82076da0e with scrape type 2
2026-01-29 06:06:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d573bac8-6206-5bcd-ab62-c0a82076da0e, identifier: CA48078
2026-01-29 06:06:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d573bac8-6206-5bcd-ab62-c0a82076da0e with identifier: CA48078
2026-01-29 06:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d573bac8-6206-5bcd-ab62-c0a82076da0e with identifier: CA48078
2026-01-29 06:06:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d573bac8-6206-5bcd-ab62-c0a82076da0e with identifier: CA48078 to the API
2026-01-29 06:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:06:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:06:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CA48078>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 154,
 'expiration_date': '2026-01-29T16:47:48Z',
 'fuel_type': 'petrol',
 'id': 'd573bac8-6206-5bcd-ab62-c0a82076da0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA48078',
 'listing': 'auction',
 'location': 'FR, Seynod',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 66841,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.3 TCe Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2019}
2026-01-29 06:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA48078%27 HTTP/1.1" 200 None
2026-01-29 06:06:12 [auto1.fr] INFO: Saving data for CA48078: {'auction_closing_time': 1769705268.0, 'created_time': 1769533292.969487, 'last_price_update_time': 1769666772.201239}
2026-01-29 06:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CA48078') HTTP/1.1" 204 0
2026-01-29 06:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MS42822/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:12 [scrapy.extensions.logstats] INFO: Crawled 545 pages (at 112 pages/min), scraped 116 items (at 28 items/min)
2026-01-29 06:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RT30199/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UB45320/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MK77081> (referer: https://www.auto1.com/v1/car-details-view/MK77081/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 370541d4-3180-52cf-a3b6-7a7af5e68b71 with identifier: MK77081
2026-01-29 06:06:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 370541d4-3180-52cf-a3b6-7a7af5e68b71 with scrape type 2
2026-01-29 06:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 370541d4-3180-52cf-a3b6-7a7af5e68b71 with scrape type 2
2026-01-29 06:06:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 370541d4-3180-52cf-a3b6-7a7af5e68b71, identifier: MK77081
2026-01-29 06:06:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 370541d4-3180-52cf-a3b6-7a7af5e68b71 with identifier: MK77081
2026-01-29 06:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 370541d4-3180-52cf-a3b6-7a7af5e68b71 with identifier: MK77081
2026-01-29 06:06:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 370541d4-3180-52cf-a3b6-7a7af5e68b71 with identifier: MK77081 to the API
2026-01-29 06:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:06:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:06:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MK77081>
{'auction_title': '',
 'c_o_2_emission_value': 28,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 224,
 'expiration_date': '2026-01-29T16:05:35Z',
 'fuel_type': 'hybrid',
 'id': '370541d4-3180-52cf-a3b6-7a7af5e68b71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK77081',
 'listing': 'auction',
 'location': 'FR, Marly-la-ville',
 'make': 'Citroen',
 'model': 'C5 X',
 'odometer': 15358,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 X 1.6 Plug-in Hybrid Shine Pack',
 'transmission': 'automatic',
 'trim': 'Shine Pack',
 'year': 2023}
2026-01-29 06:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MK77081%27 HTTP/1.1" 200 None
2026-01-29 06:06:13 [auto1.fr] INFO: Saving data for MK77081: {'auction_closing_time': 1769702735.0, 'created_time': 1769190408.505991, 'last_price_update_time': 1769666773.7384}
2026-01-29 06:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MK77081') HTTP/1.1" 204 0
2026-01-29 06:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MF09861/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WG41054/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RY70552/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DR10042> (referer: https://www.auto1.com/v1/car-details-view/DR10042/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TC17155/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 956fdfbe-75d5-5c7f-816a-d076f8b4bc5c with identifier: DR10042
2026-01-29 06:06:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 956fdfbe-75d5-5c7f-816a-d076f8b4bc5c with scrape type 2
2026-01-29 06:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 956fdfbe-75d5-5c7f-816a-d076f8b4bc5c with scrape type 2
2026-01-29 06:06:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 956fdfbe-75d5-5c7f-816a-d076f8b4bc5c, identifier: DR10042
2026-01-29 06:06:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 956fdfbe-75d5-5c7f-816a-d076f8b4bc5c with identifier: DR10042
2026-01-29 06:06:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 956fdfbe-75d5-5c7f-816a-d076f8b4bc5c with identifier: DR10042
2026-01-29 06:06:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 956fdfbe-75d5-5c7f-816a-d076f8b4bc5c with identifier: DR10042 to the API
2026-01-29 06:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:06:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:06:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DR10042>
{'auction_title': '',
 'c_o_2_emission_value': 30,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 224,
 'expiration_date': '2026-01-29T16:08:48Z',
 'fuel_type': 'hybrid',
 'id': '956fdfbe-75d5-5c7f-816a-d076f8b4bc5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR10042',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Citroen',
 'model': 'C5 X',
 'odometer': 17609,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 X 1.6 Plug-in Hybrid Shine Pack',
 'transmission': 'automatic',
 'trim': 'Shine Pack',
 'year': 2023}
2026-01-29 06:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DR10042%27 HTTP/1.1" 200 None
2026-01-29 06:06:16 [auto1.fr] INFO: Saving data for DR10042: {'auction_closing_time': 1769702928.0, 'created_time': 1769533721.231745, 'last_price_update_time': 1769666776.614481}
2026-01-29 06:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DR10042') HTTP/1.1" 204 0
2026-01-29 06:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LZ94750> (referer: https://www.auto1.com/v1/car-details-view/LZ94750/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AW25132/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7632c19b-425e-58c1-a5c6-02fff0373338 with identifier: LZ94750
2026-01-29 06:06:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7632c19b-425e-58c1-a5c6-02fff0373338 with scrape type 2
2026-01-29 06:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7632c19b-425e-58c1-a5c6-02fff0373338 with scrape type 2
2026-01-29 06:06:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7632c19b-425e-58c1-a5c6-02fff0373338, identifier: LZ94750
2026-01-29 06:06:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7632c19b-425e-58c1-a5c6-02fff0373338 with identifier: LZ94750
2026-01-29 06:06:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7632c19b-425e-58c1-a5c6-02fff0373338 with identifier: LZ94750
2026-01-29 06:06:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7632c19b-425e-58c1-a5c6-02fff0373338 with identifier: LZ94750 to the API
2026-01-29 06:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:06:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:06:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LZ94750>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:52:38Z',
 'fuel_type': 'diesel',
 'id': '7632c19b-425e-58c1-a5c6-02fff0373338',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ94750',
 'listing': 'auction',
 'location': 'FR, Montataire',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 74811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-09',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2022}
2026-01-29 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LZ94750%27 HTTP/1.1" 200 None
2026-01-29 06:06:17 [auto1.fr] INFO: Saving data for LZ94750: {'auction_closing_time': 1769705558.0, 'created_time': 1769015254.754486, 'last_price_update_time': 1769666777.134024}
2026-01-29 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LZ94750') HTTP/1.1" 204 0
2026-01-29 06:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UZ98634/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YC78844/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZH82252/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MS42822> (referer: https://www.auto1.com/v1/car-details-view/MS42822/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RT30199> (referer: https://www.auto1.com/v1/car-details-view/RT30199/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eefd00b8-e07f-5a84-a2a4-710ad5ff01d7 with identifier: MS42822
2026-01-29 06:06:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eefd00b8-e07f-5a84-a2a4-710ad5ff01d7 with scrape type 2
2026-01-29 06:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eefd00b8-e07f-5a84-a2a4-710ad5ff01d7 with scrape type 2
2026-01-29 06:06:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: eefd00b8-e07f-5a84-a2a4-710ad5ff01d7, identifier: MS42822
2026-01-29 06:06:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: eefd00b8-e07f-5a84-a2a4-710ad5ff01d7 with identifier: MS42822
2026-01-29 06:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: eefd00b8-e07f-5a84-a2a4-710ad5ff01d7 with identifier: MS42822
2026-01-29 06:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech c-series', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'manual', 'odometer': 47236, 'odometer_reading_unit': 'km', 'registration_date': '2022-10-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ms42822', 'expiration_date': '2026-01-29t16:53:57z', 'origin_country_code': 'fr', 'trim': 'c-series', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, tarnos', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 134, 'id': 'eefd00b8-e07f-5a84-a2a4-710ad5ff01d7', 'current_year_diff': 4, 'age_in_months': 38, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 47236}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 38,
     'auction_title': '',
     'c_o_2_emission_value': 134,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:53:57z',
     'fuel_type': 'petrol',
     'id': 'eefd00b8-e07f-5a84-a2a4-710ad5ff01d7',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ms42822',
     'listing': 'auction',
     'location': 'fr, tarnos',
     'make': 'citroen',
     'make_model': 'citroen c3 aircross',
     'model': 'c3 aircross',
     'odometer': 47236,
     'odometer_in_km': 47236,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-10-30',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 aircross 1.2 puretech c-series',
     'transmission': 'manual',
     'trim': 'c-series',
     'year': 2022}
2026-01-29 06:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: eefd00b8-e07f-5a84-a2a4-710ad5ff01d7 spider: auto1.fr
2026-01-29 06:06:18 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: eefd00b8-e07f-5a84-a2a4-710ad5ff01d7 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech c-series', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'manual', 'odometer': 47236, 'odometer_reading_unit': 'km', 'registration_date': '2022-10-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ms42822', 'expiration_date': '2026-01-29t16:53:57z', 'origin_country_code': 'fr', 'trim': 'c-series', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, tarnos', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 134, 'id': 'eefd00b8-e07f-5a84-a2a4-710ad5ff01d7', 'current_year_diff': 4, 'age_in_months': 38, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 47236}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 38,
     'auction_title': '',
     'c_o_2_emission_value': 134,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:53:57z',
     'fuel_type': 'petrol',
     'id': 'eefd00b8-e07f-5a84-a2a4-710ad5ff01d7',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ms42822',
     'listing': 'auction',
     'location': 'fr, tarnos',
     'make': 'citroen',
     'make_model': 'citroen c3 aircross',
     'model': 'c3 aircross',
     'odometer': 47236,
     'odometer_in_km': 47236,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-10-30',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 aircross 1.2 puretech c-series',
     'transmission': 'manual',
     'trim': 'c-series',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:53:57Z',
 'fuel_type': 'petrol',
 'id': 'eefd00b8-e07f-5a84-a2a4-710ad5ff01d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS42822',
 'listing': 'auction',
 'location': 'FR, TARNOS',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 47236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech C-Series',
 'transmission': 'manual',
 'trim': 'C-Series',
 'year': 2022}
2026-01-29 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MS42822%27 HTTP/1.1" 200 None
2026-01-29 06:06:18 [auto1.fr] INFO: Saving data for MS42822: {'auction_closing_time': 1769705637.0, 'created_time': 1769580062.275877, 'last_price_update_time': 1769666778.438967}
2026-01-29 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MS42822') HTTP/1.1" 204 0
2026-01-29 06:06:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7c7ed7e-f21b-5d91-b732-4029241f4608 with identifier: RT30199
2026-01-29 06:06:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7c7ed7e-f21b-5d91-b732-4029241f4608 with scrape type 2
2026-01-29 06:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7c7ed7e-f21b-5d91-b732-4029241f4608 with scrape type 2
2026-01-29 06:06:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f7c7ed7e-f21b-5d91-b732-4029241f4608, identifier: RT30199
2026-01-29 06:06:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f7c7ed7e-f21b-5d91-b732-4029241f4608 with identifier: RT30199
2026-01-29 06:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f7c7ed7e-f21b-5d91-b732-4029241f4608 with identifier: RT30199
2026-01-29 06:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 193920 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    193920
2026-01-29 06:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f7c7ed7e-f21b-5d91-b732-4029241f4608 spider: auto1.fr
2026-01-29 06:06:18 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: f7c7ed7e-f21b-5d91-b732-4029241f4608 due to rule: high_mileage_for_country.json, error: 193920 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    193920
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:28:32Z',
 'fuel_type': 'diesel',
 'id': 'f7c7ed7e-f21b-5d91-b732-4029241f4608',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT30199',
 'listing': 'auction',
 'location': 'FR, LA CHAPELLE LONGUEVILLE',
 'make': 'BMW',
 'model': '4er',
 'odometer': 193920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 4er 420d Gran Coupé xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2019}
2026-01-29 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RT30199%27 HTTP/1.1" 200 None
2026-01-29 06:06:18 [auto1.fr] INFO: Saving data for RT30199: {'auction_closing_time': 1769704112.0, 'created_time': 1769534100.850179, 'last_price_update_time': 1769666778.76087}
2026-01-29 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RT30199') HTTP/1.1" 204 0
2026-01-29 06:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MF09861> (referer: https://www.auto1.com/v1/car-details-view/MF09861/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e0cc7e6-38c3-5d69-8cdd-35eb17b22f02 with identifier: MF09861
2026-01-29 06:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e0cc7e6-38c3-5d69-8cdd-35eb17b22f02 with scrape type 2
2026-01-29 06:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e0cc7e6-38c3-5d69-8cdd-35eb17b22f02 with scrape type 2
2026-01-29 06:06:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0e0cc7e6-38c3-5d69-8cdd-35eb17b22f02, identifier: MF09861
2026-01-29 06:06:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0e0cc7e6-38c3-5d69-8cdd-35eb17b22f02 with identifier: MF09861
2026-01-29 06:06:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0e0cc7e6-38c3-5d69-8cdd-35eb17b22f02 with identifier: MF09861
2026-01-29 06:06:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 119847, 'odometer_reading_unit': 'km', 'registration_date': '2020-01-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mf09861', 'expiration_date': '2026-01-29t16:19:16z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, herblay', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 102, 'id': '0e0cc7e6-38c3-5d69-8cdd-35eb17b22f02', 'current_year_diff': 6, 'age_in_months': 72, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 119847}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 72,
     'auction_title': '',
     'c_o_2_emission_value': 102,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:19:16z',
     'fuel_type': 'petrol',
     'id': '0e0cc7e6-38c3-5d69-8cdd-35eb17b22f02',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mf09861',
     'listing': 'auction',
     'location': 'fr, herblay',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 119847,
     'odometer_in_km': 119847,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-01-28',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech gt line',
     'transmission': 'manual',
     'trim': 'gt line',
     'year': 2020}
2026-01-29 06:06:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 0e0cc7e6-38c3-5d69-8cdd-35eb17b22f02 spider: auto1.fr
2026-01-29 06:06:19 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 0e0cc7e6-38c3-5d69-8cdd-35eb17b22f02 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 119847, 'odometer_reading_unit': 'km', 'registration_date': '2020-01-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mf09861', 'expiration_date': '2026-01-29t16:19:16z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, herblay', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 102, 'id': '0e0cc7e6-38c3-5d69-8cdd-35eb17b22f02', 'current_year_diff': 6, 'age_in_months': 72, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 119847}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 72,
     'auction_title': '',
     'c_o_2_emission_value': 102,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:19:16z',
     'fuel_type': 'petrol',
     'id': '0e0cc7e6-38c3-5d69-8cdd-35eb17b22f02',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mf09861',
     'listing': 'auction',
     'location': 'fr, herblay',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 119847,
     'odometer_in_km': 119847,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-01-28',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech gt line',
     'transmission': 'manual',
     'trim': 'gt line',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:19:16Z',
 'fuel_type': 'petrol',
 'id': '0e0cc7e6-38c3-5d69-8cdd-35eb17b22f02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF09861',
 'listing': 'auction',
 'location': 'FR, Herblay',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 119847,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2020}
2026-01-29 06:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MF09861%27 HTTP/1.1" 200 None
2026-01-29 06:06:19 [auto1.fr] INFO: Saving data for MF09861: {'auction_closing_time': 1769703556.0, 'created_time': 1769533516.422904, 'last_price_update_time': 1769666779.519178}
2026-01-29 06:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MF09861') HTTP/1.1" 204 0
2026-01-29 06:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WG41054> (referer: https://www.auto1.com/v1/car-details-view/WG41054/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a534311-0e07-554c-b892-6315396fbed3 with identifier: WG41054
2026-01-29 06:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a534311-0e07-554c-b892-6315396fbed3 with scrape type 2
2026-01-29 06:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a534311-0e07-554c-b892-6315396fbed3 with scrape type 2
2026-01-29 06:06:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6a534311-0e07-554c-b892-6315396fbed3, identifier: WG41054
2026-01-29 06:06:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6a534311-0e07-554c-b892-6315396fbed3 with identifier: WG41054
2026-01-29 06:06:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6a534311-0e07-554c-b892-6315396fbed3 with identifier: WG41054
2026-01-29 06:06:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6a534311-0e07-554c-b892-6315396fbed3 with identifier: WG41054 to the API
2026-01-29 06:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:06:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:06:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WG41054>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:21:14Z',
 'fuel_type': 'petrol',
 'id': '6a534311-0e07-554c-b892-6315396fbed3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG41054',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Opel',
 'model': 'Karl',
 'odometer': 112363,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-27',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Opel Karl 1.0 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2017}
2026-01-29 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WG41054%27 HTTP/1.1" 200 None
2026-01-29 06:06:20 [auto1.fr] INFO: Saving data for WG41054: {'auction_closing_time': 1769703674.0, 'created_time': 1768496673.107476, 'last_price_update_time': 1769666780.065707}
2026-01-29 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WG41054') HTTP/1.1" 204 0
2026-01-29 06:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KX09817/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SV32269/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TC17155> (referer: https://www.auto1.com/v1/car-details-view/TC17155/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6722f22e-5000-582a-b53a-199e45263f52 with identifier: TC17155
2026-01-29 06:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6722f22e-5000-582a-b53a-199e45263f52 with scrape type 2
2026-01-29 06:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6722f22e-5000-582a-b53a-199e45263f52 with scrape type 2
2026-01-29 06:06:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6722f22e-5000-582a-b53a-199e45263f52, identifier: TC17155
2026-01-29 06:06:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6722f22e-5000-582a-b53a-199e45263f52 with identifier: TC17155
2026-01-29 06:06:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6722f22e-5000-582a-b53a-199e45263f52 with identifier: TC17155
2026-01-29 06:06:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6722f22e-5000-582a-b53a-199e45263f52 with identifier: TC17155 to the API
2026-01-29 06:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:06:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:06:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TC17155>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 220,
 'expiration_date': '2026-01-29T16:12:36Z',
 'fuel_type': 'diesel',
 'id': '6722f22e-5000-582a-b53a-199e45263f52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC17155',
 'listing': 'auction',
 'location': 'FR, Quincieux',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 47144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d Mild-Hybrid 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2022}
2026-01-29 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TC17155%27 HTTP/1.1" 200 None
2026-01-29 06:06:22 [auto1.fr] INFO: Saving data for TC17155: {'auction_closing_time': 1769703156.0, 'created_time': 1768889571.604558, 'last_price_update_time': 1769666782.281824}
2026-01-29 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TC17155') HTTP/1.1" 204 0
2026-01-29 06:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UZ98634> (referer: https://www.auto1.com/v1/car-details-view/UZ98634/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12e89816-aad3-5a52-ad1d-f0b18597b012 with identifier: UZ98634
2026-01-29 06:06:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12e89816-aad3-5a52-ad1d-f0b18597b012 with scrape type 2
2026-01-29 06:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12e89816-aad3-5a52-ad1d-f0b18597b012 with scrape type 2
2026-01-29 06:06:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 12e89816-aad3-5a52-ad1d-f0b18597b012, identifier: UZ98634
2026-01-29 06:06:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 12e89816-aad3-5a52-ad1d-f0b18597b012 with identifier: UZ98634
2026-01-29 06:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 12e89816-aad3-5a52-ad1d-f0b18597b012 with identifier: UZ98634
2026-01-29 06:06:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 95066, 'odometer_reading_unit': 'km', 'registration_date': '2019-04-15', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uz98634', 'expiration_date': '2026-01-29t16:03:57z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ingrandes sur vienne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 112, 'id': '12e89816-aad3-5a52-ad1d-f0b18597b012', 'current_year_diff': 7, 'age_in_months': 81, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 95066}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 81,
     'auction_title': '',
     'c_o_2_emission_value': 112,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:03:57z',
     'fuel_type': 'petrol',
     'id': '12e89816-aad3-5a52-ad1d-f0b18597b012',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uz98634',
     'listing': 'auction',
     'location': 'fr, ingrandes sur vienne',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 95066,
     'odometer_in_km': 95066,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-04-15',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2019}
2026-01-29 06:06:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 12e89816-aad3-5a52-ad1d-f0b18597b012 spider: auto1.fr
2026-01-29 06:06:24 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 12e89816-aad3-5a52-ad1d-f0b18597b012 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 95066, 'odometer_reading_unit': 'km', 'registration_date': '2019-04-15', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uz98634', 'expiration_date': '2026-01-29t16:03:57z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ingrandes sur vienne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 112, 'id': '12e89816-aad3-5a52-ad1d-f0b18597b012', 'current_year_diff': 7, 'age_in_months': 81, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 95066}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 81,
     'auction_title': '',
     'c_o_2_emission_value': 112,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:03:57z',
     'fuel_type': 'petrol',
     'id': '12e89816-aad3-5a52-ad1d-f0b18597b012',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uz98634',
     'listing': 'auction',
     'location': 'fr, ingrandes sur vienne',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 95066,
     'odometer_in_km': 95066,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-04-15',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:03:57Z',
 'fuel_type': 'petrol',
 'id': '12e89816-aad3-5a52-ad1d-f0b18597b012',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ98634',
 'listing': 'auction',
 'location': 'FR, Ingrandes sur Vienne',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 95066,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2019}
2026-01-29 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UZ98634%27 HTTP/1.1" 200 None
2026-01-29 06:06:24 [auto1.fr] INFO: Saving data for UZ98634: {'auction_closing_time': 1769702637.0, 'created_time': 1767765984.654202, 'last_price_update_time': 1769666784.14275}
2026-01-29 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UZ98634') HTTP/1.1" 204 0
2026-01-29 06:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CE56263/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KK69084/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YC78844> (referer: https://www.auto1.com/v1/car-details-view/YC78844/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b53e2a1-dd15-5fc6-bf63-d987369b632a with identifier: YC78844
2026-01-29 06:06:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b53e2a1-dd15-5fc6-bf63-d987369b632a with scrape type 2
2026-01-29 06:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b53e2a1-dd15-5fc6-bf63-d987369b632a with scrape type 2
2026-01-29 06:06:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2b53e2a1-dd15-5fc6-bf63-d987369b632a, identifier: YC78844
2026-01-29 06:06:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2b53e2a1-dd15-5fc6-bf63-d987369b632a with identifier: YC78844
2026-01-29 06:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2b53e2a1-dd15-5fc6-bf63-d987369b632a with identifier: YC78844
2026-01-29 06:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'automatic', 'odometer': 11489, 'odometer_reading_unit': 'km', 'registration_date': '2021-08-04', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yc78844', 'expiration_date': '2026-01-29t16:10:59z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, pau', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 122, 'id': '2b53e2a1-dd15-5fc6-bf63-d987369b632a', 'current_year_diff': 5, 'age_in_months': 53, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 11489}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 53,
     'auction_title': '',
     'c_o_2_emission_value': 122,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:10:59z',
     'fuel_type': 'petrol',
     'id': '2b53e2a1-dd15-5fc6-bf63-d987369b632a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yc78844',
     'listing': 'auction',
     'location': 'fr, pau',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 11489,
     'odometer_in_km': 11489,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-08-04',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech gt',
     'transmission': 'automatic',
     'trim': 'gt',
     'year': 2021}
2026-01-29 06:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 2b53e2a1-dd15-5fc6-bf63-d987369b632a spider: auto1.fr
2026-01-29 06:06:25 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 2b53e2a1-dd15-5fc6-bf63-d987369b632a due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'automatic', 'odometer': 11489, 'odometer_reading_unit': 'km', 'registration_date': '2021-08-04', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yc78844', 'expiration_date': '2026-01-29t16:10:59z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, pau', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 122, 'id': '2b53e2a1-dd15-5fc6-bf63-d987369b632a', 'current_year_diff': 5, 'age_in_months': 53, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 11489}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 53,
     'auction_title': '',
     'c_o_2_emission_value': 122,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:10:59z',
     'fuel_type': 'petrol',
     'id': '2b53e2a1-dd15-5fc6-bf63-d987369b632a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yc78844',
     'listing': 'auction',
     'location': 'fr, pau',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 11489,
     'odometer_in_km': 11489,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-08-04',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech gt',
     'transmission': 'automatic',
     'trim': 'gt',
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:10:59Z',
 'fuel_type': 'petrol',
 'id': '2b53e2a1-dd15-5fc6-bf63-d987369b632a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC78844',
 'listing': 'auction',
 'location': 'FR, Pau',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 11489,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-08-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2021}
2026-01-29 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YC78844%27 HTTP/1.1" 200 None
2026-01-29 06:06:25 [auto1.fr] INFO: Saving data for YC78844: {'auction_closing_time': 1769703059.0, 'created_time': 1769534545.30601, 'last_price_update_time': 1769666785.403623}
2026-01-29 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YC78844') HTTP/1.1" 204 0
2026-01-29 06:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AW25132> (referer: https://www.auto1.com/v1/car-details-view/AW25132/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7adff2a0-e1a2-5567-9509-a6e801328ef0 with identifier: AW25132
2026-01-29 06:06:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7adff2a0-e1a2-5567-9509-a6e801328ef0 with scrape type 2
2026-01-29 06:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7adff2a0-e1a2-5567-9509-a6e801328ef0 with scrape type 2
2026-01-29 06:06:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7adff2a0-e1a2-5567-9509-a6e801328ef0, identifier: AW25132
2026-01-29 06:06:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7adff2a0-e1a2-5567-9509-a6e801328ef0 with identifier: AW25132
2026-01-29 06:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7adff2a0-e1a2-5567-9509-a6e801328ef0 with identifier: AW25132
2026-01-29 06:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
2026-01-29 06:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 7adff2a0-e1a2-5567-9509-a6e801328ef0 spider: auto1.fr
2026-01-29 06:06:25 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 7adff2a0-e1a2-5567-9509-a6e801328ef0 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:00:46Z',
 'fuel_type': 'diesel',
 'id': '7adff2a0-e1a2-5567-9509-a6e801328ef0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW25132',
 'listing': 'auction',
 'location': 'FR, TARNOS',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 124525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2019}
2026-01-29 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW25132%27 HTTP/1.1" 200 None
2026-01-29 06:06:25 [auto1.fr] INFO: Saving data for AW25132: {'auction_closing_time': 1769702446.0, 'created_time': 1769534275.548058, 'last_price_update_time': 1769666785.824701}
2026-01-29 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AW25132') HTTP/1.1" 204 0
2026-01-29 06:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UB45320> (referer: https://www.auto1.com/v1/car-details-view/UB45320/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ff3a3d3-bec3-5759-b7ae-d3e83ac0007f with identifier: UB45320
2026-01-29 06:06:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ff3a3d3-bec3-5759-b7ae-d3e83ac0007f with scrape type 2
2026-01-29 06:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ff3a3d3-bec3-5759-b7ae-d3e83ac0007f with scrape type 2
2026-01-29 06:06:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8ff3a3d3-bec3-5759-b7ae-d3e83ac0007f, identifier: UB45320
2026-01-29 06:06:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8ff3a3d3-bec3-5759-b7ae-d3e83ac0007f with identifier: UB45320
2026-01-29 06:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8ff3a3d3-bec3-5759-b7ae-d3e83ac0007f with identifier: UB45320
2026-01-29 06:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech active pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 27038, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ub45320', 'expiration_date': '2026-01-29t16:01:38z', 'origin_country_code': 'fr', 'trim': 'active pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 119, 'id': '8ff3a3d3-bec3-5759-b7ae-d3e83ac0007f', 'current_year_diff': 4, 'age_in_months': 43, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 27038}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 43,
     'auction_title': '',
     'c_o_2_emission_value': 119,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 75,
     'expiration_date': '2026-01-29t16:01:38z',
     'fuel_type': 'petrol',
     'id': '8ff3a3d3-bec3-5759-b7ae-d3e83ac0007f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ub45320',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 27038,
     'odometer_in_km': 27038,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-06-27',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech active pack',
     'transmission': 'manual',
     'trim': 'active pack',
     'year': 2022}
2026-01-29 06:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 8ff3a3d3-bec3-5759-b7ae-d3e83ac0007f spider: auto1.fr
2026-01-29 06:06:26 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 8ff3a3d3-bec3-5759-b7ae-d3e83ac0007f due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech active pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 27038, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ub45320', 'expiration_date': '2026-01-29t16:01:38z', 'origin_country_code': 'fr', 'trim': 'active pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 119, 'id': '8ff3a3d3-bec3-5759-b7ae-d3e83ac0007f', 'current_year_diff': 4, 'age_in_months': 43, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 27038}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 43,
     'auction_title': '',
     'c_o_2_emission_value': 119,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 75,
     'expiration_date': '2026-01-29t16:01:38z',
     'fuel_type': 'petrol',
     'id': '8ff3a3d3-bec3-5759-b7ae-d3e83ac0007f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ub45320',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 27038,
     'odometer_in_km': 27038,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-06-27',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech active pack',
     'transmission': 'manual',
     'trim': 'active pack',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:01:38Z',
 'fuel_type': 'petrol',
 'id': '8ff3a3d3-bec3-5759-b7ae-d3e83ac0007f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB45320',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 27038,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Active Pack',
 'transmission': 'manual',
 'trim': 'Active Pack',
 'year': 2022}
2026-01-29 06:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UB45320%27 HTTP/1.1" 200 None
2026-01-29 06:06:26 [auto1.fr] INFO: Saving data for UB45320: {'auction_closing_time': 1769702498.0, 'created_time': 1769190288.61446, 'last_price_update_time': 1769666786.373992}
2026-01-29 06:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UB45320') HTTP/1.1" 204 0
2026-01-29 06:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JK27396/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VB36819/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AR66543/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RY70552> (referer: https://www.auto1.com/v1/car-details-view/RY70552/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0793eccb-afac-53f6-85cc-ef9f01874efa with identifier: RY70552
2026-01-29 06:06:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0793eccb-afac-53f6-85cc-ef9f01874efa with scrape type 2
2026-01-29 06:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0793eccb-afac-53f6-85cc-ef9f01874efa with scrape type 2
2026-01-29 06:06:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0793eccb-afac-53f6-85cc-ef9f01874efa, identifier: RY70552
2026-01-29 06:06:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0793eccb-afac-53f6-85cc-ef9f01874efa with identifier: RY70552
2026-01-29 06:06:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0793eccb-afac-53f6-85cc-ef9f01874efa with identifier: RY70552
2026-01-29 06:06:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0793eccb-afac-53f6-85cc-ef9f01874efa with identifier: RY70552 to the API
2026-01-29 06:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:06:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:06:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RY70552>
{'auction_title': '',
 'c_o_2_emission_value': 77,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 404,
 'expiration_date': '2026-01-29T16:27:10Z',
 'fuel_type': 'hybrid',
 'id': '0793eccb-afac-53f6-85cc-ef9f01874efa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY70552',
 'listing': 'auction',
 'location': 'FR, Marly-la-ville',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 122231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-05-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport P400e Plug-in Hybrid HSE Dynamic '
          'Stealth',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic Stealth',
 'year': 2020}
2026-01-29 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RY70552%27 HTTP/1.1" 200 None
2026-01-29 06:06:28 [auto1.fr] INFO: Saving data for RY70552: {'auction_closing_time': 1769704030.0, 'created_time': 1769449061.084454, 'last_price_update_time': 1769666788.249709}
2026-01-29 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RY70552') HTTP/1.1" 204 0
2026-01-29 06:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CE56263> (referer: https://www.auto1.com/v1/car-details-view/CE56263/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f986ada7-e600-56a8-a785-6ad9774c2f66 with identifier: CE56263
2026-01-29 06:06:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f986ada7-e600-56a8-a785-6ad9774c2f66 with scrape type 2
2026-01-29 06:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f986ada7-e600-56a8-a785-6ad9774c2f66 with scrape type 2
2026-01-29 06:06:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f986ada7-e600-56a8-a785-6ad9774c2f66, identifier: CE56263
2026-01-29 06:06:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f986ada7-e600-56a8-a785-6ad9774c2f66 with identifier: CE56263
2026-01-29 06:06:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f986ada7-e600-56a8-a785-6ad9774c2f66 with identifier: CE56263
2026-01-29 06:06:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 65860, 'odometer_reading_unit': 'km', 'registration_date': '2020-11-04', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ce56263', 'expiration_date': '2026-01-29t16:45:22z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ingrandes sur vienne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 124, 'id': 'f986ada7-e600-56a8-a785-6ad9774c2f66', 'current_year_diff': 6, 'age_in_months': 62, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 65860}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 62,
     'auction_title': '',
     'c_o_2_emission_value': 124,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:45:22z',
     'fuel_type': 'petrol',
     'id': 'f986ada7-e600-56a8-a785-6ad9774c2f66',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ce56263',
     'listing': 'auction',
     'location': 'fr, ingrandes sur vienne',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 65860,
     'odometer_in_km': 65860,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-11-04',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2020}
2026-01-29 06:06:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: f986ada7-e600-56a8-a785-6ad9774c2f66 spider: auto1.fr
2026-01-29 06:06:29 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: f986ada7-e600-56a8-a785-6ad9774c2f66 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 65860, 'odometer_reading_unit': 'km', 'registration_date': '2020-11-04', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ce56263', 'expiration_date': '2026-01-29t16:45:22z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ingrandes sur vienne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 124, 'id': 'f986ada7-e600-56a8-a785-6ad9774c2f66', 'current_year_diff': 6, 'age_in_months': 62, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 65860}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 62,
     'auction_title': '',
     'c_o_2_emission_value': 124,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:45:22z',
     'fuel_type': 'petrol',
     'id': 'f986ada7-e600-56a8-a785-6ad9774c2f66',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ce56263',
     'listing': 'auction',
     'location': 'fr, ingrandes sur vienne',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 65860,
     'odometer_in_km': 65860,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-11-04',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:45:22Z',
 'fuel_type': 'petrol',
 'id': 'f986ada7-e600-56a8-a785-6ad9774c2f66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE56263',
 'listing': 'auction',
 'location': 'FR, Ingrandes sur Vienne',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 65860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-01-29 06:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CE56263%27 HTTP/1.1" 200 None
2026-01-29 06:06:29 [auto1.fr] INFO: Saving data for CE56263: {'auction_closing_time': 1769705122.0, 'created_time': 1768496775.571086, 'last_price_update_time': 1769666789.726253}
2026-01-29 06:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CE56263') HTTP/1.1" 204 0
2026-01-29 06:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:30 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:06:30 [auto1.fr] INFO: Found listing with ID: YA35276
2026-01-29 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YA35276%27 HTTP/1.1" 200 None
2026-01-29 06:06:30 [auto1.fr] INFO: Scrape type for YA35276: 2
2026-01-29 06:06:30 [auto1.fr] INFO: Found listing with ID: CW11714
2026-01-29 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CW11714%27 HTTP/1.1" 200 None
2026-01-29 06:06:30 [auto1.fr] INFO: Scrape type for CW11714: 0
2026-01-29 06:06:30 [auto1.fr] INFO: Found listing with ID: ST24526
2026-01-29 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ST24526%27 HTTP/1.1" 200 None
2026-01-29 06:06:30 [auto1.fr] INFO: Scrape type for ST24526: 0
2026-01-29 06:06:30 [auto1.fr] INFO: Found listing with ID: MK03042
2026-01-29 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MK03042%27 HTTP/1.1" 200 None
2026-01-29 06:06:30 [auto1.fr] INFO: Scrape type for MK03042: 0
2026-01-29 06:06:30 [auto1.fr] INFO: Found listing with ID: SL81788
2026-01-29 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL81788%27 HTTP/1.1" 200 None
2026-01-29 06:06:31 [auto1.fr] INFO: Scrape type for SL81788: 0
2026-01-29 06:06:31 [auto1.fr] INFO: Found listing with ID: KX93463
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KX93463%27 HTTP/1.1" 200 None
2026-01-29 06:06:31 [auto1.fr] INFO: Scrape type for KX93463: 0
2026-01-29 06:06:31 [auto1.fr] INFO: Found listing with ID: DH73797
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DH73797%27 HTTP/1.1" 200 None
2026-01-29 06:06:31 [auto1.fr] INFO: Scrape type for DH73797: 0
2026-01-29 06:06:31 [auto1.fr] INFO: Found listing with ID: VC58248
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VC58248%27 HTTP/1.1" 200 None
2026-01-29 06:06:31 [auto1.fr] INFO: Scrape type for VC58248: 0
2026-01-29 06:06:31 [auto1.fr] INFO: Found listing with ID: CW32987
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CW32987%27 HTTP/1.1" 200 None
2026-01-29 06:06:31 [auto1.fr] INFO: Scrape type for CW32987: 0
2026-01-29 06:06:31 [auto1.fr] INFO: Found listing with ID: GZ41997
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GZ41997%27 HTTP/1.1" 200 None
2026-01-29 06:06:31 [auto1.fr] INFO: Scrape type for GZ41997: 0
2026-01-29 06:06:31 [auto1.fr] INFO: Found listing with ID: WL19715
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WL19715%27 HTTP/1.1" 200 None
2026-01-29 06:06:31 [auto1.fr] INFO: Scrape type for WL19715: 0
2026-01-29 06:06:31 [auto1.fr] INFO: Found listing with ID: UA37857
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UA37857%27 HTTP/1.1" 200 None
2026-01-29 06:06:31 [auto1.fr] INFO: Scrape type for UA37857: 2
2026-01-29 06:06:31 [auto1.fr] INFO: Found listing with ID: WE07737
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WE07737%27 HTTP/1.1" 200 None
2026-01-29 06:06:31 [auto1.fr] INFO: Scrape type for WE07737: 0
2026-01-29 06:06:31 [auto1.fr] INFO: Found listing with ID: MY85005
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MY85005%27 HTTP/1.1" 200 None
2026-01-29 06:06:31 [auto1.fr] INFO: Scrape type for MY85005: 0
2026-01-29 06:06:31 [auto1.fr] INFO: Found listing with ID: GU78128
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU78128%27 HTTP/1.1" 200 None
2026-01-29 06:06:31 [auto1.fr] INFO: Scrape type for GU78128: 0
2026-01-29 06:06:31 [auto1.fr] INFO: Found listing with ID: GE00123
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GE00123%27 HTTP/1.1" 200 None
2026-01-29 06:06:31 [auto1.fr] INFO: Scrape type for GE00123: 0
2026-01-29 06:06:31 [auto1.fr] INFO: Found listing with ID: JY72790
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JY72790%27 HTTP/1.1" 200 None
2026-01-29 06:06:31 [auto1.fr] INFO: Scrape type for JY72790: 0
2026-01-29 06:06:31 [auto1.fr] INFO: Found listing with ID: NZ40390
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NZ40390%27 HTTP/1.1" 200 None
2026-01-29 06:06:31 [auto1.fr] INFO: Scrape type for NZ40390: 0
2026-01-29 06:06:31 [auto1.fr] INFO: Found listing with ID: SF08763
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF08763%27 HTTP/1.1" 200 None
2026-01-29 06:06:31 [auto1.fr] INFO: Scrape type for SF08763: 0
2026-01-29 06:06:31 [auto1.fr] INFO: Found listing with ID: YG29717
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG29717%27 HTTP/1.1" 200 None
2026-01-29 06:06:31 [auto1.fr] INFO: Scrape type for YG29717: 2
2026-01-29 06:06:31 [auto1.fr] INFO: Found listing with ID: DC96528
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DC96528%27 HTTP/1.1" 200 None
2026-01-29 06:06:31 [auto1.fr] INFO: Scrape type for DC96528: 2
2026-01-29 06:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SV32269> (referer: https://www.auto1.com/v1/car-details-view/SV32269/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:31 [auto1.fr] INFO: Found listing with ID: SS53107
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SS53107%27 HTTP/1.1" 200 None
2026-01-29 06:06:31 [auto1.fr] INFO: Scrape type for SS53107: 2
2026-01-29 06:06:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:31 [auto1.fr] INFO: Found listing with ID: VS39820
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS39820%27 HTTP/1.1" 200 None
2026-01-29 06:06:31 [auto1.fr] INFO: Scrape type for VS39820: 2
2026-01-29 06:06:31 [auto1.fr] INFO: Found listing with ID: EG48643
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EG48643%27 HTTP/1.1" 200 None
2026-01-29 06:06:31 [auto1.fr] INFO: Scrape type for EG48643: 0
2026-01-29 06:06:31 [auto1.fr] INFO: Found listing with ID: ZZ35334
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZZ35334%27 HTTP/1.1" 200 None
2026-01-29 06:06:31 [auto1.fr] INFO: Scrape type for ZZ35334: 0
2026-01-29 06:06:31 [auto1.fr] INFO: Found listing with ID: FS95119
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FS95119%27 HTTP/1.1" 200 None
2026-01-29 06:06:31 [auto1.fr] INFO: Scrape type for FS95119: 2
2026-01-29 06:06:31 [auto1.fr] INFO: Found listing with ID: CW85860
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CW85860%27 HTTP/1.1" 200 None
2026-01-29 06:06:31 [auto1.fr] INFO: Scrape type for CW85860: 0
2026-01-29 06:06:31 [auto1.fr] INFO: Found listing with ID: BM90055
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BM90055%27 HTTP/1.1" 200 None
2026-01-29 06:06:31 [auto1.fr] INFO: Scrape type for BM90055: 0
2026-01-29 06:06:31 [auto1.fr] INFO: Found listing with ID: UA20744
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UA20744%27 HTTP/1.1" 200 None
2026-01-29 06:06:31 [auto1.fr] INFO: Scrape type for UA20744: 2
2026-01-29 06:06:31 [auto1.fr] INFO: Found listing with ID: WV49919
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WV49919%27 HTTP/1.1" 200 None
2026-01-29 06:06:31 [auto1.fr] INFO: Scrape type for WV49919: 2
2026-01-29 06:06:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06d48475-0410-5d9f-a945-2345645f115b with identifier: SV32269
2026-01-29 06:06:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06d48475-0410-5d9f-a945-2345645f115b with scrape type 2
2026-01-29 06:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06d48475-0410-5d9f-a945-2345645f115b with scrape type 2
2026-01-29 06:06:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 06d48475-0410-5d9f-a945-2345645f115b, identifier: SV32269
2026-01-29 06:06:31 [auto1.fr] INFO: Found listing with ID: JM19604
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JM19604%27 HTTP/1.1" 200 None
2026-01-29 06:06:31 [auto1.fr] INFO: Scrape type for JM19604: 2
2026-01-29 06:06:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 06d48475-0410-5d9f-a945-2345645f115b with identifier: SV32269
2026-01-29 06:06:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 06d48475-0410-5d9f-a945-2345645f115b with identifier: SV32269
2026-01-29 06:06:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 06d48475-0410-5d9f-a945-2345645f115b with identifier: SV32269 to the API
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:06:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SV32269>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:51:57Z',
 'fuel_type': 'hybrid',
 'id': '06d48475-0410-5d9f-a945-2345645f115b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV32269',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Toyota',
 'model': 'Yaris Cross',
 'odometer': 45539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris Cross 1.5 Hybrid Design',
 'transmission': 'automatic',
 'trim': 'Design',
 'year': 2022}
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV32269%27 HTTP/1.1" 200 None
2026-01-29 06:06:31 [auto1.fr] INFO: Saving data for SV32269: {'auction_closing_time': 1769705517.0, 'created_time': 1768842194.08723, 'last_price_update_time': 1769666791.992944}
2026-01-29 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SV32269') HTTP/1.1" 204 0
2026-01-29 06:06:32 [auto1.fr] INFO: Found listing with ID: FR45824
2026-01-29 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FR45824%27 HTTP/1.1" 200 None
2026-01-29 06:06:32 [auto1.fr] INFO: Scrape type for FR45824: 0
2026-01-29 06:06:32 [auto1.fr] INFO: Found listing with ID: CP28007
2026-01-29 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CP28007%27 HTTP/1.1" 200 None
2026-01-29 06:06:32 [auto1.fr] INFO: Scrape type for CP28007: 0
2026-01-29 06:06:32 [auto1.fr] INFO: Found listing with ID: NZ43148
2026-01-29 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NZ43148%27 HTTP/1.1" 200 None
2026-01-29 06:06:32 [auto1.fr] INFO: Scrape type for NZ43148: 2
2026-01-29 06:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JK27396> (referer: https://www.auto1.com/v1/car-details-view/JK27396/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:32 [auto1.fr] INFO: Found listing with ID: AY15266
2026-01-29 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AY15266%27 HTTP/1.1" 200 None
2026-01-29 06:06:32 [auto1.fr] INFO: Scrape type for AY15266: 0
2026-01-29 06:06:32 [auto1.fr] INFO: Found listing with ID: WK19105
2026-01-29 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WK19105%27 HTTP/1.1" 200 None
2026-01-29 06:06:32 [auto1.fr] INFO: Scrape type for WK19105: 0
2026-01-29 06:06:32 [auto1.fr] INFO: Found listing with ID: XD52399
2026-01-29 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XD52399%27 HTTP/1.1" 200 None
2026-01-29 06:06:32 [auto1.fr] INFO: Scrape type for XD52399: 2
2026-01-29 06:06:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:32 [auto1.fr] INFO: Found listing with ID: MP01789
2026-01-29 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP01789%27 HTTP/1.1" 200 None
2026-01-29 06:06:32 [auto1.fr] INFO: Scrape type for MP01789: 2
2026-01-29 06:06:32 [auto1.fr] INFO: Found listing with ID: CS76950
2026-01-29 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CS76950%27 HTTP/1.1" 200 None
2026-01-29 06:06:32 [auto1.fr] INFO: Scrape type for CS76950: 2
2026-01-29 06:06:32 [auto1.fr] INFO: Found listing with ID: FL56179
2026-01-29 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FL56179%27 HTTP/1.1" 200 None
2026-01-29 06:06:32 [auto1.fr] INFO: Scrape type for FL56179: 2
2026-01-29 06:06:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1592479-3867-55b1-96be-17f96d163348 with identifier: JK27396
2026-01-29 06:06:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1592479-3867-55b1-96be-17f96d163348 with scrape type 2
2026-01-29 06:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1592479-3867-55b1-96be-17f96d163348 with scrape type 2
2026-01-29 06:06:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a1592479-3867-55b1-96be-17f96d163348, identifier: JK27396
2026-01-29 06:06:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a1592479-3867-55b1-96be-17f96d163348 with identifier: JK27396
2026-01-29 06:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a1592479-3867-55b1-96be-17f96d163348 with identifier: JK27396
2026-01-29 06:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 146419 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    146419
2026-01-29 06:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: a1592479-3867-55b1-96be-17f96d163348 spider: auto1.fr
2026-01-29 06:06:32 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: a1592479-3867-55b1-96be-17f96d163348 due to rule: high_mileage_for_make.json, error: 146419 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    146419
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:25:08Z',
 'fuel_type': 'diesel',
 'id': 'a1592479-3867-55b1-96be-17f96d163348',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK27396',
 'listing': 'auction',
 'location': 'Saint-Germain-du-Puy',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 146419,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Clubman Cooper D',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-01-29 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JK27396%27 HTTP/1.1" 200 None
2026-01-29 06:06:32 [auto1.fr] INFO: Saving data for JK27396: {'auction_closing_time': 1769703908.0, 'created_time': 1768716153.979104, 'last_price_update_time': 1769666792.580828}
2026-01-29 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JK27396') HTTP/1.1" 204 0
2026-01-29 06:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VB36819> (referer: https://www.auto1.com/v1/car-details-view/VB36819/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1033c26e-43a9-54d0-a881-e2be651418c9 with identifier: VB36819
2026-01-29 06:06:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1033c26e-43a9-54d0-a881-e2be651418c9 with scrape type 2
2026-01-29 06:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1033c26e-43a9-54d0-a881-e2be651418c9 with scrape type 2
2026-01-29 06:06:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1033c26e-43a9-54d0-a881-e2be651418c9, identifier: VB36819
2026-01-29 06:06:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1033c26e-43a9-54d0-a881-e2be651418c9 with identifier: VB36819
2026-01-29 06:06:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1033c26e-43a9-54d0-a881-e2be651418c9 with identifier: VB36819
2026-01-29 06:06:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1033c26e-43a9-54d0-a881-e2be651418c9 with identifier: VB36819 to the API
2026-01-29 06:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:06:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:06:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VB36819>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:37:57Z',
 'fuel_type': 'diesel',
 'id': '1033c26e-43a9-54d0-a881-e2be651418c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB36819',
 'listing': 'auction',
 'location': 'FR, MIRAMAS',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 144249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Karoq 2.0 TDI Style 4x4',
 'transmission': 'automatic',
 'trim': 'Style 4x4',
 'year': 2018}
2026-01-29 06:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VB36819%27 HTTP/1.1" 200 None
2026-01-29 06:06:33 [auto1.fr] INFO: Saving data for VB36819: {'auction_closing_time': 1769704677.0, 'created_time': 1769534005.128802, 'last_price_update_time': 1769666793.425466}
2026-01-29 06:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VB36819') HTTP/1.1" 204 0
2026-01-29 06:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AR66543> (referer: https://www.auto1.com/v1/car-details-view/AR66543/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZH82252> (referer: https://www.auto1.com/v1/car-details-view/ZH82252/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e744bdd7-9c77-53ac-b6c0-6a5e0e25b856 with identifier: AR66543
2026-01-29 06:06:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e744bdd7-9c77-53ac-b6c0-6a5e0e25b856 with scrape type 2
2026-01-29 06:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e744bdd7-9c77-53ac-b6c0-6a5e0e25b856 with scrape type 2
2026-01-29 06:06:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e744bdd7-9c77-53ac-b6c0-6a5e0e25b856, identifier: AR66543
2026-01-29 06:06:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e744bdd7-9c77-53ac-b6c0-6a5e0e25b856 with identifier: AR66543
2026-01-29 06:06:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e744bdd7-9c77-53ac-b6c0-6a5e0e25b856 with identifier: AR66543
2026-01-29 06:06:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech allure business', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 39415, 'odometer_reading_unit': 'km', 'registration_date': '2020-10-15', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ar66543', 'expiration_date': '2026-01-29t16:12:05z', 'origin_country_code': 'fr', 'trim': 'allure business', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, houecourt', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 152, 'id': 'e744bdd7-9c77-53ac-b6c0-6a5e0e25b856', 'current_year_diff': 6, 'age_in_months': 63, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 39415}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 63,
     'auction_title': '',
     'c_o_2_emission_value': 152,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:12:05z',
     'fuel_type': 'petrol',
     'id': 'e744bdd7-9c77-53ac-b6c0-6a5e0e25b856',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ar66543',
     'listing': 'auction',
     'location': 'fr, houecourt',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 39415,
     'odometer_in_km': 39415,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-10-15',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 puretech allure business',
     'transmission': 'automatic',
     'trim': 'allure business',
     'year': 2020}
2026-01-29 06:06:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: e744bdd7-9c77-53ac-b6c0-6a5e0e25b856 spider: auto1.fr
2026-01-29 06:06:33 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: e744bdd7-9c77-53ac-b6c0-6a5e0e25b856 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech allure business', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 39415, 'odometer_reading_unit': 'km', 'registration_date': '2020-10-15', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ar66543', 'expiration_date': '2026-01-29t16:12:05z', 'origin_country_code': 'fr', 'trim': 'allure business', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, houecourt', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 152, 'id': 'e744bdd7-9c77-53ac-b6c0-6a5e0e25b856', 'current_year_diff': 6, 'age_in_months': 63, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 39415}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 63,
     'auction_title': '',
     'c_o_2_emission_value': 152,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:12:05z',
     'fuel_type': 'petrol',
     'id': 'e744bdd7-9c77-53ac-b6c0-6a5e0e25b856',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ar66543',
     'listing': 'auction',
     'location': 'fr, houecourt',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 39415,
     'odometer_in_km': 39415,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-10-15',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 puretech allure business',
     'transmission': 'automatic',
     'trim': 'allure business',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:12:05Z',
 'fuel_type': 'petrol',
 'id': 'e744bdd7-9c77-53ac-b6c0-6a5e0e25b856',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR66543',
 'listing': 'auction',
 'location': 'FR, Houecourt',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 39415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Allure Business',
 'transmission': 'automatic',
 'trim': 'Allure Business',
 'year': 2020}
2026-01-29 06:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AR66543%27 HTTP/1.1" 200 None
2026-01-29 06:06:33 [auto1.fr] INFO: Saving data for AR66543: {'auction_closing_time': 1769703125.0, 'created_time': 1769533484.33448, 'last_price_update_time': 1769666793.844935}
2026-01-29 06:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AR66543') HTTP/1.1" 204 0
2026-01-29 06:06:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 354bb5d6-047d-5545-883a-c5eeebcd4fa6 with identifier: ZH82252
2026-01-29 06:06:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 354bb5d6-047d-5545-883a-c5eeebcd4fa6 with scrape type 2
2026-01-29 06:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 354bb5d6-047d-5545-883a-c5eeebcd4fa6 with scrape type 2
2026-01-29 06:06:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 354bb5d6-047d-5545-883a-c5eeebcd4fa6, identifier: ZH82252
2026-01-29 06:06:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 354bb5d6-047d-5545-883a-c5eeebcd4fa6 with identifier: ZH82252
2026-01-29 06:06:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 354bb5d6-047d-5545-883a-c5eeebcd4fa6 with identifier: ZH82252
2026-01-29 06:06:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 354bb5d6-047d-5545-883a-c5eeebcd4fa6 with identifier: ZH82252 to the API
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:06:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZH82252>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:11:20Z',
 'fuel_type': 'petrol',
 'id': '354bb5d6-047d-5545-883a-c5eeebcd4fa6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH82252',
 'listing': 'auction',
 'location': 'Metz',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 90911,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Karoq 1.5 TSI ACT SportLine',
 'transmission': 'automatic',
 'trim': 'SportLine',
 'year': 2020}
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZH82252%27 HTTP/1.1" 200 None
2026-01-29 06:06:34 [auto1.fr] INFO: Saving data for ZH82252: {'auction_closing_time': 1769703080.0, 'created_time': 1768929107.900887, 'last_price_update_time': 1769666794.277313}
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZH82252') HTTP/1.1" 204 0
2026-01-29 06:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:34 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:06:34 [auto1.fr] INFO: Found listing with ID: VT21483
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VT21483%27 HTTP/1.1" 200 None
2026-01-29 06:06:34 [auto1.fr] INFO: Scrape type for VT21483: 0
2026-01-29 06:06:34 [auto1.fr] INFO: Found listing with ID: FA92467
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FA92467%27 HTTP/1.1" 200 None
2026-01-29 06:06:34 [auto1.fr] INFO: Scrape type for FA92467: 0
2026-01-29 06:06:34 [auto1.fr] INFO: Found listing with ID: TG40361
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TG40361%27 HTTP/1.1" 200 None
2026-01-29 06:06:34 [auto1.fr] INFO: Scrape type for TG40361: 0
2026-01-29 06:06:34 [auto1.fr] INFO: Found listing with ID: BE11551
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BE11551%27 HTTP/1.1" 200 None
2026-01-29 06:06:34 [auto1.fr] INFO: Scrape type for BE11551: 0
2026-01-29 06:06:34 [auto1.fr] INFO: Found listing with ID: SC02077
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SC02077%27 HTTP/1.1" 200 None
2026-01-29 06:06:34 [auto1.fr] INFO: Scrape type for SC02077: 0
2026-01-29 06:06:34 [auto1.fr] INFO: Found listing with ID: NN52770
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NN52770%27 HTTP/1.1" 200 None
2026-01-29 06:06:34 [auto1.fr] INFO: Scrape type for NN52770: 0
2026-01-29 06:06:34 [auto1.fr] INFO: Found listing with ID: CD59619
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CD59619%27 HTTP/1.1" 200 None
2026-01-29 06:06:34 [auto1.fr] INFO: Scrape type for CD59619: 2
2026-01-29 06:06:34 [auto1.fr] INFO: Found listing with ID: NH60052
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH60052%27 HTTP/1.1" 200 None
2026-01-29 06:06:34 [auto1.fr] INFO: Scrape type for NH60052: 0
2026-01-29 06:06:34 [auto1.fr] INFO: Found listing with ID: AT82299
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AT82299%27 HTTP/1.1" 200 None
2026-01-29 06:06:34 [auto1.fr] INFO: Scrape type for AT82299: 0
2026-01-29 06:06:34 [auto1.fr] INFO: Found listing with ID: YA13329
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YA13329%27 HTTP/1.1" 200 None
2026-01-29 06:06:34 [auto1.fr] INFO: Scrape type for YA13329: 0
2026-01-29 06:06:34 [auto1.fr] INFO: Found listing with ID: XZ24822
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XZ24822%27 HTTP/1.1" 200 None
2026-01-29 06:06:34 [auto1.fr] INFO: Scrape type for XZ24822: 0
2026-01-29 06:06:34 [auto1.fr] INFO: Found listing with ID: YW47002
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YW47002%27 HTTP/1.1" 200 None
2026-01-29 06:06:34 [auto1.fr] INFO: Scrape type for YW47002: 0
2026-01-29 06:06:34 [auto1.fr] INFO: Found listing with ID: TN58602
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TN58602%27 HTTP/1.1" 200 None
2026-01-29 06:06:34 [auto1.fr] INFO: Scrape type for TN58602: 2
2026-01-29 06:06:34 [auto1.fr] INFO: Found listing with ID: HT98723
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HT98723%27 HTTP/1.1" 200 None
2026-01-29 06:06:34 [auto1.fr] INFO: Scrape type for HT98723: 2
2026-01-29 06:06:34 [auto1.fr] INFO: Found listing with ID: UB15028
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UB15028%27 HTTP/1.1" 200 None
2026-01-29 06:06:34 [auto1.fr] INFO: Scrape type for UB15028: 0
2026-01-29 06:06:34 [auto1.fr] INFO: Found listing with ID: GA39306
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GA39306%27 HTTP/1.1" 200 None
2026-01-29 06:06:34 [auto1.fr] INFO: Scrape type for GA39306: 2
2026-01-29 06:06:34 [auto1.fr] INFO: Found listing with ID: GH58539
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GH58539%27 HTTP/1.1" 200 None
2026-01-29 06:06:34 [auto1.fr] INFO: Scrape type for GH58539: 0
2026-01-29 06:06:34 [auto1.fr] INFO: Found listing with ID: AL09788
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AL09788%27 HTTP/1.1" 200 None
2026-01-29 06:06:34 [auto1.fr] INFO: Scrape type for AL09788: 2
2026-01-29 06:06:34 [auto1.fr] INFO: Found listing with ID: JD85200
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD85200%27 HTTP/1.1" 200 None
2026-01-29 06:06:34 [auto1.fr] INFO: Scrape type for JD85200: 0
2026-01-29 06:06:34 [auto1.fr] INFO: Found listing with ID: TK93025
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TK93025%27 HTTP/1.1" 200 None
2026-01-29 06:06:34 [auto1.fr] INFO: Scrape type for TK93025: 0
2026-01-29 06:06:34 [auto1.fr] INFO: Found listing with ID: KH14175
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH14175%27 HTTP/1.1" 200 None
2026-01-29 06:06:34 [auto1.fr] INFO: Scrape type for KH14175: 2
2026-01-29 06:06:34 [auto1.fr] INFO: Found listing with ID: FS73973
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FS73973%27 HTTP/1.1" 200 None
2026-01-29 06:06:34 [auto1.fr] INFO: Scrape type for FS73973: 0
2026-01-29 06:06:34 [auto1.fr] INFO: Found listing with ID: KK93163
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KK93163%27 HTTP/1.1" 200 None
2026-01-29 06:06:34 [auto1.fr] INFO: Scrape type for KK93163: 0
2026-01-29 06:06:34 [auto1.fr] INFO: Found listing with ID: RU03060
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RU03060%27 HTTP/1.1" 200 None
2026-01-29 06:06:34 [auto1.fr] INFO: Scrape type for RU03060: 2
2026-01-29 06:06:34 [auto1.fr] INFO: Found listing with ID: KA95717
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KA95717%27 HTTP/1.1" 200 None
2026-01-29 06:06:34 [auto1.fr] INFO: Scrape type for KA95717: 2
2026-01-29 06:06:34 [auto1.fr] INFO: Found listing with ID: YE32704
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YE32704%27 HTTP/1.1" 200 None
2026-01-29 06:06:34 [auto1.fr] INFO: Scrape type for YE32704: 2
2026-01-29 06:06:34 [auto1.fr] INFO: Found listing with ID: BE03446
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BE03446%27 HTTP/1.1" 200 None
2026-01-29 06:06:34 [auto1.fr] INFO: Scrape type for BE03446: 0
2026-01-29 06:06:34 [auto1.fr] INFO: Found listing with ID: FJ80328
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ80328%27 HTTP/1.1" 200 None
2026-01-29 06:06:34 [auto1.fr] INFO: Scrape type for FJ80328: 0
2026-01-29 06:06:34 [auto1.fr] INFO: Found listing with ID: PD18148
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PD18148%27 HTTP/1.1" 200 None
2026-01-29 06:06:34 [auto1.fr] INFO: Scrape type for PD18148: 2
2026-01-29 06:06:34 [auto1.fr] INFO: Found listing with ID: WL47501
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WL47501%27 HTTP/1.1" 200 None
2026-01-29 06:06:34 [auto1.fr] INFO: Scrape type for WL47501: 0
2026-01-29 06:06:34 [auto1.fr] INFO: Found listing with ID: EJ58259
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EJ58259%27 HTTP/1.1" 200 None
2026-01-29 06:06:34 [auto1.fr] INFO: Scrape type for EJ58259: 2
2026-01-29 06:06:34 [auto1.fr] INFO: Found listing with ID: EB45903
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EB45903%27 HTTP/1.1" 200 None
2026-01-29 06:06:34 [auto1.fr] INFO: Scrape type for EB45903: 0
2026-01-29 06:06:34 [auto1.fr] INFO: Found listing with ID: CY81201
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY81201%27 HTTP/1.1" 200 None
2026-01-29 06:06:34 [auto1.fr] INFO: Scrape type for CY81201: 0
2026-01-29 06:06:34 [auto1.fr] INFO: Found listing with ID: MR40332
2026-01-29 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR40332%27 HTTP/1.1" 200 None
2026-01-29 06:06:35 [auto1.fr] INFO: Scrape type for MR40332: 0
2026-01-29 06:06:35 [auto1.fr] INFO: Found listing with ID: SB17449
2026-01-29 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SB17449%27 HTTP/1.1" 200 None
2026-01-29 06:06:35 [auto1.fr] INFO: Scrape type for SB17449: 2
2026-01-29 06:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YA35276/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:35 [auto1.fr] INFO: Found listing with ID: JN53316
2026-01-29 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JN53316%27 HTTP/1.1" 200 None
2026-01-29 06:06:35 [auto1.fr] INFO: Scrape type for JN53316: 2
2026-01-29 06:06:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:35 [auto1.fr] INFO: Found listing with ID: YL56654
2026-01-29 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YL56654%27 HTTP/1.1" 200 None
2026-01-29 06:06:35 [auto1.fr] INFO: Scrape type for YL56654: 2
2026-01-29 06:06:35 [auto1.fr] INFO: Found listing with ID: FW91017
2026-01-29 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FW91017%27 HTTP/1.1" 200 None
2026-01-29 06:06:35 [auto1.fr] INFO: Scrape type for FW91017: 2
2026-01-29 06:06:35 [auto1.fr] INFO: Found listing with ID: BH31485
2026-01-29 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BH31485%27 HTTP/1.1" 200 None
2026-01-29 06:06:35 [auto1.fr] INFO: Scrape type for BH31485: 2
2026-01-29 06:06:35 [auto1.fr] INFO: Found listing with ID: NR37380
2026-01-29 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NR37380%27 HTTP/1.1" 200 None
2026-01-29 06:06:35 [auto1.fr] INFO: Scrape type for NR37380: 2
2026-01-29 06:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KX09817> (referer: https://www.auto1.com/v1/car-details-view/KX09817/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74f9bf0b-2c51-5aa4-940d-11583508388c with identifier: KX09817
2026-01-29 06:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74f9bf0b-2c51-5aa4-940d-11583508388c with scrape type 2
2026-01-29 06:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74f9bf0b-2c51-5aa4-940d-11583508388c with scrape type 2
2026-01-29 06:06:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 74f9bf0b-2c51-5aa4-940d-11583508388c, identifier: KX09817
2026-01-29 06:06:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 74f9bf0b-2c51-5aa4-940d-11583508388c with identifier: KX09817
2026-01-29 06:06:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 74f9bf0b-2c51-5aa4-940d-11583508388c with identifier: KX09817
2026-01-29 06:06:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 74f9bf0b-2c51-5aa4-940d-11583508388c with identifier: KX09817 to the API
2026-01-29 06:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:06:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:06:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KX09817>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:06:22Z',
 'fuel_type': 'hybrid',
 'id': '74f9bf0b-2c51-5aa4-940d-11583508388c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX09817',
 'listing': 'auction',
 'location': 'FR, Marly-la-ville',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 40694,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Hybrid Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2021}
2026-01-29 06:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KX09817%27 HTTP/1.1" 200 None
2026-01-29 06:06:36 [auto1.fr] INFO: Saving data for KX09817: {'auction_closing_time': 1769702782.0, 'created_time': 1769580053.05951, 'last_price_update_time': 1769666796.020992}
2026-01-29 06:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KX09817') HTTP/1.1" 204 0
2026-01-29 06:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DC96528/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YG29717/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VS39820/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FL56179/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NZ43148/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CS76950/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XD52399/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UA37857/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KK69084> (referer: https://www.auto1.com/v1/car-details-view/KK69084/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23750156-99c5-516a-8a09-b970e019423e with identifier: KK69084
2026-01-29 06:06:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23750156-99c5-516a-8a09-b970e019423e with scrape type 2
2026-01-29 06:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23750156-99c5-516a-8a09-b970e019423e with scrape type 2
2026-01-29 06:06:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 23750156-99c5-516a-8a09-b970e019423e, identifier: KK69084
2026-01-29 06:06:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 23750156-99c5-516a-8a09-b970e019423e with identifier: KK69084
2026-01-29 06:06:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 23750156-99c5-516a-8a09-b970e019423e with identifier: KK69084
2026-01-29 06:06:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 23750156-99c5-516a-8a09-b970e019423e with identifier: KK69084 to the API
2026-01-29 06:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:06:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:06:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KK69084>
{'auction_title': '',
 'c_o_2_emission_value': 30,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 224,
 'expiration_date': '2026-01-29T16:00:01Z',
 'fuel_type': 'hybrid',
 'id': '23750156-99c5-516a-8a09-b970e019423e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK69084',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 78558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Hybrid 225 Allure',
 'transmission': 'automatic',
 'trim': '225 Allure',
 'year': 2020}
2026-01-29 06:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KK69084%27 HTTP/1.1" 200 None
2026-01-29 06:06:41 [auto1.fr] INFO: Saving data for KK69084: {'auction_closing_time': 1769702401.0, 'created_time': 1768889029.870214, 'last_price_update_time': 1769666801.299507}
2026-01-29 06:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KK69084') HTTP/1.1" 204 0
2026-01-29 06:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YA35276> (referer: https://www.auto1.com/v1/car-details-view/YA35276/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2732776e-66f3-5dd1-bfa9-7a0697c38a25 with identifier: YA35276
2026-01-29 06:06:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2732776e-66f3-5dd1-bfa9-7a0697c38a25 with scrape type 2
2026-01-29 06:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2732776e-66f3-5dd1-bfa9-7a0697c38a25 with scrape type 2
2026-01-29 06:06:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2732776e-66f3-5dd1-bfa9-7a0697c38a25, identifier: YA35276
2026-01-29 06:06:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2732776e-66f3-5dd1-bfa9-7a0697c38a25 with identifier: YA35276
2026-01-29 06:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2732776e-66f3-5dd1-bfa9-7a0697c38a25 with identifier: YA35276
2026-01-29 06:06:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2732776e-66f3-5dd1-bfa9-7a0697c38a25 with identifier: YA35276 to the API
2026-01-29 06:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:06:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:06:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YA35276>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:44:12Z',
 'fuel_type': 'diesel',
 'id': '2732776e-66f3-5dd1-bfa9-7a0697c38a25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA35276',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 93992,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque D150 Mild-Hybrid R-dynamic S',
 'transmission': 'automatic',
 'trim': 'R-dynamic S',
 'year': 2019}
2026-01-29 06:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YA35276%27 HTTP/1.1" 200 None
2026-01-29 06:06:41 [auto1.fr] INFO: Saving data for YA35276: {'auction_closing_time': 1769705052.0, 'created_time': 1767600051.980524, 'last_price_update_time': 1769666801.85938}
2026-01-29 06:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YA35276') HTTP/1.1" 204 0
2026-01-29 06:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SB17449/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MP01789/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VS39820> (referer: https://www.auto1.com/v1/car-details-view/VS39820/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SS53107/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9df8192b-7cb5-54c7-b714-f20e6ff93a11 with identifier: VS39820
2026-01-29 06:06:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9df8192b-7cb5-54c7-b714-f20e6ff93a11 with scrape type 2
2026-01-29 06:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9df8192b-7cb5-54c7-b714-f20e6ff93a11 with scrape type 2
2026-01-29 06:06:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9df8192b-7cb5-54c7-b714-f20e6ff93a11, identifier: VS39820
2026-01-29 06:06:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9df8192b-7cb5-54c7-b714-f20e6ff93a11 with identifier: VS39820
2026-01-29 06:06:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9df8192b-7cb5-54c7-b714-f20e6ff93a11 with identifier: VS39820
2026-01-29 06:06:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9df8192b-7cb5-54c7-b714-f20e6ff93a11 with identifier: VS39820 to the API
2026-01-29 06:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:06:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:06:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VS39820>
{'auction_title': '',
 'c_o_2_emission_value': 72,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'engine_horse_power': 122,
 'expiration_date': '2026-01-29T16:11:15Z',
 'fuel_type': 'hybrid',
 'id': '9df8192b-7cb5-54c7-b714-f20e6ff93a11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS39820',
 'listing': 'auction',
 'location': 'FR, MOUGINS',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 121574,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota C-HR 1.8 Hybrid Graphic',
 'transmission': 'automatic',
 'trim': 'Graphic',
 'year': 2018}
2026-01-29 06:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS39820%27 HTTP/1.1" 200 None
2026-01-29 06:06:46 [auto1.fr] INFO: Saving data for VS39820: {'auction_closing_time': 1769703075.0, 'created_time': 1769533685.706613, 'last_price_update_time': 1769666806.877533}
2026-01-29 06:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VS39820') HTTP/1.1" 204 0
2026-01-29 06:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NR37380/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FL56179> (referer: https://www.auto1.com/v1/car-details-view/FL56179/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4acb7dd5-21a9-58a1-b209-6559cc0d1b5e with identifier: FL56179
2026-01-29 06:06:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4acb7dd5-21a9-58a1-b209-6559cc0d1b5e with scrape type 2
2026-01-29 06:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4acb7dd5-21a9-58a1-b209-6559cc0d1b5e with scrape type 2
2026-01-29 06:06:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4acb7dd5-21a9-58a1-b209-6559cc0d1b5e, identifier: FL56179
2026-01-29 06:06:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4acb7dd5-21a9-58a1-b209-6559cc0d1b5e with identifier: FL56179
2026-01-29 06:06:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4acb7dd5-21a9-58a1-b209-6559cc0d1b5e with identifier: FL56179
2026-01-29 06:06:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4acb7dd5-21a9-58a1-b209-6559cc0d1b5e with identifier: FL56179 to the API
2026-01-29 06:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:06:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:06:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FL56179>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 155,
 'expiration_date': '2026-01-29T16:58:52Z',
 'fuel_type': 'petrol',
 'id': '4acb7dd5-21a9-58a1-b209-6559cc0d1b5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL56179',
 'listing': 'auction',
 'location': 'FR, Marckolsheim',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 89712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line X',
 'transmission': 'manual',
 'trim': 'ST-Line X',
 'year': 2020}
2026-01-29 06:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FL56179%27 HTTP/1.1" 200 None
2026-01-29 06:06:48 [auto1.fr] INFO: Saving data for FL56179: {'auction_closing_time': 1769705932.0, 'created_time': 1767719279.443395, 'last_price_update_time': 1769666808.918057}
2026-01-29 06:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FL56179') HTTP/1.1" 204 0
2026-01-29 06:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NZ43148> (referer: https://www.auto1.com/v1/car-details-view/NZ43148/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CS76950> (referer: https://www.auto1.com/v1/car-details-view/CS76950/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51429e10-1e45-5084-aef7-d6568e70b306 with identifier: NZ43148
2026-01-29 06:06:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51429e10-1e45-5084-aef7-d6568e70b306 with scrape type 2
2026-01-29 06:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51429e10-1e45-5084-aef7-d6568e70b306 with scrape type 2
2026-01-29 06:06:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 51429e10-1e45-5084-aef7-d6568e70b306, identifier: NZ43148
2026-01-29 06:06:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 51429e10-1e45-5084-aef7-d6568e70b306 with identifier: NZ43148
2026-01-29 06:06:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 51429e10-1e45-5084-aef7-d6568e70b306 with identifier: NZ43148
2026-01-29 06:06:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 51429e10-1e45-5084-aef7-d6568e70b306 with identifier: NZ43148 to the API
2026-01-29 06:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:06:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NZ43148>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:08:45Z',
 'fuel_type': 'diesel',
 'id': '51429e10-1e45-5084-aef7-d6568e70b306',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ43148',
 'listing': 'auction',
 'location': 'FR, Ambarès-et-Lagrave',
 'make': 'DS Automobiles',
 'model': 'DS7 Crossback',
 'odometer': 114924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS Automobiles DS7 Crossback 1.5 Blue-HDi Grand Chic',
 'transmission': 'automatic',
 'trim': 'Grand Chic',
 'year': 2020}
2026-01-29 06:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NZ43148%27 HTTP/1.1" 200 None
2026-01-29 06:06:49 [auto1.fr] INFO: Saving data for NZ43148: {'auction_closing_time': 1769702925.0, 'created_time': 1769533751.454195, 'last_price_update_time': 1769666809.498081}
2026-01-29 06:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NZ43148') HTTP/1.1" 204 0
2026-01-29 06:06:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a98ed3b-6f92-5e42-8ebb-75bbacf1c6d2 with identifier: CS76950
2026-01-29 06:06:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a98ed3b-6f92-5e42-8ebb-75bbacf1c6d2 with scrape type 2
2026-01-29 06:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a98ed3b-6f92-5e42-8ebb-75bbacf1c6d2 with scrape type 2
2026-01-29 06:06:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4a98ed3b-6f92-5e42-8ebb-75bbacf1c6d2, identifier: CS76950
2026-01-29 06:06:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4a98ed3b-6f92-5e42-8ebb-75bbacf1c6d2 with identifier: CS76950
2026-01-29 06:06:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4a98ed3b-6f92-5e42-8ebb-75bbacf1c6d2 with identifier: CS76950
2026-01-29 06:06:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4a98ed3b-6f92-5e42-8ebb-75bbacf1c6d2 with identifier: CS76950 to the API
2026-01-29 06:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:06:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CS76950>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:17:42Z',
 'fuel_type': 'petrol',
 'id': '4a98ed3b-6f92-5e42-8ebb-75bbacf1c6d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS76950',
 'listing': 'auction',
 'location': 'FR, Nanteuil-le-Haudouin',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 112088,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Kamiq 1.0 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2021}
2026-01-29 06:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CS76950%27 HTTP/1.1" 200 None
2026-01-29 06:06:49 [auto1.fr] INFO: Saving data for CS76950: {'auction_closing_time': 1769703462.0, 'created_time': 1769580168.484039, 'last_price_update_time': 1769666809.99252}
2026-01-29 06:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CS76950') HTTP/1.1" 204 0
2026-01-29 06:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XD52399> (referer: https://www.auto1.com/v1/car-details-view/XD52399/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9161642e-21f5-54d7-9cd9-e2381f92c9b2 with identifier: XD52399
2026-01-29 06:06:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9161642e-21f5-54d7-9cd9-e2381f92c9b2 with scrape type 2
2026-01-29 06:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9161642e-21f5-54d7-9cd9-e2381f92c9b2 with scrape type 2
2026-01-29 06:06:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9161642e-21f5-54d7-9cd9-e2381f92c9b2, identifier: XD52399
2026-01-29 06:06:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9161642e-21f5-54d7-9cd9-e2381f92c9b2 with identifier: XD52399
2026-01-29 06:06:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9161642e-21f5-54d7-9cd9-e2381f92c9b2 with identifier: XD52399
2026-01-29 06:06:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel corsa 1.2 turbo edition', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'corsa', 'transmission': 'manual', 'odometer': 70782, 'odometer_reading_unit': 'km', 'registration_date': '2020-12-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xd52399', 'expiration_date': '2026-01-29t16:45:08z', 'origin_country_code': 'fr', 'trim': 'edition', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, mulhouse', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 117, 'id': '9161642e-21f5-54d7-9cd9-e2381f92c9b2', 'current_year_diff': 6, 'age_in_months': 61, 'make_model': 'opel corsa', 'sanitized_make': 'opel', 'odometer_in_km': 70782}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 61,
     'auction_title': '',
     'c_o_2_emission_value': 117,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:45:08z',
     'fuel_type': 'petrol',
     'id': '9161642e-21f5-54d7-9cd9-e2381f92c9b2',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xd52399',
     'listing': 'auction',
     'location': 'fr, mulhouse',
     'make': 'opel',
     'make_model': 'opel corsa',
     'model': 'corsa',
     'odometer': 70782,
     'odometer_in_km': 70782,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-12-29',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel corsa 1.2 turbo edition',
     'transmission': 'manual',
     'trim': 'edition',
     'year': 2020}
2026-01-29 06:06:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 9161642e-21f5-54d7-9cd9-e2381f92c9b2 spider: auto1.fr
2026-01-29 06:06:50 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 9161642e-21f5-54d7-9cd9-e2381f92c9b2 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel corsa 1.2 turbo edition', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'corsa', 'transmission': 'manual', 'odometer': 70782, 'odometer_reading_unit': 'km', 'registration_date': '2020-12-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xd52399', 'expiration_date': '2026-01-29t16:45:08z', 'origin_country_code': 'fr', 'trim': 'edition', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, mulhouse', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 117, 'id': '9161642e-21f5-54d7-9cd9-e2381f92c9b2', 'current_year_diff': 6, 'age_in_months': 61, 'make_model': 'opel corsa', 'sanitized_make': 'opel', 'odometer_in_km': 70782}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 61,
     'auction_title': '',
     'c_o_2_emission_value': 117,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:45:08z',
     'fuel_type': 'petrol',
     'id': '9161642e-21f5-54d7-9cd9-e2381f92c9b2',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xd52399',
     'listing': 'auction',
     'location': 'fr, mulhouse',
     'make': 'opel',
     'make_model': 'opel corsa',
     'model': 'corsa',
     'odometer': 70782,
     'odometer_in_km': 70782,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-12-29',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel corsa 1.2 turbo edition',
     'transmission': 'manual',
     'trim': 'edition',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:45:08Z',
 'fuel_type': 'petrol',
 'id': '9161642e-21f5-54d7-9cd9-e2381f92c9b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD52399',
 'listing': 'auction',
 'location': 'FR, Mulhouse',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 70782,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Turbo Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2020}
2026-01-29 06:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XD52399%27 HTTP/1.1" 200 None
2026-01-29 06:06:50 [auto1.fr] INFO: Saving data for XD52399: {'auction_closing_time': 1769705108.0, 'created_time': 1769533443.517419, 'last_price_update_time': 1769666810.712504}
2026-01-29 06:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XD52399') HTTP/1.1" 204 0
2026-01-29 06:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UA37857> (referer: https://www.auto1.com/v1/car-details-view/UA37857/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DC96528> (referer: https://www.auto1.com/v1/car-details-view/DC96528/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3246522a-4319-5da8-9d99-a163c9549a39 with identifier: UA37857
2026-01-29 06:06:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3246522a-4319-5da8-9d99-a163c9549a39 with scrape type 2
2026-01-29 06:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3246522a-4319-5da8-9d99-a163c9549a39 with scrape type 2
2026-01-29 06:06:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3246522a-4319-5da8-9d99-a163c9549a39, identifier: UA37857
2026-01-29 06:06:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3246522a-4319-5da8-9d99-a163c9549a39 with identifier: UA37857
2026-01-29 06:06:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3246522a-4319-5da8-9d99-a163c9549a39 with identifier: UA37857
2026-01-29 06:06:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3246522a-4319-5da8-9d99-a163c9549a39 with identifier: UA37857 to the API
2026-01-29 06:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:06:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:06:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UA37857>
{'auction_title': '',
 'c_o_2_emission_value': 5,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:26:10Z',
 'fuel_type': 'electro',
 'id': '3246522a-4319-5da8-9d99-a163c9549a39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA37857',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 28025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 electric drive 100 kW e GT',
 'transmission': 'automatic',
 'trim': 'e GT',
 'year': 2021}
2026-01-29 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UA37857%27 HTTP/1.1" 200 None
2026-01-29 06:06:51 [auto1.fr] INFO: Saving data for UA37857: {'auction_closing_time': 1769703970.0, 'created_time': 1769533873.449606, 'last_price_update_time': 1769666811.299531}
2026-01-29 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UA37857') HTTP/1.1" 204 0
2026-01-29 06:06:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0bf3b7c-f782-53bd-a5ea-0b08d7e45a79 with identifier: DC96528
2026-01-29 06:06:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0bf3b7c-f782-53bd-a5ea-0b08d7e45a79 with scrape type 2
2026-01-29 06:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0bf3b7c-f782-53bd-a5ea-0b08d7e45a79 with scrape type 2
2026-01-29 06:06:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c0bf3b7c-f782-53bd-a5ea-0b08d7e45a79, identifier: DC96528
2026-01-29 06:06:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c0bf3b7c-f782-53bd-a5ea-0b08d7e45a79 with identifier: DC96528
2026-01-29 06:06:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c0bf3b7c-f782-53bd-a5ea-0b08d7e45a79 with identifier: DC96528
2026-01-29 06:06:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 183394 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    183394
2026-01-29 06:06:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c0bf3b7c-f782-53bd-a5ea-0b08d7e45a79 spider: auto1.fr
2026-01-29 06:06:51 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: c0bf3b7c-f782-53bd-a5ea-0b08d7e45a79 due to rule: high_mileage_for_country.json, error: 183394 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    183394
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': 'Taxi',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2026-01-29T16:34:09Z',
 'fuel_type': 'diesel',
 'id': 'c0bf3b7c-f782-53bd-a5ea-0b08d7e45a79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC96528',
 'listing': 'auction',
 'location': 'FR, Villenoy',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 183394,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Energy Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2019}
2026-01-29 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DC96528%27 HTTP/1.1" 200 None
2026-01-29 06:06:51 [auto1.fr] INFO: Saving data for DC96528: {'auction_closing_time': 1769704449.0, 'created_time': 1768890992.781216, 'last_price_update_time': 1769666811.630398}
2026-01-29 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DC96528') HTTP/1.1" 204 0
2026-01-29 06:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YS99236> (referer: https://www.auto1.com/v1/car-details-view/YS99236/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e46b8fb-5f43-5152-8405-134ff0458449 with identifier: YS99236
2026-01-29 06:06:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e46b8fb-5f43-5152-8405-134ff0458449 with scrape type 2
2026-01-29 06:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e46b8fb-5f43-5152-8405-134ff0458449 with scrape type 2
2026-01-29 06:06:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8e46b8fb-5f43-5152-8405-134ff0458449, identifier: YS99236
2026-01-29 06:06:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8e46b8fb-5f43-5152-8405-134ff0458449 with identifier: YS99236
2026-01-29 06:06:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8e46b8fb-5f43-5152-8405-134ff0458449 with identifier: YS99236
2026-01-29 06:06:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8e46b8fb-5f43-5152-8405-134ff0458449 with identifier: YS99236 to the API
2026-01-29 06:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:06:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:06:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YS99236>
{'auction_title': '',
 'c_o_2_emission_value': 36,
 'category': 'Taxi',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 252,
 'expiration_date': '2026-01-29T16:15:58Z',
 'fuel_type': 'hybrid',
 'id': '8e46b8fb-5f43-5152-8405-134ff0458449',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS99236',
 'listing': 'auction',
 'location': 'FR, Marly-la-ville',
 'make': 'BMW',
 'model': '5er',
 'odometer': 145747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 530e',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-01-29 06:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS99236%27 HTTP/1.1" 200 None
2026-01-29 06:06:52 [auto1.fr] INFO: Saving data for YS99236: {'auction_closing_time': 1769703358.0, 'created_time': 1769533445.801805, 'last_price_update_time': 1769666812.167241}
2026-01-29 06:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YS99236') HTTP/1.1" 204 0
2026-01-29 06:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MP01789> (referer: https://www.auto1.com/v1/car-details-view/MP01789/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5f6d55d-79ae-515f-adac-4ee37abb46af with identifier: MP01789
2026-01-29 06:06:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5f6d55d-79ae-515f-adac-4ee37abb46af with scrape type 2
2026-01-29 06:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5f6d55d-79ae-515f-adac-4ee37abb46af with scrape type 2
2026-01-29 06:06:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b5f6d55d-79ae-515f-adac-4ee37abb46af, identifier: MP01789
2026-01-29 06:06:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b5f6d55d-79ae-515f-adac-4ee37abb46af with identifier: MP01789
2026-01-29 06:06:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b5f6d55d-79ae-515f-adac-4ee37abb46af with identifier: MP01789
2026-01-29 06:06:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b5f6d55d-79ae-515f-adac-4ee37abb46af with identifier: MP01789 to the API
2026-01-29 06:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:06:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:06:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MP01789>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:57:15Z',
 'fuel_type': 'petrol',
 'id': 'b5f6d55d-79ae-515f-adac-4ee37abb46af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP01789',
 'listing': 'auction',
 'location': 'FR, Boulogne-Billancourt',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 8112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Confortline Business',
 'transmission': 'automatic',
 'trim': 'Confortline Business',
 'year': 2018}
2026-01-29 06:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP01789%27 HTTP/1.1" 200 None
2026-01-29 06:06:52 [auto1.fr] INFO: Saving data for MP01789: {'auction_closing_time': 1769705835.0, 'created_time': 1769533795.91923, 'last_price_update_time': 1769666812.930994}
2026-01-29 06:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MP01789') HTTP/1.1" 204 0
2026-01-29 06:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YL56654/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SS53107> (referer: https://www.auto1.com/v1/car-details-view/SS53107/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 747dac40-4d12-5e63-a7f4-78c993a2303e with identifier: SS53107
2026-01-29 06:06:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 747dac40-4d12-5e63-a7f4-78c993a2303e with scrape type 2
2026-01-29 06:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 747dac40-4d12-5e63-a7f4-78c993a2303e with scrape type 2
2026-01-29 06:06:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 747dac40-4d12-5e63-a7f4-78c993a2303e, identifier: SS53107
2026-01-29 06:06:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 747dac40-4d12-5e63-a7f4-78c993a2303e with identifier: SS53107
2026-01-29 06:06:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 747dac40-4d12-5e63-a7f4-78c993a2303e with identifier: SS53107
2026-01-29 06:06:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 163115 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    163115
2026-01-29 06:06:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 747dac40-4d12-5e63-a7f4-78c993a2303e spider: auto1.fr
2026-01-29 06:06:54 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 747dac40-4d12-5e63-a7f4-78c993a2303e due to rule: high_mileage_for_country.json, error: 163115 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    163115
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:14:21Z',
 'fuel_type': 'diesel',
 'id': '747dac40-4d12-5e63-a7f4-78c993a2303e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS53107',
 'listing': 'auction',
 'location': 'FR, Saint-Saulve',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 163115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC40 2.0 D4 Inscription Luxe AWD',
 'transmission': 'automatic',
 'trim': 'Inscription Luxe AWD',
 'year': 2018}
2026-01-29 06:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SS53107%27 HTTP/1.1" 200 None
2026-01-29 06:06:54 [auto1.fr] INFO: Saving data for SS53107: {'auction_closing_time': 1769703261.0, 'created_time': 1769061947.010128, 'last_price_update_time': 1769666814.331548}
2026-01-29 06:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SS53107') HTTP/1.1" 204 0
2026-01-29 06:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BH31485/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FW91017/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JN53316/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NR37380> (referer: https://www.auto1.com/v1/car-details-view/NR37380/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:06:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:06:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79cf2923-7a15-5eb8-9ad1-10f211874184 with identifier: NR37380
2026-01-29 06:06:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79cf2923-7a15-5eb8-9ad1-10f211874184 with scrape type 2
2026-01-29 06:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79cf2923-7a15-5eb8-9ad1-10f211874184 with scrape type 2
2026-01-29 06:07:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 79cf2923-7a15-5eb8-9ad1-10f211874184, identifier: NR37380
2026-01-29 06:07:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 79cf2923-7a15-5eb8-9ad1-10f211874184 with identifier: NR37380
2026-01-29 06:07:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 79cf2923-7a15-5eb8-9ad1-10f211874184 with identifier: NR37380
2026-01-29 06:07:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2026-01-29 06:07:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 79cf2923-7a15-5eb8-9ad1-10f211874184 spider: auto1.fr
2026-01-29 06:07:00 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 79cf2923-7a15-5eb8-9ad1-10f211874184 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 99,
 'expiration_date': '2026-01-29T16:09:48Z',
 'fuel_type': 'diesel',
 'id': '79cf2923-7a15-5eb8-9ad1-10f211874184',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR37380',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 143867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-14',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Blue-HDi Club M',
 'transmission': 'manual',
 'trim': 'Club M',
 'year': 2019}
2026-01-29 06:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NR37380%27 HTTP/1.1" 200 None
2026-01-29 06:07:00 [auto1.fr] INFO: Saving data for NR37380: {'auction_closing_time': 1769702988.0, 'created_time': 1768842343.427364, 'last_price_update_time': 1769666820.239942}
2026-01-29 06:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NR37380') HTTP/1.1" 204 0
2026-01-29 06:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YE32704/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YH64690/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RU03060/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KH14175/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AL09788/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KA95717/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EJ58259/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PD18148/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SB17449> (referer: https://www.auto1.com/v1/car-details-view/SB17449/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 358bf0b4-1348-56cb-a245-5fc08d43f2e4 with identifier: SB17449
2026-01-29 06:07:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 358bf0b4-1348-56cb-a245-5fc08d43f2e4 with scrape type 2
2026-01-29 06:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 358bf0b4-1348-56cb-a245-5fc08d43f2e4 with scrape type 2
2026-01-29 06:07:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 358bf0b4-1348-56cb-a245-5fc08d43f2e4, identifier: SB17449
2026-01-29 06:07:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 358bf0b4-1348-56cb-a245-5fc08d43f2e4 with identifier: SB17449
2026-01-29 06:07:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 358bf0b4-1348-56cb-a245-5fc08d43f2e4 with identifier: SB17449
2026-01-29 06:07:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c5 x 1.2 puretech feel pack', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c5 x', 'transmission': 'automatic', 'odometer': 44585, 'odometer_reading_unit': 'km', 'registration_date': '2023-06-13', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sb17449', 'expiration_date': '2026-01-29t16:48:26z', 'origin_country_code': 'fr', 'trim': 'feel pack', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 137, 'id': '358bf0b4-1348-56cb-a245-5fc08d43f2e4', 'current_year_diff': 3, 'age_in_months': 31, 'make_model': 'citroen c5 x', 'sanitized_make': 'citroen', 'odometer_in_km': 44585}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 31,
     'auction_title': '',
     'c_o_2_emission_value': 137,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:48:26z',
     'fuel_type': 'petrol',
     'id': '358bf0b4-1348-56cb-a245-5fc08d43f2e4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sb17449',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'citroen',
     'make_model': 'citroen c5 x',
     'model': 'c5 x',
     'odometer': 44585,
     'odometer_in_km': 44585,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-06-13',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c5 x 1.2 puretech feel pack',
     'transmission': 'automatic',
     'trim': 'feel pack',
     'year': 2023}
2026-01-29 06:07:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 358bf0b4-1348-56cb-a245-5fc08d43f2e4 spider: auto1.fr
2026-01-29 06:07:09 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 358bf0b4-1348-56cb-a245-5fc08d43f2e4 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c5 x 1.2 puretech feel pack', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c5 x', 'transmission': 'automatic', 'odometer': 44585, 'odometer_reading_unit': 'km', 'registration_date': '2023-06-13', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sb17449', 'expiration_date': '2026-01-29t16:48:26z', 'origin_country_code': 'fr', 'trim': 'feel pack', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 137, 'id': '358bf0b4-1348-56cb-a245-5fc08d43f2e4', 'current_year_diff': 3, 'age_in_months': 31, 'make_model': 'citroen c5 x', 'sanitized_make': 'citroen', 'odometer_in_km': 44585}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 31,
     'auction_title': '',
     'c_o_2_emission_value': 137,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:48:26z',
     'fuel_type': 'petrol',
     'id': '358bf0b4-1348-56cb-a245-5fc08d43f2e4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sb17449',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'citroen',
     'make_model': 'citroen c5 x',
     'model': 'c5 x',
     'odometer': 44585,
     'odometer_in_km': 44585,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-06-13',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c5 x 1.2 puretech feel pack',
     'transmission': 'automatic',
     'trim': 'feel pack',
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:48:26Z',
 'fuel_type': 'petrol',
 'id': '358bf0b4-1348-56cb-a245-5fc08d43f2e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB17449',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Citroen',
 'model': 'C5 X',
 'odometer': 44585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-06-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 X 1.2 PureTech Feel Pack',
 'transmission': 'automatic',
 'trim': 'Feel Pack',
 'year': 2023}
2026-01-29 06:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SB17449%27 HTTP/1.1" 200 None
2026-01-29 06:07:09 [auto1.fr] INFO: Saving data for SB17449: {'auction_closing_time': 1769705306.0, 'created_time': 1769533863.544109, 'last_price_update_time': 1769666829.486183}
2026-01-29 06:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SB17449') HTTP/1.1" 204 0
2026-01-29 06:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YL56654> (referer: https://www.auto1.com/v1/car-details-view/YL56654/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fab7692e-6dc9-5a89-818f-04568595e816 with identifier: YL56654
2026-01-29 06:07:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fab7692e-6dc9-5a89-818f-04568595e816 with scrape type 2
2026-01-29 06:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fab7692e-6dc9-5a89-818f-04568595e816 with scrape type 2
2026-01-29 06:07:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fab7692e-6dc9-5a89-818f-04568595e816, identifier: YL56654
2026-01-29 06:07:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fab7692e-6dc9-5a89-818f-04568595e816 with identifier: YL56654
2026-01-29 06:07:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fab7692e-6dc9-5a89-818f-04568595e816 with identifier: YL56654
2026-01-29 06:07:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 142990 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    142990
2026-01-29 06:07:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: fab7692e-6dc9-5a89-818f-04568595e816 spider: auto1.fr
2026-01-29 06:07:09 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: fab7692e-6dc9-5a89-818f-04568595e816 due to rule: high_mileage_for_make.json, error: 142990 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    142990
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 135,
 'expiration_date': '2026-01-29T16:28:53Z',
 'fuel_type': 'petrol',
 'id': 'fab7692e-6dc9-5a89-818f-04568595e816',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL56654',
 'listing': 'auction',
 'location': 'FR, Houecourt',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 142990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Clubman Cooper',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-01-29 06:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YL56654%27 HTTP/1.1" 200 None
2026-01-29 06:07:09 [auto1.fr] INFO: Saving data for YL56654: {'auction_closing_time': 1769704133.0, 'created_time': 1769533853.225732, 'last_price_update_time': 1769666829.935555}
2026-01-29 06:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YL56654') HTTP/1.1" 204 0
2026-01-29 06:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GA39306/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FW91017> (referer: https://www.auto1.com/v1/car-details-view/FW91017/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BH31485> (referer: https://www.auto1.com/v1/car-details-view/BH31485/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b45c9244-96ec-5120-84e6-ed2e5836485a with identifier: FW91017
2026-01-29 06:07:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b45c9244-96ec-5120-84e6-ed2e5836485a with scrape type 2
2026-01-29 06:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b45c9244-96ec-5120-84e6-ed2e5836485a with scrape type 2
2026-01-29 06:07:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b45c9244-96ec-5120-84e6-ed2e5836485a, identifier: FW91017
2026-01-29 06:07:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b45c9244-96ec-5120-84e6-ed2e5836485a with identifier: FW91017
2026-01-29 06:07:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b45c9244-96ec-5120-84e6-ed2e5836485a with identifier: FW91017
2026-01-29 06:07:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b45c9244-96ec-5120-84e6-ed2e5836485a with identifier: FW91017 to the API
2026-01-29 06:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:07:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:07:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FW91017>
{'auction_title': '',
 'c_o_2_emission_value': 30,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 299,
 'expiration_date': '2026-01-29T16:08:28Z',
 'fuel_type': 'hybrid',
 'id': 'b45c9244-96ec-5120-84e6-ed2e5836485a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW91017',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 67406,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Hybrid GT Pack',
 'transmission': 'automatic',
 'trim': 'GT Pack',
 'year': 2021}
2026-01-29 06:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FW91017%27 HTTP/1.1" 200 None
2026-01-29 06:07:12 [auto1.fr] INFO: Saving data for FW91017: {'auction_closing_time': 1769702908.0, 'created_time': 1768670016.366642, 'last_price_update_time': 1769666832.170761}
2026-01-29 06:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FW91017') HTTP/1.1" 204 0
2026-01-29 06:07:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 185fbc39-6df3-515c-ae28-c4f2f6106abe with identifier: BH31485
2026-01-29 06:07:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 185fbc39-6df3-515c-ae28-c4f2f6106abe with scrape type 2
2026-01-29 06:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 185fbc39-6df3-515c-ae28-c4f2f6106abe with scrape type 2
2026-01-29 06:07:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 185fbc39-6df3-515c-ae28-c4f2f6106abe, identifier: BH31485
2026-01-29 06:07:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 185fbc39-6df3-515c-ae28-c4f2f6106abe with identifier: BH31485
2026-01-29 06:07:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 185fbc39-6df3-515c-ae28-c4f2f6106abe with identifier: BH31485
2026-01-29 06:07:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 vti feel business', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 72767, 'odometer_reading_unit': 'km', 'registration_date': '2018-03-19', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/bh31485', 'expiration_date': '2026-01-29t16:21:14z', 'origin_country_code': 'fr', 'trim': 'feel business', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': '185fbc39-6df3-515c-ae28-c4f2f6106abe', 'current_year_diff': 8, 'age_in_months': 94, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 72767}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 94,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:21:14z',
     'fuel_type': 'petrol',
     'id': '185fbc39-6df3-515c-ae28-c4f2f6106abe',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/bh31485',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 72767,
     'odometer_in_km': 72767,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-03-19',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 vti feel business',
     'transmission': 'manual',
     'trim': 'feel business',
     'year': 2018}
2026-01-29 06:07:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 185fbc39-6df3-515c-ae28-c4f2f6106abe spider: auto1.fr
2026-01-29 06:07:12 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 185fbc39-6df3-515c-ae28-c4f2f6106abe due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 vti feel business', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 72767, 'odometer_reading_unit': 'km', 'registration_date': '2018-03-19', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/bh31485', 'expiration_date': '2026-01-29t16:21:14z', 'origin_country_code': 'fr', 'trim': 'feel business', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': '185fbc39-6df3-515c-ae28-c4f2f6106abe', 'current_year_diff': 8, 'age_in_months': 94, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 72767}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 94,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:21:14z',
     'fuel_type': 'petrol',
     'id': '185fbc39-6df3-515c-ae28-c4f2f6106abe',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/bh31485',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 72767,
     'odometer_in_km': 72767,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-03-19',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 vti feel business',
     'transmission': 'manual',
     'trim': 'feel business',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:21:14Z',
 'fuel_type': 'petrol',
 'id': '185fbc39-6df3-515c-ae28-c4f2f6106abe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH31485',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 72767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 VTi Feel Business',
 'transmission': 'manual',
 'trim': 'Feel Business',
 'year': 2018}
2026-01-29 06:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BH31485%27 HTTP/1.1" 200 None
2026-01-29 06:07:12 [auto1.fr] INFO: Saving data for BH31485: {'auction_closing_time': 1769703674.0, 'created_time': 1769533857.176166, 'last_price_update_time': 1769666832.526311}
2026-01-29 06:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BH31485') HTTP/1.1" 204 0
2026-01-29 06:07:12 [scrapy.extensions.logstats] INFO: Crawled 627 pages (at 82 pages/min), scraped 136 items (at 20 items/min)
2026-01-29 06:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JN53316> (referer: https://www.auto1.com/v1/car-details-view/JN53316/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HT98723/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 150e29b5-e6b5-59b8-a95c-29d22f129438 with identifier: JN53316
2026-01-29 06:07:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 150e29b5-e6b5-59b8-a95c-29d22f129438 with scrape type 2
2026-01-29 06:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 150e29b5-e6b5-59b8-a95c-29d22f129438 with scrape type 2
2026-01-29 06:07:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 150e29b5-e6b5-59b8-a95c-29d22f129438, identifier: JN53316
2026-01-29 06:07:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 150e29b5-e6b5-59b8-a95c-29d22f129438 with identifier: JN53316
2026-01-29 06:07:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 150e29b5-e6b5-59b8-a95c-29d22f129438 with identifier: JN53316
2026-01-29 06:07:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 150e29b5-e6b5-59b8-a95c-29d22f129438 with identifier: JN53316 to the API
2026-01-29 06:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:07:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:07:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JN53316>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:28:00Z',
 'fuel_type': 'electro',
 'id': '150e29b5-e6b5-59b8-a95c-29d22f129438',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN53316',
 'listing': 'auction',
 'location': 'FR, Anais',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 22700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-15',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Renault Twingo electric drive 60 kW Equilibre Electric',
 'transmission': 'automatic',
 'trim': 'Equilibre Electric',
 'year': 2022}
2026-01-29 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JN53316%27 HTTP/1.1" 200 None
2026-01-29 06:07:13 [auto1.fr] INFO: Saving data for JN53316: {'auction_closing_time': 1769704080.0, 'created_time': 1769580230.582576, 'last_price_update_time': 1769666833.767588}
2026-01-29 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JN53316') HTTP/1.1" 204 0
2026-01-29 06:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YG29717> (referer: https://www.auto1.com/v1/car-details-view/YG29717/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YE32704> (referer: https://www.auto1.com/v1/car-details-view/YE32704/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 455c5bc1-8818-536c-be88-92fb0673d18e with identifier: YG29717
2026-01-29 06:07:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 455c5bc1-8818-536c-be88-92fb0673d18e with scrape type 2
2026-01-29 06:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 455c5bc1-8818-536c-be88-92fb0673d18e with scrape type 2
2026-01-29 06:07:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 455c5bc1-8818-536c-be88-92fb0673d18e, identifier: YG29717
2026-01-29 06:07:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 455c5bc1-8818-536c-be88-92fb0673d18e with identifier: YG29717
2026-01-29 06:07:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 455c5bc1-8818-536c-be88-92fb0673d18e with identifier: YG29717
2026-01-29 06:07:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 455c5bc1-8818-536c-be88-92fb0673d18e with identifier: YG29717 to the API
2026-01-29 06:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:07:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:07:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YG29717>
{'auction_title': '',
 'c_o_2_emission_value': 86,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:59:10Z',
 'fuel_type': 'diesel',
 'id': '455c5bc1-8818-536c-be88-92fb0673d18e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG29717',
 'listing': 'auction',
 'location': 'LABEGE',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 50569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi Signature',
 'transmission': 'manual',
 'trim': 'Signature',
 'year': 2019}
2026-01-29 06:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG29717%27 HTTP/1.1" 200 None
2026-01-29 06:07:16 [auto1.fr] INFO: Saving data for YG29717: {'auction_closing_time': 1769705950.0, 'created_time': 1769533718.685243, 'last_price_update_time': 1769666836.602085}
2026-01-29 06:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YG29717') HTTP/1.1" 204 0
2026-01-29 06:07:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0279f25e-f81e-5ae5-a981-effc231eb264 with identifier: YE32704
2026-01-29 06:07:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0279f25e-f81e-5ae5-a981-effc231eb264 with scrape type 2
2026-01-29 06:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0279f25e-f81e-5ae5-a981-effc231eb264 with scrape type 2
2026-01-29 06:07:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0279f25e-f81e-5ae5-a981-effc231eb264, identifier: YE32704
2026-01-29 06:07:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0279f25e-f81e-5ae5-a981-effc231eb264 with identifier: YE32704
2026-01-29 06:07:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0279f25e-f81e-5ae5-a981-effc231eb264 with identifier: YE32704
2026-01-29 06:07:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0279f25e-f81e-5ae5-a981-effc231eb264 with identifier: YE32704 to the API
2026-01-29 06:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:07:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:07:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YE32704>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:22:06Z',
 'fuel_type': 'diesel',
 'id': '0279f25e-f81e-5ae5-a981-effc231eb264',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE32704',
 'listing': 'auction',
 'location': 'FR, Houecourt',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 148351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ateca 2.0 TDI Xcellence 4Drive',
 'transmission': 'automatic',
 'trim': 'Xcellence 4Drive',
 'year': 2018}
2026-01-29 06:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YE32704%27 HTTP/1.1" 200 None
2026-01-29 06:07:17 [auto1.fr] INFO: Saving data for YE32704: {'auction_closing_time': 1769703726.0, 'created_time': 1769534410.513199, 'last_price_update_time': 1769666837.056948}
2026-01-29 06:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YE32704') HTTP/1.1" 204 0
2026-01-29 06:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KA95717> (referer: https://www.auto1.com/v1/car-details-view/KA95717/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YH64690> (referer: https://www.auto1.com/v1/car-details-view/YH64690/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4658eeff-b954-51b9-980e-5816413f2e14 with identifier: KA95717
2026-01-29 06:07:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4658eeff-b954-51b9-980e-5816413f2e14 with scrape type 2
2026-01-29 06:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4658eeff-b954-51b9-980e-5816413f2e14 with scrape type 2
2026-01-29 06:07:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4658eeff-b954-51b9-980e-5816413f2e14, identifier: KA95717
2026-01-29 06:07:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4658eeff-b954-51b9-980e-5816413f2e14 with identifier: KA95717
2026-01-29 06:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4658eeff-b954-51b9-980e-5816413f2e14 with identifier: KA95717
2026-01-29 06:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'manual', 'odometer': 73383, 'odometer_reading_unit': 'km', 'registration_date': '2018-01-15', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ka95717', 'expiration_date': '2026-01-29t16:09:44z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'nice', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 117, 'id': '4658eeff-b954-51b9-980e-5816413f2e14', 'current_year_diff': 8, 'age_in_months': 96, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 73383}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 96,
     'auction_title': '',
     'c_o_2_emission_value': 117,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:09:44z',
     'fuel_type': 'petrol',
     'id': '4658eeff-b954-51b9-980e-5816413f2e14',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ka95717',
     'listing': 'auction',
     'location': 'nice',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 73383,
     'odometer_in_km': 73383,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-01-15',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2018}
2026-01-29 06:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 4658eeff-b954-51b9-980e-5816413f2e14 spider: auto1.fr
2026-01-29 06:07:17 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 4658eeff-b954-51b9-980e-5816413f2e14 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'manual', 'odometer': 73383, 'odometer_reading_unit': 'km', 'registration_date': '2018-01-15', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ka95717', 'expiration_date': '2026-01-29t16:09:44z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'nice', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 117, 'id': '4658eeff-b954-51b9-980e-5816413f2e14', 'current_year_diff': 8, 'age_in_months': 96, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 73383}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 96,
     'auction_title': '',
     'c_o_2_emission_value': 117,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:09:44z',
     'fuel_type': 'petrol',
     'id': '4658eeff-b954-51b9-980e-5816413f2e14',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ka95717',
     'listing': 'auction',
     'location': 'nice',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 73383,
     'odometer_in_km': 73383,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-01-15',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:09:44Z',
 'fuel_type': 'petrol',
 'id': '4658eeff-b954-51b9-980e-5816413f2e14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA95717',
 'listing': 'auction',
 'location': 'Nice',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 73383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2018}
2026-01-29 06:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KA95717%27 HTTP/1.1" 200 None
2026-01-29 06:07:17 [auto1.fr] INFO: Saving data for KA95717: {'auction_closing_time': 1769702984.0, 'created_time': 1769449343.897067, 'last_price_update_time': 1769666837.861121}
2026-01-29 06:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KA95717') HTTP/1.1" 204 0
2026-01-29 06:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KH14175> (referer: https://www.auto1.com/v1/car-details-view/KH14175/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TN58602/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6614610c-628e-5a46-9aa1-e30fc1cce427 with identifier: YH64690
2026-01-29 06:07:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6614610c-628e-5a46-9aa1-e30fc1cce427 with scrape type 2
2026-01-29 06:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6614610c-628e-5a46-9aa1-e30fc1cce427 with scrape type 2
2026-01-29 06:07:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6614610c-628e-5a46-9aa1-e30fc1cce427, identifier: YH64690
2026-01-29 06:07:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6614610c-628e-5a46-9aa1-e30fc1cce427 with identifier: YH64690
2026-01-29 06:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6614610c-628e-5a46-9aa1-e30fc1cce427 with identifier: YH64690
2026-01-29 06:07:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6614610c-628e-5a46-9aa1-e30fc1cce427 with identifier: YH64690 to the API
2026-01-29 06:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:07:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:07:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YH64690>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:19:05Z',
 'fuel_type': 'petrol',
 'id': '6614610c-628e-5a46-9aa1-e30fc1cce427',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH64690',
 'listing': 'auction',
 'location': 'FR, Marly-la-ville',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 69824,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q2 1.4 TFSI ACT S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2018}
2026-01-29 06:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YH64690%27 HTTP/1.1" 200 None
2026-01-29 06:07:18 [auto1.fr] INFO: Saving data for YH64690: {'auction_closing_time': 1769703545.0, 'created_time': 1769061847.830452, 'last_price_update_time': 1769666838.285568}
2026-01-29 06:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YH64690') HTTP/1.1" 204 0
2026-01-29 06:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EJ58259> (referer: https://www.auto1.com/v1/car-details-view/EJ58259/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9abe26cd-bd18-58fd-99db-1d0f9cfc8679 with identifier: KH14175
2026-01-29 06:07:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9abe26cd-bd18-58fd-99db-1d0f9cfc8679 with scrape type 2
2026-01-29 06:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9abe26cd-bd18-58fd-99db-1d0f9cfc8679 with scrape type 2
2026-01-29 06:07:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9abe26cd-bd18-58fd-99db-1d0f9cfc8679, identifier: KH14175
2026-01-29 06:07:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9abe26cd-bd18-58fd-99db-1d0f9cfc8679 with identifier: KH14175
2026-01-29 06:07:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9abe26cd-bd18-58fd-99db-1d0f9cfc8679 with identifier: KH14175
2026-01-29 06:07:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech gt pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 22637, 'odometer_reading_unit': 'km', 'registration_date': '2021-06-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kh14175', 'expiration_date': '2026-01-29t16:40:10z', 'origin_country_code': 'fr', 'trim': 'gt pack', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 136, 'id': '9abe26cd-bd18-58fd-99db-1d0f9cfc8679', 'current_year_diff': 5, 'age_in_months': 55, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 22637}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 55,
     'auction_title': '',
     'c_o_2_emission_value': 136,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:40:10z',
     'fuel_type': 'petrol',
     'id': '9abe26cd-bd18-58fd-99db-1d0f9cfc8679',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kh14175',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 22637,
     'odometer_in_km': 22637,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-06-23',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech gt pack',
     'transmission': 'automatic',
     'trim': 'gt pack',
     'year': 2021}
2026-01-29 06:07:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 9abe26cd-bd18-58fd-99db-1d0f9cfc8679 spider: auto1.fr
2026-01-29 06:07:18 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 9abe26cd-bd18-58fd-99db-1d0f9cfc8679 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech gt pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 22637, 'odometer_reading_unit': 'km', 'registration_date': '2021-06-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kh14175', 'expiration_date': '2026-01-29t16:40:10z', 'origin_country_code': 'fr', 'trim': 'gt pack', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 136, 'id': '9abe26cd-bd18-58fd-99db-1d0f9cfc8679', 'current_year_diff': 5, 'age_in_months': 55, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 22637}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 55,
     'auction_title': '',
     'c_o_2_emission_value': 136,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:40:10z',
     'fuel_type': 'petrol',
     'id': '9abe26cd-bd18-58fd-99db-1d0f9cfc8679',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kh14175',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 22637,
     'odometer_in_km': 22637,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-06-23',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech gt pack',
     'transmission': 'automatic',
     'trim': 'gt pack',
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:40:10Z',
 'fuel_type': 'petrol',
 'id': '9abe26cd-bd18-58fd-99db-1d0f9cfc8679',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH14175',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 22637,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech GT Pack',
 'transmission': 'automatic',
 'trim': 'GT Pack',
 'year': 2021}
2026-01-29 06:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH14175%27 HTTP/1.1" 200 None
2026-01-29 06:07:18 [auto1.fr] INFO: Saving data for KH14175: {'auction_closing_time': 1769704810.0, 'created_time': 1769533774.208451, 'last_price_update_time': 1769666838.603919}
2026-01-29 06:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KH14175') HTTP/1.1" 204 0
2026-01-29 06:07:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b710802-3a7b-55a5-8e3e-957c520649a5 with identifier: EJ58259
2026-01-29 06:07:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b710802-3a7b-55a5-8e3e-957c520649a5 with scrape type 2
2026-01-29 06:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b710802-3a7b-55a5-8e3e-957c520649a5 with scrape type 2
2026-01-29 06:07:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1b710802-3a7b-55a5-8e3e-957c520649a5, identifier: EJ58259
2026-01-29 06:07:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1b710802-3a7b-55a5-8e3e-957c520649a5 with identifier: EJ58259
2026-01-29 06:07:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1b710802-3a7b-55a5-8e3e-957c520649a5 with identifier: EJ58259
2026-01-29 06:07:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'jumper' containing 'jumper'
2026-01-29 06:07:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 1b710802-3a7b-55a5-8e3e-957c520649a5 spider: auto1.fr
2026-01-29 06:07:18 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 1b710802-3a7b-55a5-8e3e-957c520649a5 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'jumper' containing 'jumper'
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:04:07Z',
 'fuel_type': 'diesel',
 'id': '1b710802-3a7b-55a5-8e3e-957c520649a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ58259',
 'listing': 'auction',
 'location': 'FR, Ingrandes sur Vienne',
 'make': 'Citroen',
 'model': 'Jumper',
 'odometer': 80102,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-17',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Citroen Jumper 2.0 Blue-HDi 35 L2H2 Business',
 'transmission': 'manual',
 'trim': '35 L2H2 Business',
 'year': 2019}
2026-01-29 06:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EJ58259%27 HTTP/1.1" 200 None
2026-01-29 06:07:18 [auto1.fr] INFO: Saving data for EJ58259: {'auction_closing_time': 1769702647.0, 'created_time': 1769533828.77482, 'last_price_update_time': 1769666838.928875}
2026-01-29 06:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EJ58259') HTTP/1.1" 204 0
2026-01-29 06:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GA39306> (referer: https://www.auto1.com/v1/car-details-view/GA39306/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:19 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:07:19 [auto1.fr] INFO: Found listing with ID: NG09663
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NG09663%27 HTTP/1.1" 200 None
2026-01-29 06:07:19 [auto1.fr] INFO: Scrape type for NG09663: 2
2026-01-29 06:07:19 [auto1.fr] INFO: Found listing with ID: CG22715
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CG22715%27 HTTP/1.1" 200 None
2026-01-29 06:07:19 [auto1.fr] INFO: Scrape type for CG22715: 0
2026-01-29 06:07:19 [auto1.fr] INFO: Found listing with ID: YU81464
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YU81464%27 HTTP/1.1" 200 None
2026-01-29 06:07:19 [auto1.fr] INFO: Scrape type for YU81464: 2
2026-01-29 06:07:19 [auto1.fr] INFO: Found listing with ID: ZP82806
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP82806%27 HTTP/1.1" 200 None
2026-01-29 06:07:19 [auto1.fr] INFO: Scrape type for ZP82806: 2
2026-01-29 06:07:19 [auto1.fr] INFO: Found listing with ID: BM28211
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BM28211%27 HTTP/1.1" 200 None
2026-01-29 06:07:19 [auto1.fr] INFO: Scrape type for BM28211: 0
2026-01-29 06:07:19 [auto1.fr] INFO: Found listing with ID: FD94241
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FD94241%27 HTTP/1.1" 200 None
2026-01-29 06:07:19 [auto1.fr] INFO: Scrape type for FD94241: 0
2026-01-29 06:07:19 [auto1.fr] INFO: Found listing with ID: AB13106
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AB13106%27 HTTP/1.1" 200 None
2026-01-29 06:07:19 [auto1.fr] INFO: Scrape type for AB13106: 2
2026-01-29 06:07:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4c2e63b-62dd-5dcd-841e-f9886a0f8499 with identifier: GA39306
2026-01-29 06:07:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4c2e63b-62dd-5dcd-841e-f9886a0f8499 with scrape type 2
2026-01-29 06:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4c2e63b-62dd-5dcd-841e-f9886a0f8499 with scrape type 2
2026-01-29 06:07:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f4c2e63b-62dd-5dcd-841e-f9886a0f8499, identifier: GA39306
2026-01-29 06:07:19 [auto1.fr] INFO: Found listing with ID: PX90385
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX90385%27 HTTP/1.1" 200 None
2026-01-29 06:07:19 [auto1.fr] INFO: Scrape type for PX90385: 2
2026-01-29 06:07:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f4c2e63b-62dd-5dcd-841e-f9886a0f8499 with identifier: GA39306
2026-01-29 06:07:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f4c2e63b-62dd-5dcd-841e-f9886a0f8499 with identifier: GA39306
2026-01-29 06:07:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c4 x 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c4 x', 'transmission': 'automatic', 'odometer': 23397, 'odometer_reading_unit': 'km', 'registration_date': '2023-06-18', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ga39306', 'expiration_date': '2026-01-29t16:46:55z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 4, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 129, 'id': 'f4c2e63b-62dd-5dcd-841e-f9886a0f8499', 'current_year_diff': 3, 'age_in_months': 31, 'make_model': 'citroen c4 x', 'sanitized_make': 'citroen', 'odometer_in_km': 23397}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 31,
     'auction_title': '',
     'c_o_2_emission_value': 129,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 4,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:46:55z',
     'fuel_type': 'petrol',
     'id': 'f4c2e63b-62dd-5dcd-841e-f9886a0f8499',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ga39306',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'citroen',
     'make_model': 'citroen c4 x',
     'model': 'c4 x',
     'odometer': 23397,
     'odometer_in_km': 23397,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-06-18',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c4 x 1.2 puretech shine',
     'transmission': 'automatic',
     'trim': 'shine',
     'year': 2023}
2026-01-29 06:07:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: f4c2e63b-62dd-5dcd-841e-f9886a0f8499 spider: auto1.fr
2026-01-29 06:07:19 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: f4c2e63b-62dd-5dcd-841e-f9886a0f8499 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c4 x 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c4 x', 'transmission': 'automatic', 'odometer': 23397, 'odometer_reading_unit': 'km', 'registration_date': '2023-06-18', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ga39306', 'expiration_date': '2026-01-29t16:46:55z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 4, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 129, 'id': 'f4c2e63b-62dd-5dcd-841e-f9886a0f8499', 'current_year_diff': 3, 'age_in_months': 31, 'make_model': 'citroen c4 x', 'sanitized_make': 'citroen', 'odometer_in_km': 23397}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 31,
     'auction_title': '',
     'c_o_2_emission_value': 129,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 4,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:46:55z',
     'fuel_type': 'petrol',
     'id': 'f4c2e63b-62dd-5dcd-841e-f9886a0f8499',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ga39306',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'citroen',
     'make_model': 'citroen c4 x',
     'model': 'c4 x',
     'odometer': 23397,
     'odometer_in_km': 23397,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-06-18',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c4 x 1.2 puretech shine',
     'transmission': 'automatic',
     'trim': 'shine',
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:46:55Z',
 'fuel_type': 'petrol',
 'id': 'f4c2e63b-62dd-5dcd-841e-f9886a0f8499',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA39306',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Citroen',
 'model': 'C4 X',
 'odometer': 23397,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-06-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 X 1.2 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2023}
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GA39306%27 HTTP/1.1" 200 None
2026-01-29 06:07:19 [auto1.fr] INFO: Saving data for GA39306: {'auction_closing_time': 1769705215.0, 'created_time': 1769446824.512113, 'last_price_update_time': 1769666839.83466}
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GA39306') HTTP/1.1" 204 0
2026-01-29 06:07:19 [auto1.fr] INFO: Found listing with ID: KN18335
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KN18335%27 HTTP/1.1" 200 None
2026-01-29 06:07:19 [auto1.fr] INFO: Scrape type for KN18335: 0
2026-01-29 06:07:19 [auto1.fr] INFO: Found listing with ID: RK84609
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RK84609%27 HTTP/1.1" 200 None
2026-01-29 06:07:19 [auto1.fr] INFO: Scrape type for RK84609: 2
2026-01-29 06:07:19 [auto1.fr] INFO: Found listing with ID: XZ24718
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XZ24718%27 HTTP/1.1" 200 None
2026-01-29 06:07:19 [auto1.fr] INFO: Scrape type for XZ24718: 0
2026-01-29 06:07:19 [auto1.fr] INFO: Found listing with ID: LJ97195
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ97195%27 HTTP/1.1" 200 None
2026-01-29 06:07:19 [auto1.fr] INFO: Scrape type for LJ97195: 0
2026-01-29 06:07:19 [auto1.fr] INFO: Found listing with ID: MC36898
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC36898%27 HTTP/1.1" 200 None
2026-01-29 06:07:19 [auto1.fr] INFO: Scrape type for MC36898: 0
2026-01-29 06:07:19 [auto1.fr] INFO: Found listing with ID: YM21172
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YM21172%27 HTTP/1.1" 200 None
2026-01-29 06:07:19 [auto1.fr] INFO: Scrape type for YM21172: 0
2026-01-29 06:07:19 [auto1.fr] INFO: Found listing with ID: UX68890
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UX68890%27 HTTP/1.1" 200 None
2026-01-29 06:07:19 [auto1.fr] INFO: Scrape type for UX68890: 2
2026-01-29 06:07:19 [auto1.fr] INFO: Found listing with ID: SU20841
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SU20841%27 HTTP/1.1" 200 None
2026-01-29 06:07:19 [auto1.fr] INFO: Scrape type for SU20841: 2
2026-01-29 06:07:19 [auto1.fr] INFO: Found listing with ID: NW96598
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NW96598%27 HTTP/1.1" 200 None
2026-01-29 06:07:20 [auto1.fr] INFO: Scrape type for NW96598: 0
2026-01-29 06:07:20 [auto1.fr] INFO: Found listing with ID: FA65984
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FA65984%27 HTTP/1.1" 200 None
2026-01-29 06:07:20 [auto1.fr] INFO: Scrape type for FA65984: 0
2026-01-29 06:07:20 [auto1.fr] INFO: Found listing with ID: CU82747
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CU82747%27 HTTP/1.1" 200 None
2026-01-29 06:07:20 [auto1.fr] INFO: Scrape type for CU82747: 2
2026-01-29 06:07:20 [auto1.fr] INFO: Found listing with ID: JF75060
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JF75060%27 HTTP/1.1" 200 None
2026-01-29 06:07:20 [auto1.fr] INFO: Scrape type for JF75060: 0
2026-01-29 06:07:20 [auto1.fr] INFO: Found listing with ID: JB94762
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JB94762%27 HTTP/1.1" 200 None
2026-01-29 06:07:20 [auto1.fr] INFO: Scrape type for JB94762: 2
2026-01-29 06:07:20 [auto1.fr] INFO: Found listing with ID: XZ66050
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XZ66050%27 HTTP/1.1" 200 None
2026-01-29 06:07:20 [auto1.fr] INFO: Scrape type for XZ66050: 0
2026-01-29 06:07:20 [auto1.fr] INFO: Found listing with ID: CX19076
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CX19076%27 HTTP/1.1" 200 None
2026-01-29 06:07:20 [auto1.fr] INFO: Scrape type for CX19076: 0
2026-01-29 06:07:20 [auto1.fr] INFO: Found listing with ID: GP99101
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GP99101%27 HTTP/1.1" 200 None
2026-01-29 06:07:20 [auto1.fr] INFO: Scrape type for GP99101: 2
2026-01-29 06:07:20 [auto1.fr] INFO: Found listing with ID: EE76098
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EE76098%27 HTTP/1.1" 200 None
2026-01-29 06:07:20 [auto1.fr] INFO: Scrape type for EE76098: 2
2026-01-29 06:07:20 [auto1.fr] INFO: Found listing with ID: EL30673
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EL30673%27 HTTP/1.1" 200 None
2026-01-29 06:07:20 [auto1.fr] INFO: Scrape type for EL30673: 2
2026-01-29 06:07:20 [auto1.fr] INFO: Found listing with ID: JB23857
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JB23857%27 HTTP/1.1" 200 None
2026-01-29 06:07:20 [auto1.fr] INFO: Scrape type for JB23857: 2
2026-01-29 06:07:20 [auto1.fr] INFO: Found listing with ID: YP50881
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP50881%27 HTTP/1.1" 200 None
2026-01-29 06:07:20 [auto1.fr] INFO: Scrape type for YP50881: 2
2026-01-29 06:07:20 [auto1.fr] INFO: Found listing with ID: WW29549
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WW29549%27 HTTP/1.1" 200 None
2026-01-29 06:07:20 [auto1.fr] INFO: Scrape type for WW29549: 2
2026-01-29 06:07:20 [auto1.fr] INFO: Found listing with ID: UY43869
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY43869%27 HTTP/1.1" 200 None
2026-01-29 06:07:20 [auto1.fr] INFO: Scrape type for UY43869: 0
2026-01-29 06:07:20 [auto1.fr] INFO: Found listing with ID: PL29033
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PL29033%27 HTTP/1.1" 200 None
2026-01-29 06:07:20 [auto1.fr] INFO: Scrape type for PL29033: 0
2026-01-29 06:07:20 [auto1.fr] INFO: Found listing with ID: MS90300
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MS90300%27 HTTP/1.1" 200 None
2026-01-29 06:07:20 [auto1.fr] INFO: Scrape type for MS90300: 2
2026-01-29 06:07:20 [auto1.fr] INFO: Found listing with ID: JU22292
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JU22292%27 HTTP/1.1" 200 None
2026-01-29 06:07:20 [auto1.fr] INFO: Scrape type for JU22292: 0
2026-01-29 06:07:20 [auto1.fr] INFO: Found listing with ID: GP79855
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GP79855%27 HTTP/1.1" 200 None
2026-01-29 06:07:20 [auto1.fr] INFO: Scrape type for GP79855: 2
2026-01-29 06:07:20 [auto1.fr] INFO: Found listing with ID: TJ82667
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TJ82667%27 HTTP/1.1" 200 None
2026-01-29 06:07:20 [auto1.fr] INFO: Scrape type for TJ82667: 2
2026-01-29 06:07:20 [auto1.fr] INFO: Found listing with ID: RM32421
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM32421%27 HTTP/1.1" 200 None
2026-01-29 06:07:20 [auto1.fr] INFO: Scrape type for RM32421: 2
2026-01-29 06:07:20 [auto1.fr] INFO: Found listing with ID: AE77924
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AE77924%27 HTTP/1.1" 200 None
2026-01-29 06:07:20 [auto1.fr] INFO: Scrape type for AE77924: 0
2026-01-29 06:07:20 [auto1.fr] INFO: Found listing with ID: NX18590
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NX18590%27 HTTP/1.1" 200 None
2026-01-29 06:07:20 [auto1.fr] INFO: Scrape type for NX18590: 0
2026-01-29 06:07:20 [auto1.fr] INFO: Found listing with ID: HU31612
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HU31612%27 HTTP/1.1" 200 None
2026-01-29 06:07:20 [auto1.fr] INFO: Scrape type for HU31612: 0
2026-01-29 06:07:20 [auto1.fr] INFO: Found listing with ID: BN36421
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BN36421%27 HTTP/1.1" 200 None
2026-01-29 06:07:20 [auto1.fr] INFO: Scrape type for BN36421: 0
2026-01-29 06:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JM19604/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RU03060> (referer: https://www.auto1.com/v1/car-details-view/RU03060/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4d2ecf2-9a95-5356-aa92-97c5778b8930 with identifier: RU03060
2026-01-29 06:07:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4d2ecf2-9a95-5356-aa92-97c5778b8930 with scrape type 2
2026-01-29 06:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4d2ecf2-9a95-5356-aa92-97c5778b8930 with scrape type 2
2026-01-29 06:07:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a4d2ecf2-9a95-5356-aa92-97c5778b8930, identifier: RU03060
2026-01-29 06:07:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a4d2ecf2-9a95-5356-aa92-97c5778b8930 with identifier: RU03060
2026-01-29 06:07:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a4d2ecf2-9a95-5356-aa92-97c5778b8930 with identifier: RU03060
2026-01-29 06:07:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 169663 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169663
2026-01-29 06:07:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: a4d2ecf2-9a95-5356-aa92-97c5778b8930 spider: auto1.fr
2026-01-29 06:07:23 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: a4d2ecf2-9a95-5356-aa92-97c5778b8930 due to rule: high_mileage_for_country.json, error: 169663 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169663
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:50:37Z',
 'fuel_type': 'petrol',
 'id': 'a4d2ecf2-9a95-5356-aa92-97c5778b8930',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU03060',
 'listing': 'auction',
 'location': 'FR, Saint Aignan de Grandlieu',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 169663,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda Civic 1.0 VTEC Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2017}
2026-01-29 06:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RU03060%27 HTTP/1.1" 200 None
2026-01-29 06:07:23 [auto1.fr] INFO: Saving data for RU03060: {'auction_closing_time': 1769705437.0, 'created_time': 1768324886.485842, 'last_price_update_time': 1769666843.495019}
2026-01-29 06:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RU03060') HTTP/1.1" 204 0
2026-01-29 06:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HT98723> (referer: https://www.auto1.com/v1/car-details-view/HT98723/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fcd8fb3-5fe0-5f06-98bc-e6d716e36d7a with identifier: HT98723
2026-01-29 06:07:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fcd8fb3-5fe0-5f06-98bc-e6d716e36d7a with scrape type 2
2026-01-29 06:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2fcd8fb3-5fe0-5f06-98bc-e6d716e36d7a with scrape type 2
2026-01-29 06:07:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2fcd8fb3-5fe0-5f06-98bc-e6d716e36d7a, identifier: HT98723
2026-01-29 06:07:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2fcd8fb3-5fe0-5f06-98bc-e6d716e36d7a with identifier: HT98723
2026-01-29 06:07:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2fcd8fb3-5fe0-5f06-98bc-e6d716e36d7a with identifier: HT98723
2026-01-29 06:07:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech crossway', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 105958, 'odometer_reading_unit': 'km', 'registration_date': '2018-04-15', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ht98723', 'expiration_date': '2026-01-29t16:08:35z', 'origin_country_code': 'fr', 'trim': 'crossway', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marseille', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 110, 'id': '2fcd8fb3-5fe0-5f06-98bc-e6d716e36d7a', 'current_year_diff': 8, 'age_in_months': 93, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 105958}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 93,
     'auction_title': '',
     'c_o_2_emission_value': 110,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:08:35z',
     'fuel_type': 'petrol',
     'id': '2fcd8fb3-5fe0-5f06-98bc-e6d716e36d7a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ht98723',
     'listing': 'auction',
     'location': 'fr, marseille',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 105958,
     'odometer_in_km': 105958,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-04-15',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech crossway',
     'transmission': 'manual',
     'trim': 'crossway',
     'year': 2018}
2026-01-29 06:07:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 2fcd8fb3-5fe0-5f06-98bc-e6d716e36d7a spider: auto1.fr
2026-01-29 06:07:23 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 2fcd8fb3-5fe0-5f06-98bc-e6d716e36d7a due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech crossway', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 105958, 'odometer_reading_unit': 'km', 'registration_date': '2018-04-15', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ht98723', 'expiration_date': '2026-01-29t16:08:35z', 'origin_country_code': 'fr', 'trim': 'crossway', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marseille', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 110, 'id': '2fcd8fb3-5fe0-5f06-98bc-e6d716e36d7a', 'current_year_diff': 8, 'age_in_months': 93, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 105958}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 93,
     'auction_title': '',
     'c_o_2_emission_value': 110,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:08:35z',
     'fuel_type': 'petrol',
     'id': '2fcd8fb3-5fe0-5f06-98bc-e6d716e36d7a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ht98723',
     'listing': 'auction',
     'location': 'fr, marseille',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 105958,
     'odometer_in_km': 105958,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-04-15',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech crossway',
     'transmission': 'manual',
     'trim': 'crossway',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:08:35Z',
 'fuel_type': 'petrol',
 'id': '2fcd8fb3-5fe0-5f06-98bc-e6d716e36d7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT98723',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 105958,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Crossway',
 'transmission': 'manual',
 'trim': 'Crossway',
 'year': 2018}
2026-01-29 06:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HT98723%27 HTTP/1.1" 200 None
2026-01-29 06:07:24 [auto1.fr] INFO: Saving data for HT98723: {'auction_closing_time': 1769702915.0, 'created_time': 1769533642.328296, 'last_price_update_time': 1769666844.008514}
2026-01-29 06:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HT98723') HTTP/1.1" 204 0
2026-01-29 06:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FS95119/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UA20744/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AL09788> (referer: https://www.auto1.com/v1/car-details-view/AL09788/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f32287dd-8765-5098-88fc-4d042cb41a86 with identifier: AL09788
2026-01-29 06:07:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f32287dd-8765-5098-88fc-4d042cb41a86 with scrape type 2
2026-01-29 06:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f32287dd-8765-5098-88fc-4d042cb41a86 with scrape type 2
2026-01-29 06:07:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f32287dd-8765-5098-88fc-4d042cb41a86, identifier: AL09788
2026-01-29 06:07:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f32287dd-8765-5098-88fc-4d042cb41a86 with identifier: AL09788
2026-01-29 06:07:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f32287dd-8765-5098-88fc-4d042cb41a86 with identifier: AL09788
2026-01-29 06:07:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f32287dd-8765-5098-88fc-4d042cb41a86 with identifier: AL09788 to the API
2026-01-29 06:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:07:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:07:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AL09788>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 380,
 'expiration_date': '2026-01-29T16:48:06Z',
 'fuel_type': 'petrol',
 'id': 'f32287dd-8765-5098-88fc-4d042cb41a86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL09788',
 'listing': 'auction',
 'location': 'FR, Ambarès-et-Lagrave',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 117542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 45 AMG 4Matic Sport',
 'transmission': 'automatic',
 'trim': '4Matic Sport',
 'year': 2017}
2026-01-29 06:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AL09788%27 HTTP/1.1" 200 None
2026-01-29 06:07:25 [auto1.fr] INFO: Saving data for AL09788: {'auction_closing_time': 1769705286.0, 'created_time': 1769449916.25, 'last_price_update_time': 1769666845.454312}
2026-01-29 06:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AL09788') HTTP/1.1" 204 0
2026-01-29 06:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YU81464/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZP82806/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WV49919/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TN58602> (referer: https://www.auto1.com/v1/car-details-view/TN58602/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07d2d4c0-26f2-53da-acac-1ac168683368 with identifier: TN58602
2026-01-29 06:07:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07d2d4c0-26f2-53da-acac-1ac168683368 with scrape type 2
2026-01-29 06:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07d2d4c0-26f2-53da-acac-1ac168683368 with scrape type 2
2026-01-29 06:07:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 07d2d4c0-26f2-53da-acac-1ac168683368, identifier: TN58602
2026-01-29 06:07:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 07d2d4c0-26f2-53da-acac-1ac168683368 with identifier: TN58602
2026-01-29 06:07:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 07d2d4c0-26f2-53da-acac-1ac168683368 with identifier: TN58602
2026-01-29 06:07:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 e-vti exclusive', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'automatic', 'odometer': 52723, 'odometer_reading_unit': 'km', 'registration_date': '2017-02-19', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/tn58602', 'expiration_date': '2026-01-29t16:11:19z', 'origin_country_code': 'fr', 'trim': 'exclusive', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, warluis', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 99, 'id': '07d2d4c0-26f2-53da-acac-1ac168683368', 'current_year_diff': 9, 'age_in_months': 107, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 52723}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 107,
     'auction_title': '',
     'c_o_2_emission_value': 99,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:11:19z',
     'fuel_type': 'petrol',
     'id': '07d2d4c0-26f2-53da-acac-1ac168683368',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/tn58602',
     'listing': 'auction',
     'location': 'fr, warluis',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 52723,
     'odometer_in_km': 52723,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-02-19',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 e-vti exclusive',
     'transmission': 'automatic',
     'trim': 'exclusive',
     'year': 2017}
2026-01-29 06:07:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 07d2d4c0-26f2-53da-acac-1ac168683368 spider: auto1.fr
2026-01-29 06:07:32 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 07d2d4c0-26f2-53da-acac-1ac168683368 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 e-vti exclusive', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'automatic', 'odometer': 52723, 'odometer_reading_unit': 'km', 'registration_date': '2017-02-19', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/tn58602', 'expiration_date': '2026-01-29t16:11:19z', 'origin_country_code': 'fr', 'trim': 'exclusive', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, warluis', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 99, 'id': '07d2d4c0-26f2-53da-acac-1ac168683368', 'current_year_diff': 9, 'age_in_months': 107, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 52723}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 107,
     'auction_title': '',
     'c_o_2_emission_value': 99,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:11:19z',
     'fuel_type': 'petrol',
     'id': '07d2d4c0-26f2-53da-acac-1ac168683368',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/tn58602',
     'listing': 'auction',
     'location': 'fr, warluis',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 52723,
     'odometer_in_km': 52723,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-02-19',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 e-vti exclusive',
     'transmission': 'automatic',
     'trim': 'exclusive',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:11:19Z',
 'fuel_type': 'petrol',
 'id': '07d2d4c0-26f2-53da-acac-1ac168683368',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN58602',
 'listing': 'auction',
 'location': 'FR, Warluis',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 52723,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 e-VTi Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2017}
2026-01-29 06:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TN58602%27 HTTP/1.1" 200 None
2026-01-29 06:07:32 [auto1.fr] INFO: Saving data for TN58602: {'auction_closing_time': 1769703079.0, 'created_time': 1769533616.53548, 'last_price_update_time': 1769666852.158061}
2026-01-29 06:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TN58602') HTTP/1.1" 204 0
2026-01-29 06:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RM32421/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TJ82667/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GP79855/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AB13106/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MS90300/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UA20744> (referer: https://www.auto1.com/v1/car-details-view/UA20744/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be1dcf24-51a7-5e35-a552-a5485075ffbb with identifier: UA20744
2026-01-29 06:07:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be1dcf24-51a7-5e35-a552-a5485075ffbb with scrape type 2
2026-01-29 06:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be1dcf24-51a7-5e35-a552-a5485075ffbb with scrape type 2
2026-01-29 06:07:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: be1dcf24-51a7-5e35-a552-a5485075ffbb, identifier: UA20744
2026-01-29 06:07:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: be1dcf24-51a7-5e35-a552-a5485075ffbb with identifier: UA20744
2026-01-29 06:07:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: be1dcf24-51a7-5e35-a552-a5485075ffbb with identifier: UA20744
2026-01-29 06:07:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'manual', 'odometer': 131819, 'odometer_reading_unit': 'km', 'registration_date': '2019-07-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ua20744', 'expiration_date': '2026-01-29t16:19:24z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, nanteuil-le-haudouin', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 118, 'id': 'be1dcf24-51a7-5e35-a552-a5485075ffbb', 'current_year_diff': 7, 'age_in_months': 77, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 131819}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 77,
     'auction_title': '',
     'c_o_2_emission_value': 118,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:19:24z',
     'fuel_type': 'petrol',
     'id': 'be1dcf24-51a7-5e35-a552-a5485075ffbb',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ua20744',
     'listing': 'auction',
     'location': 'fr, nanteuil-le-haudouin',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 131819,
     'odometer_in_km': 131819,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-07-30',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 puretech gt',
     'transmission': 'manual',
     'trim': 'gt',
     'year': 2019}
2026-01-29 06:07:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: be1dcf24-51a7-5e35-a552-a5485075ffbb spider: auto1.fr
2026-01-29 06:07:47 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: be1dcf24-51a7-5e35-a552-a5485075ffbb due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'manual', 'odometer': 131819, 'odometer_reading_unit': 'km', 'registration_date': '2019-07-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ua20744', 'expiration_date': '2026-01-29t16:19:24z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, nanteuil-le-haudouin', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 118, 'id': 'be1dcf24-51a7-5e35-a552-a5485075ffbb', 'current_year_diff': 7, 'age_in_months': 77, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 131819}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 77,
     'auction_title': '',
     'c_o_2_emission_value': 118,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:19:24z',
     'fuel_type': 'petrol',
     'id': 'be1dcf24-51a7-5e35-a552-a5485075ffbb',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ua20744',
     'listing': 'auction',
     'location': 'fr, nanteuil-le-haudouin',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 131819,
     'odometer_in_km': 131819,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-07-30',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 puretech gt',
     'transmission': 'manual',
     'trim': 'gt',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:19:24Z',
 'fuel_type': 'petrol',
 'id': 'be1dcf24-51a7-5e35-a552-a5485075ffbb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA20744',
 'listing': 'auction',
 'location': 'FR, Nanteuil-le-Haudouin',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 131819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech GT',
 'transmission': 'manual',
 'trim': 'GT',
 'year': 2019}
2026-01-29 06:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UA20744%27 HTTP/1.1" 200 None
2026-01-29 06:07:47 [auto1.fr] INFO: Saving data for UA20744: {'auction_closing_time': 1769703564.0, 'created_time': 1769533640.440467, 'last_price_update_time': 1769666867.37805}
2026-01-29 06:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UA20744') HTTP/1.1" 204 0
2026-01-29 06:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FS95119> (referer: https://www.auto1.com/v1/car-details-view/FS95119/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fccd0dcc-ac2d-5d8f-ac11-930778881bb4 with identifier: FS95119
2026-01-29 06:07:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fccd0dcc-ac2d-5d8f-ac11-930778881bb4 with scrape type 2
2026-01-29 06:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fccd0dcc-ac2d-5d8f-ac11-930778881bb4 with scrape type 2
2026-01-29 06:07:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fccd0dcc-ac2d-5d8f-ac11-930778881bb4, identifier: FS95119
2026-01-29 06:07:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fccd0dcc-ac2d-5d8f-ac11-930778881bb4 with identifier: FS95119
2026-01-29 06:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fccd0dcc-ac2d-5d8f-ac11-930778881bb4 with identifier: FS95119
2026-01-29 06:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 194867 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    194867
2026-01-29 06:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: fccd0dcc-ac2d-5d8f-ac11-930778881bb4 spider: auto1.fr
2026-01-29 06:07:52 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: fccd0dcc-ac2d-5d8f-ac11-930778881bb4 due to rule: high_mileage_for_country.json, error: 194867 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    194867
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:49:05Z',
 'fuel_type': 'diesel',
 'id': 'fccd0dcc-ac2d-5d8f-ac11-930778881bb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS95119',
 'listing': 'auction',
 'location': 'FR, Houecourt',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 194867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 d Shooting Brake Inspiration',
 'transmission': 'manual',
 'trim': 'Inspiration',
 'year': 2018}
2026-01-29 06:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FS95119%27 HTTP/1.1" 200 None
2026-01-29 06:07:52 [auto1.fr] INFO: Saving data for FS95119: {'auction_closing_time': 1769705345.0, 'created_time': 1769533478.849268, 'last_price_update_time': 1769666872.255649}
2026-01-29 06:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FS95119') HTTP/1.1" 204 0
2026-01-29 06:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JM19604> (referer: https://www.auto1.com/v1/car-details-view/JM19604/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa89da84-4863-5995-be05-560def9b26e4 with identifier: JM19604
2026-01-29 06:07:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa89da84-4863-5995-be05-560def9b26e4 with scrape type 2
2026-01-29 06:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa89da84-4863-5995-be05-560def9b26e4 with scrape type 2
2026-01-29 06:07:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: aa89da84-4863-5995-be05-560def9b26e4, identifier: JM19604
2026-01-29 06:07:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: aa89da84-4863-5995-be05-560def9b26e4 with identifier: JM19604
2026-01-29 06:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: aa89da84-4863-5995-be05-560def9b26e4 with identifier: JM19604
2026-01-29 06:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 't6 transporter' containing 'transporter'
2026-01-29 06:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: aa89da84-4863-5995-be05-560def9b26e4 spider: auto1.fr
2026-01-29 06:07:52 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: aa89da84-4863-5995-be05-560def9b26e4 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 't6 transporter' containing 'transporter'
{'auction_title': '',
 'c_o_2_emission_value': 199,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 204,
 'expiration_date': '2026-01-29T16:27:28Z',
 'fuel_type': 'diesel',
 'id': 'aa89da84-4863-5995-be05-560def9b26e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM19604',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Volkswagen',
 'model': 'T6 Transporter',
 'odometer': 145712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-10-13',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten FWD',
 'transmission': 'automatic',
 'trim': 'Kasten FWD',
 'year': 2021}
2026-01-29 06:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JM19604%27 HTTP/1.1" 200 None
2026-01-29 06:07:52 [auto1.fr] INFO: Saving data for JM19604: {'auction_closing_time': 1769704048.0, 'created_time': 1769534123.492728, 'last_price_update_time': 1769666872.678836}
2026-01-29 06:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JM19604') HTTP/1.1" 204 0
2026-01-29 06:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YU81464> (referer: https://www.auto1.com/v1/car-details-view/YU81464/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d0c6108-0717-5f63-977c-ad4874e734c2 with identifier: YU81464
2026-01-29 06:07:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d0c6108-0717-5f63-977c-ad4874e734c2 with scrape type 2
2026-01-29 06:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d0c6108-0717-5f63-977c-ad4874e734c2 with scrape type 2
2026-01-29 06:07:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0d0c6108-0717-5f63-977c-ad4874e734c2, identifier: YU81464
2026-01-29 06:07:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0d0c6108-0717-5f63-977c-ad4874e734c2 with identifier: YU81464
2026-01-29 06:07:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0d0c6108-0717-5f63-977c-ad4874e734c2 with identifier: YU81464
2026-01-29 06:07:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech allure pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'automatic', 'odometer': 114452, 'odometer_reading_unit': 'km', 'registration_date': '2022-02-17', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yu81464', 'expiration_date': '2026-01-29t16:16:55z', 'origin_country_code': 'fr', 'trim': 'allure pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, carrières-sous-poissy', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '0d0c6108-0717-5f63-977c-ad4874e734c2', 'current_year_diff': 4, 'age_in_months': 47, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 114452}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 47,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:16:55z',
     'fuel_type': 'petrol',
     'id': '0d0c6108-0717-5f63-977c-ad4874e734c2',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yu81464',
     'listing': 'auction',
     'location': 'fr, carrières-sous-poissy',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 114452,
     'odometer_in_km': 114452,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-02-17',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech allure pack',
     'transmission': 'automatic',
     'trim': 'allure pack',
     'year': 2022}
2026-01-29 06:07:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 0d0c6108-0717-5f63-977c-ad4874e734c2 spider: auto1.fr
2026-01-29 06:07:55 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 0d0c6108-0717-5f63-977c-ad4874e734c2 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech allure pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'automatic', 'odometer': 114452, 'odometer_reading_unit': 'km', 'registration_date': '2022-02-17', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yu81464', 'expiration_date': '2026-01-29t16:16:55z', 'origin_country_code': 'fr', 'trim': 'allure pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, carrières-sous-poissy', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '0d0c6108-0717-5f63-977c-ad4874e734c2', 'current_year_diff': 4, 'age_in_months': 47, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 114452}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 47,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:16:55z',
     'fuel_type': 'petrol',
     'id': '0d0c6108-0717-5f63-977c-ad4874e734c2',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yu81464',
     'listing': 'auction',
     'location': 'fr, carrières-sous-poissy',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 114452,
     'odometer_in_km': 114452,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-02-17',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech allure pack',
     'transmission': 'automatic',
     'trim': 'allure pack',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:16:55Z',
 'fuel_type': 'petrol',
 'id': '0d0c6108-0717-5f63-977c-ad4874e734c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU81464',
 'listing': 'auction',
 'location': 'FR, Carrières-sous-Poissy',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 114452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2022}
2026-01-29 06:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YU81464%27 HTTP/1.1" 200 None
2026-01-29 06:07:55 [auto1.fr] INFO: Saving data for YU81464: {'auction_closing_time': 1769703415.0, 'created_time': 1769533318.497474, 'last_price_update_time': 1769666875.295141}
2026-01-29 06:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YU81464') HTTP/1.1" 204 0
2026-01-29 06:07:56 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.745(s), this was the 1st time calling it.
2026-01-29 06:07:56 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.640942139868011 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WV49919> (referer: https://www.auto1.com/v1/car-details-view/WV49919/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:07:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:07:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9f9728d-bfab-5150-8838-44de82710e2b with identifier: WV49919
2026-01-29 06:07:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9f9728d-bfab-5150-8838-44de82710e2b with scrape type 2
2026-01-29 06:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9f9728d-bfab-5150-8838-44de82710e2b with scrape type 2
2026-01-29 06:07:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a9f9728d-bfab-5150-8838-44de82710e2b, identifier: WV49919
2026-01-29 06:07:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a9f9728d-bfab-5150-8838-44de82710e2b with identifier: WV49919
2026-01-29 06:07:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a9f9728d-bfab-5150-8838-44de82710e2b with identifier: WV49919
2026-01-29 06:07:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a9f9728d-bfab-5150-8838-44de82710e2b with identifier: WV49919 to the API
2026-01-29 06:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:07:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:07:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WV49919>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:40:31Z',
 'fuel_type': 'diesel',
 'id': 'a9f9728d-bfab-5150-8838-44de82710e2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV49919',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 44997,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2026-01-29 06:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WV49919%27 HTTP/1.1" 200 None
2026-01-29 06:07:58 [auto1.fr] INFO: Saving data for WV49919: {'auction_closing_time': 1769704831.0, 'created_time': 1768903863.405616, 'last_price_update_time': 1769666878.199478}
2026-01-29 06:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WV49919') HTTP/1.1" 204 0
2026-01-29 06:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RM32421> (referer: https://www.auto1.com/v1/car-details-view/RM32421/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:08:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03a2ebd7-28ab-5dc0-a401-8953ae21ecd3 with identifier: RM32421
2026-01-29 06:08:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03a2ebd7-28ab-5dc0-a401-8953ae21ecd3 with scrape type 2
2026-01-29 06:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03a2ebd7-28ab-5dc0-a401-8953ae21ecd3 with scrape type 2
2026-01-29 06:08:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 03a2ebd7-28ab-5dc0-a401-8953ae21ecd3, identifier: RM32421
2026-01-29 06:08:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 03a2ebd7-28ab-5dc0-a401-8953ae21ecd3 with identifier: RM32421
2026-01-29 06:08:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 03a2ebd7-28ab-5dc0-a401-8953ae21ecd3 with identifier: RM32421
2026-01-29 06:08:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 03a2ebd7-28ab-5dc0-a401-8953ae21ecd3 with identifier: RM32421 to the API
2026-01-29 06:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:08:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:08:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RM32421>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:44:27Z',
 'fuel_type': 'diesel',
 'id': '03a2ebd7-28ab-5dc0-a401-8953ae21ecd3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM32421',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 145881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2017}
2026-01-29 06:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM32421%27 HTTP/1.1" 200 None
2026-01-29 06:08:01 [auto1.fr] INFO: Saving data for RM32421: {'auction_closing_time': 1769705067.0, 'created_time': 1768844197.15313, 'last_price_update_time': 1769666881.130164}
2026-01-29 06:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RM32421') HTTP/1.1" 204 0
2026-01-29 06:08:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TJ82667> (referer: https://www.auto1.com/v1/car-details-view/TJ82667/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:08:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71a223f4-dc4c-5ebd-bbf9-e27be23c1eb7 with identifier: TJ82667
2026-01-29 06:08:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71a223f4-dc4c-5ebd-bbf9-e27be23c1eb7 with scrape type 2
2026-01-29 06:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71a223f4-dc4c-5ebd-bbf9-e27be23c1eb7 with scrape type 2
2026-01-29 06:08:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 71a223f4-dc4c-5ebd-bbf9-e27be23c1eb7, identifier: TJ82667
2026-01-29 06:08:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 71a223f4-dc4c-5ebd-bbf9-e27be23c1eb7 with identifier: TJ82667
2026-01-29 06:08:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 71a223f4-dc4c-5ebd-bbf9-e27be23c1eb7 with identifier: TJ82667
2026-01-29 06:08:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 71a223f4-dc4c-5ebd-bbf9-e27be23c1eb7 with identifier: TJ82667 to the API
2026-01-29 06:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:08:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:08:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TJ82667>
{'auction_title': '',
 'c_o_2_emission_value': 88,
 'category': None,
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-01-29T16:11:00Z',
 'fuel_type': 'petrol',
 'id': '71a223f4-dc4c-5ebd-bbf9-e27be23c1eb7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ82667',
 'listing': 'auction',
 'location': 'FR, LE HAVRE',
 'make': 'Fiat',
 'model': '500',
 'odometer': 60000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-01-13',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2021}
2026-01-29 06:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TJ82667%27 HTTP/1.1" 200 None
2026-01-29 06:08:02 [auto1.fr] INFO: Saving data for TJ82667: {'auction_closing_time': 1769703060.0, 'created_time': 1768903562.071834, 'last_price_update_time': 1769666882.617489}
2026-01-29 06:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TJ82667') HTTP/1.1" 204 0
2026-01-29 06:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WW29549/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FY73676/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AB13106> (referer: https://www.auto1.com/v1/car-details-view/AB13106/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:08:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c300ba81-8cf0-5636-9660-4f81ba7277f6 with identifier: AB13106
2026-01-29 06:08:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c300ba81-8cf0-5636-9660-4f81ba7277f6 with scrape type 2
2026-01-29 06:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c300ba81-8cf0-5636-9660-4f81ba7277f6 with scrape type 2
2026-01-29 06:08:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c300ba81-8cf0-5636-9660-4f81ba7277f6, identifier: AB13106
2026-01-29 06:08:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c300ba81-8cf0-5636-9660-4f81ba7277f6 with identifier: AB13106
2026-01-29 06:08:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c300ba81-8cf0-5636-9660-4f81ba7277f6 with identifier: AB13106
2026-01-29 06:08:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c300ba81-8cf0-5636-9660-4f81ba7277f6 with identifier: AB13106 to the API
2026-01-29 06:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:08:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:08:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AB13106>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': 'Taxi',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 204,
 'expiration_date': '2026-01-29T16:07:44Z',
 'fuel_type': 'electro',
 'id': 'c300ba81-8cf0-5636-9660-4f81ba7277f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB13106',
 'listing': 'auction',
 'location': 'FR, Quincieux',
 'make': 'Skoda',
 'model': 'Enyaq',
 'odometer': 103226,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Enyaq iV 80 Suite',
 'transmission': 'automatic',
 'trim': 'Suite',
 'year': 2021}
2026-01-29 06:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AB13106%27 HTTP/1.1" 200 None
2026-01-29 06:08:11 [auto1.fr] INFO: Saving data for AB13106: {'auction_closing_time': 1769702864.0, 'created_time': 1768809651.665775, 'last_price_update_time': 1769666891.634819}
2026-01-29 06:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AB13106') HTTP/1.1" 204 0
2026-01-29 06:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZP82806> (referer: https://www.auto1.com/v1/car-details-view/ZP82806/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:08:12 [scrapy.extensions.logstats] INFO: Crawled 664 pages (at 37 pages/min), scraped 145 items (at 9 items/min)
2026-01-29 06:08:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d90e85f5-6125-585a-b9f0-83116ecd44a6 with identifier: ZP82806
2026-01-29 06:08:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d90e85f5-6125-585a-b9f0-83116ecd44a6 with scrape type 2
2026-01-29 06:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d90e85f5-6125-585a-b9f0-83116ecd44a6 with scrape type 2
2026-01-29 06:08:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d90e85f5-6125-585a-b9f0-83116ecd44a6, identifier: ZP82806
2026-01-29 06:08:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d90e85f5-6125-585a-b9f0-83116ecd44a6 with identifier: ZP82806
2026-01-29 06:08:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d90e85f5-6125-585a-b9f0-83116ecd44a6 with identifier: ZP82806
2026-01-29 06:08:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2026-01-29 06:08:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: d90e85f5-6125-585a-b9f0-83116ecd44a6 spider: auto1.fr
2026-01-29 06:08:12 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: d90e85f5-6125-585a-b9f0-83116ecd44a6 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:02:47Z',
 'fuel_type': 'diesel',
 'id': 'd90e85f5-6125-585a-b9f0-83116ecd44a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP82806',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 114785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-27',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Peugeot Partner 1.5 Blue-HDi Premium L1',
 'transmission': 'manual',
 'trim': 'Premium L1',
 'year': 2020}
2026-01-29 06:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP82806%27 HTTP/1.1" 200 None
2026-01-29 06:08:12 [auto1.fr] INFO: Saving data for ZP82806: {'auction_closing_time': 1769702567.0, 'created_time': 1767805759.182662, 'last_price_update_time': 1769666892.599743}
2026-01-29 06:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZP82806') HTTP/1.1" 204 0
2026-01-29 06:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GP79855> (referer: https://www.auto1.com/v1/car-details-view/GP79855/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:08:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d529e1e-8fc8-5d6c-8094-6f1491d82583 with identifier: GP79855
2026-01-29 06:08:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d529e1e-8fc8-5d6c-8094-6f1491d82583 with scrape type 2
2026-01-29 06:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d529e1e-8fc8-5d6c-8094-6f1491d82583 with scrape type 2
2026-01-29 06:08:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9d529e1e-8fc8-5d6c-8094-6f1491d82583, identifier: GP79855
2026-01-29 06:08:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9d529e1e-8fc8-5d6c-8094-6f1491d82583 with identifier: GP79855
2026-01-29 06:08:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9d529e1e-8fc8-5d6c-8094-6f1491d82583 with identifier: GP79855
2026-01-29 06:08:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'automatic', 'odometer': 43008, 'odometer_reading_unit': 'km', 'registration_date': '2022-11-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gp79855', 'expiration_date': '2026-01-29t16:54:49z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 134, 'id': '9d529e1e-8fc8-5d6c-8094-6f1491d82583', 'current_year_diff': 4, 'age_in_months': 38, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 43008}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 38,
     'auction_title': '',
     'c_o_2_emission_value': 134,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:54:49z',
     'fuel_type': 'petrol',
     'id': '9d529e1e-8fc8-5d6c-8094-6f1491d82583',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gp79855',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 43008,
     'odometer_in_km': 43008,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-11-27',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech shine',
     'transmission': 'automatic',
     'trim': 'shine',
     'year': 2022}
2026-01-29 06:08:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 9d529e1e-8fc8-5d6c-8094-6f1491d82583 spider: auto1.fr
2026-01-29 06:08:22 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 9d529e1e-8fc8-5d6c-8094-6f1491d82583 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'automatic', 'odometer': 43008, 'odometer_reading_unit': 'km', 'registration_date': '2022-11-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gp79855', 'expiration_date': '2026-01-29t16:54:49z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 134, 'id': '9d529e1e-8fc8-5d6c-8094-6f1491d82583', 'current_year_diff': 4, 'age_in_months': 38, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 43008}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 38,
     'auction_title': '',
     'c_o_2_emission_value': 134,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:54:49z',
     'fuel_type': 'petrol',
     'id': '9d529e1e-8fc8-5d6c-8094-6f1491d82583',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gp79855',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 43008,
     'odometer_in_km': 43008,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-11-27',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech shine',
     'transmission': 'automatic',
     'trim': 'shine',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:54:49Z',
 'fuel_type': 'petrol',
 'id': '9d529e1e-8fc8-5d6c-8094-6f1491d82583',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP79855',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 43008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2022}
2026-01-29 06:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GP79855%27 HTTP/1.1" 200 None
2026-01-29 06:08:22 [auto1.fr] INFO: Saving data for GP79855: {'auction_closing_time': 1769705689.0, 'created_time': 1769493765.565577, 'last_price_update_time': 1769666902.552273}
2026-01-29 06:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GP79855') HTTP/1.1" 204 0
2026-01-29 06:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YP50881/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB23857/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MS90300> (referer: https://www.auto1.com/v1/car-details-view/MS90300/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:08:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1365accb-2212-5640-bfd2-b134e8fc37ce with identifier: MS90300
2026-01-29 06:08:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1365accb-2212-5640-bfd2-b134e8fc37ce with scrape type 2
2026-01-29 06:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1365accb-2212-5640-bfd2-b134e8fc37ce with scrape type 2
2026-01-29 06:08:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1365accb-2212-5640-bfd2-b134e8fc37ce, identifier: MS90300
2026-01-29 06:08:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1365accb-2212-5640-bfd2-b134e8fc37ce with identifier: MS90300
2026-01-29 06:08:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1365accb-2212-5640-bfd2-b134e8fc37ce with identifier: MS90300
2026-01-29 06:08:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1365accb-2212-5640-bfd2-b134e8fc37ce with identifier: MS90300 to the API
2026-01-29 06:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:08:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:08:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MS90300>
{'auction_title': '',
 'c_o_2_emission_value': 24,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 218,
 'expiration_date': '2026-01-29T16:34:42Z',
 'fuel_type': 'hybrid',
 'id': '1365accb-2212-5640-bfd2-b134e8fc37ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS90300',
 'listing': 'auction',
 'location': 'FR, Brive-la-Gaillarde',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 136053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 250e AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-01-29 06:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MS90300%27 HTTP/1.1" 200 None
2026-01-29 06:08:24 [auto1.fr] INFO: Saving data for MS90300: {'auction_closing_time': 1769704482.0, 'created_time': 1769534386.703869, 'last_price_update_time': 1769666904.231398}
2026-01-29 06:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MS90300') HTTP/1.1" 204 0
2026-01-29 06:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PD18148> (referer: https://www.auto1.com/v1/car-details-view/PD18148/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:08:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db6b384c-01ea-556d-bdc7-29950c03d7cc with identifier: PD18148
2026-01-29 06:08:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db6b384c-01ea-556d-bdc7-29950c03d7cc with scrape type 2
2026-01-29 06:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db6b384c-01ea-556d-bdc7-29950c03d7cc with scrape type 2
2026-01-29 06:08:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: db6b384c-01ea-556d-bdc7-29950c03d7cc, identifier: PD18148
2026-01-29 06:08:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: db6b384c-01ea-556d-bdc7-29950c03d7cc with identifier: PD18148
2026-01-29 06:08:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: db6b384c-01ea-556d-bdc7-29950c03d7cc with identifier: PD18148
2026-01-29 06:08:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 92212, 'odometer_reading_unit': 'km', 'registration_date': '2019-05-20', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pd18148', 'expiration_date': '2026-01-29t16:44:42z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marly-la-ville', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 112, 'id': 'db6b384c-01ea-556d-bdc7-29950c03d7cc', 'current_year_diff': 7, 'age_in_months': 80, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 92212}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 80,
     'auction_title': '',
     'c_o_2_emission_value': 112,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:44:42z',
     'fuel_type': 'petrol',
     'id': 'db6b384c-01ea-556d-bdc7-29950c03d7cc',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pd18148',
     'listing': 'auction',
     'location': 'fr, marly-la-ville',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 92212,
     'odometer_in_km': 92212,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-05-20',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2019}
2026-01-29 06:08:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: db6b384c-01ea-556d-bdc7-29950c03d7cc spider: auto1.fr
2026-01-29 06:08:24 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: db6b384c-01ea-556d-bdc7-29950c03d7cc due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 92212, 'odometer_reading_unit': 'km', 'registration_date': '2019-05-20', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pd18148', 'expiration_date': '2026-01-29t16:44:42z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marly-la-ville', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 112, 'id': 'db6b384c-01ea-556d-bdc7-29950c03d7cc', 'current_year_diff': 7, 'age_in_months': 80, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 92212}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 80,
     'auction_title': '',
     'c_o_2_emission_value': 112,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:44:42z',
     'fuel_type': 'petrol',
     'id': 'db6b384c-01ea-556d-bdc7-29950c03d7cc',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pd18148',
     'listing': 'auction',
     'location': 'fr, marly-la-ville',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 92212,
     'odometer_in_km': 92212,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-05-20',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:44:42Z',
 'fuel_type': 'petrol',
 'id': 'db6b384c-01ea-556d-bdc7-29950c03d7cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD18148',
 'listing': 'auction',
 'location': 'FR, Marly-la-ville',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 92212,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2019}
2026-01-29 06:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PD18148%27 HTTP/1.1" 200 None
2026-01-29 06:08:24 [auto1.fr] INFO: Saving data for PD18148: {'auction_closing_time': 1769705082.0, 'created_time': 1769534098.417811, 'last_price_update_time': 1769666904.823755}
2026-01-29 06:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PD18148') HTTP/1.1" 204 0
2026-01-29 06:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EE76098/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GP99101/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CD59619/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CU82747/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UX68890/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SU20841/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB94762/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PX90385/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RK84609/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB23857> (referer: https://www.auto1.com/v1/car-details-view/JB23857/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FY73676> (referer: https://www.auto1.com/v1/car-details-view/FY73676/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:08:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab04873a-6b71-5cc8-8866-96afccd2bb1c with identifier: JB23857
2026-01-29 06:08:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab04873a-6b71-5cc8-8866-96afccd2bb1c with scrape type 2
2026-01-29 06:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab04873a-6b71-5cc8-8866-96afccd2bb1c with scrape type 2
2026-01-29 06:08:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ab04873a-6b71-5cc8-8866-96afccd2bb1c, identifier: JB23857
2026-01-29 06:08:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ab04873a-6b71-5cc8-8866-96afccd2bb1c with identifier: JB23857
2026-01-29 06:08:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ab04873a-6b71-5cc8-8866-96afccd2bb1c with identifier: JB23857
2026-01-29 06:08:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ab04873a-6b71-5cc8-8866-96afccd2bb1c with identifier: JB23857 to the API
2026-01-29 06:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:08:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:08:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JB23857>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 381,
 'expiration_date': '2026-01-29T16:11:14Z',
 'fuel_type': 'hybrid',
 'id': 'ab04873a-6b71-5cc8-8866-96afccd2bb1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB23857',
 'listing': 'auction',
 'location': 'FR, Marckolsheim',
 'make': 'Jeep',
 'model': 'Wrangler Unlimited',
 'odometer': 90439,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Wrangler Unlimited 2.0 4xe Plug-in Hybrid Rubicon',
 'transmission': 'automatic',
 'trim': 'Rubicon',
 'year': 2021}
2026-01-29 06:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JB23857%27 HTTP/1.1" 200 None
2026-01-29 06:08:37 [auto1.fr] INFO: Saving data for JB23857: {'auction_closing_time': 1769703074.0, 'created_time': 1769534159.264636, 'last_price_update_time': 1769666917.757802}
2026-01-29 06:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JB23857') HTTP/1.1" 204 0
2026-01-29 06:08:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7034212-2356-5b1a-840a-56e3e2d3ab5a with identifier: FY73676
2026-01-29 06:08:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7034212-2356-5b1a-840a-56e3e2d3ab5a with scrape type 2
2026-01-29 06:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7034212-2356-5b1a-840a-56e3e2d3ab5a with scrape type 2
2026-01-29 06:08:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d7034212-2356-5b1a-840a-56e3e2d3ab5a, identifier: FY73676
2026-01-29 06:08:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d7034212-2356-5b1a-840a-56e3e2d3ab5a with identifier: FY73676
2026-01-29 06:08:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d7034212-2356-5b1a-840a-56e3e2d3ab5a with identifier: FY73676
2026-01-29 06:08:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'beige', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'manual', 'odometer': 52906, 'odometer_reading_unit': 'km', 'registration_date': '2019-11-11', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fy73676', 'expiration_date': '2026-01-29t16:40:36z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'marseille', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 104, 'id': 'd7034212-2356-5b1a-840a-56e3e2d3ab5a', 'current_year_diff': 7, 'age_in_months': 74, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 52906}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 74,
     'auction_title': '',
     'c_o_2_emission_value': 104,
     'category': None,
     'color': 'beige',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:40:36z',
     'fuel_type': 'petrol',
     'id': 'd7034212-2356-5b1a-840a-56e3e2d3ab5a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fy73676',
     'listing': 'auction',
     'location': 'marseille',
     'make': 'citroen',
     'make_model': 'citroen c3 aircross',
     'model': 'c3 aircross',
     'odometer': 52906,
     'odometer_in_km': 52906,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-11-11',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 aircross 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2019}
2026-01-29 06:08:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: d7034212-2356-5b1a-840a-56e3e2d3ab5a spider: auto1.fr
2026-01-29 06:08:38 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: d7034212-2356-5b1a-840a-56e3e2d3ab5a due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'beige', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'manual', 'odometer': 52906, 'odometer_reading_unit': 'km', 'registration_date': '2019-11-11', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fy73676', 'expiration_date': '2026-01-29t16:40:36z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'marseille', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 104, 'id': 'd7034212-2356-5b1a-840a-56e3e2d3ab5a', 'current_year_diff': 7, 'age_in_months': 74, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 52906}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 74,
     'auction_title': '',
     'c_o_2_emission_value': 104,
     'category': None,
     'color': 'beige',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:40:36z',
     'fuel_type': 'petrol',
     'id': 'd7034212-2356-5b1a-840a-56e3e2d3ab5a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fy73676',
     'listing': 'auction',
     'location': 'marseille',
     'make': 'citroen',
     'make_model': 'citroen c3 aircross',
     'model': 'c3 aircross',
     'odometer': 52906,
     'odometer_in_km': 52906,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-11-11',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 aircross 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:40:36Z',
 'fuel_type': 'petrol',
 'id': 'd7034212-2356-5b1a-840a-56e3e2d3ab5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY73676',
 'listing': 'auction',
 'location': 'Marseille',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 52906,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2019}
2026-01-29 06:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FY73676%27 HTTP/1.1" 200 None
2026-01-29 06:08:38 [auto1.fr] INFO: Saving data for FY73676: {'auction_closing_time': 1769704836.0, 'created_time': 1769580158.961284, 'last_price_update_time': 1769666918.091492}
2026-01-29 06:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FY73676') HTTP/1.1" 204 0
2026-01-29 06:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YP50881> (referer: https://www.auto1.com/v1/car-details-view/YP50881/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EE76098> (referer: https://www.auto1.com/v1/car-details-view/EE76098/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:08:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9eb47f0f-b06f-57be-a747-f28e62a6acf5 with identifier: YP50881
2026-01-29 06:08:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9eb47f0f-b06f-57be-a747-f28e62a6acf5 with scrape type 2
2026-01-29 06:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9eb47f0f-b06f-57be-a747-f28e62a6acf5 with scrape type 2
2026-01-29 06:08:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9eb47f0f-b06f-57be-a747-f28e62a6acf5, identifier: YP50881
2026-01-29 06:08:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9eb47f0f-b06f-57be-a747-f28e62a6acf5 with identifier: YP50881
2026-01-29 06:08:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9eb47f0f-b06f-57be-a747-f28e62a6acf5 with identifier: YP50881
2026-01-29 06:08:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 150320 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150320
2026-01-29 06:08:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 9eb47f0f-b06f-57be-a747-f28e62a6acf5 spider: auto1.fr
2026-01-29 06:08:39 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 9eb47f0f-b06f-57be-a747-f28e62a6acf5 due to rule: high_mileage_for_country.json, error: 150320 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150320
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:08:57Z',
 'fuel_type': 'petrol',
 'id': '9eb47f0f-b06f-57be-a747-f28e62a6acf5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP50881',
 'listing': 'auction',
 'location': 'FR, Marly-la-ville',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 150320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Micra 1.0 IG-T Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2019}
2026-01-29 06:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP50881%27 HTTP/1.1" 200 None
2026-01-29 06:08:39 [auto1.fr] INFO: Saving data for YP50881: {'auction_closing_time': 1769702937.0, 'created_time': 1769148331.990975, 'last_price_update_time': 1769666919.163524}
2026-01-29 06:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YP50881') HTTP/1.1" 204 0
2026-01-29 06:08:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8d91a50-4976-5198-839f-94f6acb9cafa with identifier: EE76098
2026-01-29 06:08:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8d91a50-4976-5198-839f-94f6acb9cafa with scrape type 2
2026-01-29 06:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8d91a50-4976-5198-839f-94f6acb9cafa with scrape type 2
2026-01-29 06:08:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a8d91a50-4976-5198-839f-94f6acb9cafa, identifier: EE76098
2026-01-29 06:08:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a8d91a50-4976-5198-839f-94f6acb9cafa with identifier: EE76098
2026-01-29 06:08:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a8d91a50-4976-5198-839f-94f6acb9cafa with identifier: EE76098
2026-01-29 06:08:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech active', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 32511, 'odometer_reading_unit': 'km', 'registration_date': '2022-02-21', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ee76098', 'expiration_date': '2026-01-29t16:17:41z', 'origin_country_code': 'fr', 'trim': 'active', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, beauzelle', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 124, 'id': 'a8d91a50-4976-5198-839f-94f6acb9cafa', 'current_year_diff': 4, 'age_in_months': 47, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 32511}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 47,
     'auction_title': '',
     'c_o_2_emission_value': 124,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:17:41z',
     'fuel_type': 'petrol',
     'id': 'a8d91a50-4976-5198-839f-94f6acb9cafa',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ee76098',
     'listing': 'auction',
     'location': 'fr, beauzelle',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 32511,
     'odometer_in_km': 32511,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-02-21',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech active',
     'transmission': 'manual',
     'trim': 'active',
     'year': 2022}
2026-01-29 06:08:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: a8d91a50-4976-5198-839f-94f6acb9cafa spider: auto1.fr
2026-01-29 06:08:39 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: a8d91a50-4976-5198-839f-94f6acb9cafa due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech active', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 32511, 'odometer_reading_unit': 'km', 'registration_date': '2022-02-21', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ee76098', 'expiration_date': '2026-01-29t16:17:41z', 'origin_country_code': 'fr', 'trim': 'active', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, beauzelle', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 124, 'id': 'a8d91a50-4976-5198-839f-94f6acb9cafa', 'current_year_diff': 4, 'age_in_months': 47, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 32511}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 47,
     'auction_title': '',
     'c_o_2_emission_value': 124,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:17:41z',
     'fuel_type': 'petrol',
     'id': 'a8d91a50-4976-5198-839f-94f6acb9cafa',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ee76098',
     'listing': 'auction',
     'location': 'fr, beauzelle',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 32511,
     'odometer_in_km': 32511,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-02-21',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech active',
     'transmission': 'manual',
     'trim': 'active',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:17:41Z',
 'fuel_type': 'petrol',
 'id': 'a8d91a50-4976-5198-839f-94f6acb9cafa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE76098',
 'listing': 'auction',
 'location': 'FR, Beauzelle',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 32511,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2022}
2026-01-29 06:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EE76098%27 HTTP/1.1" 200 None
2026-01-29 06:08:39 [auto1.fr] INFO: Saving data for EE76098: {'auction_closing_time': 1769703461.0, 'created_time': 1769101243.665771, 'last_price_update_time': 1769666919.491846}
2026-01-29 06:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EE76098') HTTP/1.1" 204 0
2026-01-29 06:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GP99101> (referer: https://www.auto1.com/v1/car-details-view/GP99101/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:08:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c733c6ea-4f18-52f7-a1a7-95d147fdece7 with identifier: GP99101
2026-01-29 06:08:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c733c6ea-4f18-52f7-a1a7-95d147fdece7 with scrape type 2
2026-01-29 06:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c733c6ea-4f18-52f7-a1a7-95d147fdece7 with scrape type 2
2026-01-29 06:08:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c733c6ea-4f18-52f7-a1a7-95d147fdece7, identifier: GP99101
2026-01-29 06:08:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c733c6ea-4f18-52f7-a1a7-95d147fdece7 with identifier: GP99101
2026-01-29 06:08:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c733c6ea-4f18-52f7-a1a7-95d147fdece7 with identifier: GP99101
2026-01-29 06:08:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 168049 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168049
2026-01-29 06:08:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c733c6ea-4f18-52f7-a1a7-95d147fdece7 spider: auto1.fr
2026-01-29 06:08:39 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: c733c6ea-4f18-52f7-a1a7-95d147fdece7 due to rule: high_mileage_for_country.json, error: 168049 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168049
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:29:33Z',
 'fuel_type': 'diesel',
 'id': 'c733c6ea-4f18-52f7-a1a7-95d147fdece7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP99101',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Volkswagen',
 'model': 'Arteon',
 'odometer': 168049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Arteon 2.0 TDI R-Line Exclusive',
 'transmission': 'automatic',
 'trim': 'R-Line Exclusive',
 'year': 2019}
2026-01-29 06:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GP99101%27 HTTP/1.1" 200 None
2026-01-29 06:08:39 [auto1.fr] INFO: Saving data for GP99101: {'auction_closing_time': 1769704173.0, 'created_time': 1767114391.912417, 'last_price_update_time': 1769666919.935262}
2026-01-29 06:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GP99101') HTTP/1.1" 204 0
2026-01-29 06:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UX68890> (referer: https://www.auto1.com/v1/car-details-view/UX68890/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:08:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 853291d6-0d3c-56e3-9837-911d032a0686 with identifier: UX68890
2026-01-29 06:08:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 853291d6-0d3c-56e3-9837-911d032a0686 with scrape type 2
2026-01-29 06:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 853291d6-0d3c-56e3-9837-911d032a0686 with scrape type 2
2026-01-29 06:08:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 853291d6-0d3c-56e3-9837-911d032a0686, identifier: UX68890
2026-01-29 06:08:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 853291d6-0d3c-56e3-9837-911d032a0686 with identifier: UX68890
2026-01-29 06:08:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 853291d6-0d3c-56e3-9837-911d032a0686 with identifier: UX68890
2026-01-29 06:08:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 170795 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    170795
2026-01-29 06:08:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 853291d6-0d3c-56e3-9837-911d032a0686 spider: auto1.fr
2026-01-29 06:08:40 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 853291d6-0d3c-56e3-9837-911d032a0686 due to rule: high_mileage_for_country.json, error: 170795 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    170795
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:21:19Z',
 'fuel_type': 'diesel',
 'id': '853291d6-0d3c-56e3-9837-911d032a0686',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX68890',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 170795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC40 2.0 D3 Business 2WD',
 'transmission': 'automatic',
 'trim': 'Business 2WD',
 'year': 2018}
2026-01-29 06:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UX68890%27 HTTP/1.1" 200 None
2026-01-29 06:08:40 [auto1.fr] INFO: Saving data for UX68890: {'auction_closing_time': 1769703679.0, 'created_time': 1768903751.087068, 'last_price_update_time': 1769666920.651158}
2026-01-29 06:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UX68890') HTTP/1.1" 204 0
2026-01-29 06:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SU20841> (referer: https://www.auto1.com/v1/car-details-view/SU20841/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:08:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acd26781-6cf6-5a4b-9390-6ca6887be7b2 with identifier: SU20841
2026-01-29 06:08:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acd26781-6cf6-5a4b-9390-6ca6887be7b2 with scrape type 2
2026-01-29 06:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acd26781-6cf6-5a4b-9390-6ca6887be7b2 with scrape type 2
2026-01-29 06:08:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: acd26781-6cf6-5a4b-9390-6ca6887be7b2, identifier: SU20841
2026-01-29 06:08:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: acd26781-6cf6-5a4b-9390-6ca6887be7b2 with identifier: SU20841
2026-01-29 06:08:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: acd26781-6cf6-5a4b-9390-6ca6887be7b2 with identifier: SU20841
2026-01-29 06:08:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 166891 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    166891
2026-01-29 06:08:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: acd26781-6cf6-5a4b-9390-6ca6887be7b2 spider: auto1.fr
2026-01-29 06:08:42 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: acd26781-6cf6-5a4b-9390-6ca6887be7b2 due to rule: high_mileage_for_country.json, error: 166891 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    166891
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-01-29T16:12:05Z',
 'fuel_type': 'diesel',
 'id': 'acd26781-6cf6-5a4b-9390-6ca6887be7b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU20841',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 166891,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 2.0 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2019}
2026-01-29 06:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SU20841%27 HTTP/1.1" 200 None
2026-01-29 06:08:42 [auto1.fr] INFO: Saving data for SU20841: {'auction_closing_time': 1769703125.0, 'created_time': 1768456916.444995, 'last_price_update_time': 1769666922.730226}
2026-01-29 06:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SU20841') HTTP/1.1" 204 0
2026-01-29 06:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WW29549> (referer: https://www.auto1.com/v1/car-details-view/WW29549/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CD59619> (referer: https://www.auto1.com/v1/car-details-view/CD59619/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CU82747> (referer: https://www.auto1.com/v1/car-details-view/CU82747/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef9d2789-6881-5ce9-9dac-5c359ba81fd4 with identifier: WW29549
2026-01-29 06:08:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef9d2789-6881-5ce9-9dac-5c359ba81fd4 with scrape type 2
2026-01-29 06:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef9d2789-6881-5ce9-9dac-5c359ba81fd4 with scrape type 2
2026-01-29 06:08:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ef9d2789-6881-5ce9-9dac-5c359ba81fd4, identifier: WW29549
2026-01-29 06:08:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ef9d2789-6881-5ce9-9dac-5c359ba81fd4 with identifier: WW29549
2026-01-29 06:08:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ef9d2789-6881-5ce9-9dac-5c359ba81fd4 with identifier: WW29549
2026-01-29 06:08:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ef9d2789-6881-5ce9-9dac-5c359ba81fd4 with identifier: WW29549 to the API
2026-01-29 06:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:08:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:08:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WW29549>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:38:53Z',
 'fuel_type': 'petrol',
 'id': 'ef9d2789-6881-5ce9-9dac-5c359ba81fd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW29549',
 'listing': 'auction',
 'location': 'FR, Nanterre',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 87953,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2021}
2026-01-29 06:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WW29549%27 HTTP/1.1" 200 None
2026-01-29 06:08:43 [auto1.fr] INFO: Saving data for WW29549: {'auction_closing_time': 1769704733.0, 'created_time': 1769580228.315388, 'last_price_update_time': 1769666923.257278}
2026-01-29 06:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WW29549') HTTP/1.1" 204 0
2026-01-29 06:08:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 482ebc1a-2f3e-573b-a197-2d5cb2f1426f with identifier: CD59619
2026-01-29 06:08:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 482ebc1a-2f3e-573b-a197-2d5cb2f1426f with scrape type 2
2026-01-29 06:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 482ebc1a-2f3e-573b-a197-2d5cb2f1426f with scrape type 2
2026-01-29 06:08:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 482ebc1a-2f3e-573b-a197-2d5cb2f1426f, identifier: CD59619
2026-01-29 06:08:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bef5a12b-28b0-5b51-9bc1-2f7fba7f70b2 with identifier: CU82747
2026-01-29 06:08:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bef5a12b-28b0-5b51-9bc1-2f7fba7f70b2 with scrape type 2
2026-01-29 06:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bef5a12b-28b0-5b51-9bc1-2f7fba7f70b2 with scrape type 2
2026-01-29 06:08:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bef5a12b-28b0-5b51-9bc1-2f7fba7f70b2, identifier: CU82747
2026-01-29 06:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EL30673/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 482ebc1a-2f3e-573b-a197-2d5cb2f1426f with identifier: CD59619
2026-01-29 06:08:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 482ebc1a-2f3e-573b-a197-2d5cb2f1426f with identifier: CD59619
2026-01-29 06:08:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'renault kadjar 1.2 tce energy intens', 'price': 0, 'currency': 'eur', 'make': 'renault', 'model': 'kadjar', 'transmission': 'manual', 'odometer': 107853, 'odometer_reading_unit': 'km', 'registration_date': '2017-10-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cd59619', 'expiration_date': '2026-01-29t16:20:39z', 'origin_country_code': 'fr', 'trim': 'intens', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 130, 'id': '482ebc1a-2f3e-573b-a197-2d5cb2f1426f', 'current_year_diff': 9, 'age_in_months': 99, 'make_model': 'renault kadjar', 'sanitized_make': 'renault', 'odometer_in_km': 107853}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 99,
     'auction_title': '',
     'c_o_2_emission_value': 130,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:20:39z',
     'fuel_type': 'petrol',
     'id': '482ebc1a-2f3e-573b-a197-2d5cb2f1426f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cd59619',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'renault',
     'make_model': 'renault kadjar',
     'model': 'kadjar',
     'odometer': 107853,
     'odometer_in_km': 107853,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-10-29',
     'sanitized_make': 'renault',
     'seats_number': 5,
     'seller_name': None,
     'title': 'renault kadjar 1.2 tce energy intens',
     'transmission': 'manual',
     'trim': 'intens',
     'year': 2017}
2026-01-29 06:08:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 482ebc1a-2f3e-573b-a197-2d5cb2f1426f spider: auto1.fr
2026-01-29 06:08:43 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 482ebc1a-2f3e-573b-a197-2d5cb2f1426f due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'renault kadjar 1.2 tce energy intens', 'price': 0, 'currency': 'eur', 'make': 'renault', 'model': 'kadjar', 'transmission': 'manual', 'odometer': 107853, 'odometer_reading_unit': 'km', 'registration_date': '2017-10-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cd59619', 'expiration_date': '2026-01-29t16:20:39z', 'origin_country_code': 'fr', 'trim': 'intens', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 130, 'id': '482ebc1a-2f3e-573b-a197-2d5cb2f1426f', 'current_year_diff': 9, 'age_in_months': 99, 'make_model': 'renault kadjar', 'sanitized_make': 'renault', 'odometer_in_km': 107853}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 99,
     'auction_title': '',
     'c_o_2_emission_value': 130,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:20:39z',
     'fuel_type': 'petrol',
     'id': '482ebc1a-2f3e-573b-a197-2d5cb2f1426f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cd59619',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'renault',
     'make_model': 'renault kadjar',
     'model': 'kadjar',
     'odometer': 107853,
     'odometer_in_km': 107853,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-10-29',
     'sanitized_make': 'renault',
     'seats_number': 5,
     'seller_name': None,
     'title': 'renault kadjar 1.2 tce energy intens',
     'transmission': 'manual',
     'trim': 'intens',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:20:39Z',
 'fuel_type': 'petrol',
 'id': '482ebc1a-2f3e-573b-a197-2d5cb2f1426f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD59619',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 107853,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Kadjar 1.2 TCe Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2017}
2026-01-29 06:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CD59619%27 HTTP/1.1" 200 None
2026-01-29 06:08:43 [auto1.fr] INFO: Saving data for CD59619: {'auction_closing_time': 1769703639.0, 'created_time': 1767978729.157315, 'last_price_update_time': 1769666923.749274}
2026-01-29 06:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CD59619') HTTP/1.1" 204 0
2026-01-29 06:08:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bef5a12b-28b0-5b51-9bc1-2f7fba7f70b2 with identifier: CU82747
2026-01-29 06:08:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bef5a12b-28b0-5b51-9bc1-2f7fba7f70b2 with identifier: CU82747
2026-01-29 06:08:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 64406, 'odometer_reading_unit': 'km', 'registration_date': '2022-12-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cu82747', 'expiration_date': '2026-01-29t16:43:06z', 'origin_country_code': 'fr', 'trim': 'elegance', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, la chapelle longueville', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 131, 'id': 'bef5a12b-28b0-5b51-9bc1-2f7fba7f70b2', 'current_year_diff': 4, 'age_in_months': 37, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 64406}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 37,
     'auction_title': '',
     'c_o_2_emission_value': 131,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:43:06z',
     'fuel_type': 'petrol',
     'id': 'bef5a12b-28b0-5b51-9bc1-2f7fba7f70b2',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cu82747',
     'listing': 'auction',
     'location': 'fr, la chapelle longueville',
     'make': 'opel',
     'make_model': 'opel crossland x',
     'model': 'crossland x',
     'odometer': 64406,
     'odometer_in_km': 64406,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-12-29',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel crossland x 1.2 turbo elegance',
     'transmission': 'manual',
     'trim': 'elegance',
     'year': 2022}
2026-01-29 06:08:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: bef5a12b-28b0-5b51-9bc1-2f7fba7f70b2 spider: auto1.fr
2026-01-29 06:08:43 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: bef5a12b-28b0-5b51-9bc1-2f7fba7f70b2 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 64406, 'odometer_reading_unit': 'km', 'registration_date': '2022-12-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cu82747', 'expiration_date': '2026-01-29t16:43:06z', 'origin_country_code': 'fr', 'trim': 'elegance', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, la chapelle longueville', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 131, 'id': 'bef5a12b-28b0-5b51-9bc1-2f7fba7f70b2', 'current_year_diff': 4, 'age_in_months': 37, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 64406}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 37,
     'auction_title': '',
     'c_o_2_emission_value': 131,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:43:06z',
     'fuel_type': 'petrol',
     'id': 'bef5a12b-28b0-5b51-9bc1-2f7fba7f70b2',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cu82747',
     'listing': 'auction',
     'location': 'fr, la chapelle longueville',
     'make': 'opel',
     'make_model': 'opel crossland x',
     'model': 'crossland x',
     'odometer': 64406,
     'odometer_in_km': 64406,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-12-29',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel crossland x 1.2 turbo elegance',
     'transmission': 'manual',
     'trim': 'elegance',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:43:06Z',
 'fuel_type': 'petrol',
 'id': 'bef5a12b-28b0-5b51-9bc1-2f7fba7f70b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU82747',
 'listing': 'auction',
 'location': 'FR, LA CHAPELLE LONGUEVILLE',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 64406,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2022}
2026-01-29 06:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CU82747%27 HTTP/1.1" 200 None
2026-01-29 06:08:43 [auto1.fr] INFO: Saving data for CU82747: {'auction_closing_time': 1769704986.0, 'created_time': 1768903399.766588, 'last_price_update_time': 1769666923.977798}
2026-01-29 06:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CU82747') HTTP/1.1" 204 0
2026-01-29 06:08:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EL30673> (referer: https://www.auto1.com/v1/car-details-view/EL30673/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f64950e8-d011-5825-aea9-3674672cad5e with identifier: EL30673
2026-01-29 06:08:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f64950e8-d011-5825-aea9-3674672cad5e with scrape type 2
2026-01-29 06:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f64950e8-d011-5825-aea9-3674672cad5e with scrape type 2
2026-01-29 06:08:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f64950e8-d011-5825-aea9-3674672cad5e, identifier: EL30673
2026-01-29 06:08:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f64950e8-d011-5825-aea9-3674672cad5e with identifier: EL30673
2026-01-29 06:08:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f64950e8-d011-5825-aea9-3674672cad5e with identifier: EL30673
2026-01-29 06:08:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f64950e8-d011-5825-aea9-3674672cad5e with identifier: EL30673 to the API
2026-01-29 06:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:08:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:08:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EL30673>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:59:18Z',
 'fuel_type': 'diesel',
 'id': 'f64950e8-d011-5825-aea9-3674672cad5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL30673',
 'listing': 'auction',
 'location': 'Nice',
 'make': 'Land Rover',
 'model': 'Evoque Cabriolet',
 'odometer': 103353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-10',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Land Rover Evoque Cabriolet 2.0 Td4 HSE Dynamic',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic',
 'year': 2017}
2026-01-29 06:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EL30673%27 HTTP/1.1" 200 None
2026-01-29 06:08:45 [auto1.fr] INFO: Saving data for EL30673: {'auction_closing_time': 1769705958.0, 'created_time': 1769534117.12232, 'last_price_update_time': 1769666925.403451}
2026-01-29 06:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EL30673') HTTP/1.1" 204 0
2026-01-29 06:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PX90385> (referer: https://www.auto1.com/v1/car-details-view/PX90385/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB94762> (referer: https://www.auto1.com/v1/car-details-view/JB94762/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8450d77b-4f0c-5e34-9e1b-377bafff5aaf with identifier: PX90385
2026-01-29 06:08:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8450d77b-4f0c-5e34-9e1b-377bafff5aaf with scrape type 2
2026-01-29 06:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8450d77b-4f0c-5e34-9e1b-377bafff5aaf with scrape type 2
2026-01-29 06:08:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8450d77b-4f0c-5e34-9e1b-377bafff5aaf, identifier: PX90385
2026-01-29 06:08:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8450d77b-4f0c-5e34-9e1b-377bafff5aaf with identifier: PX90385
2026-01-29 06:08:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8450d77b-4f0c-5e34-9e1b-377bafff5aaf with identifier: PX90385
2026-01-29 06:08:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 24848, 'odometer_reading_unit': 'km', 'registration_date': '2021-11-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/px90385', 'expiration_date': '2026-01-29t16:16:04z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, échirolles', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 123, 'id': '8450d77b-4f0c-5e34-9e1b-377bafff5aaf', 'current_year_diff': 5, 'age_in_months': 50, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 24848}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 50,
     'auction_title': '',
     'c_o_2_emission_value': 123,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:16:04z',
     'fuel_type': 'petrol',
     'id': '8450d77b-4f0c-5e34-9e1b-377bafff5aaf',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/px90385',
     'listing': 'auction',
     'location': 'fr, échirolles',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 24848,
     'odometer_in_km': 24848,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-11-29',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2021}
2026-01-29 06:08:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 8450d77b-4f0c-5e34-9e1b-377bafff5aaf spider: auto1.fr
2026-01-29 06:08:45 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 8450d77b-4f0c-5e34-9e1b-377bafff5aaf due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 24848, 'odometer_reading_unit': 'km', 'registration_date': '2021-11-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/px90385', 'expiration_date': '2026-01-29t16:16:04z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, échirolles', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 123, 'id': '8450d77b-4f0c-5e34-9e1b-377bafff5aaf', 'current_year_diff': 5, 'age_in_months': 50, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 24848}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 50,
     'auction_title': '',
     'c_o_2_emission_value': 123,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:16:04z',
     'fuel_type': 'petrol',
     'id': '8450d77b-4f0c-5e34-9e1b-377bafff5aaf',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/px90385',
     'listing': 'auction',
     'location': 'fr, échirolles',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 24848,
     'odometer_in_km': 24848,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-11-29',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:16:04Z',
 'fuel_type': 'petrol',
 'id': '8450d77b-4f0c-5e34-9e1b-377bafff5aaf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX90385',
 'listing': 'auction',
 'location': 'FR, Échirolles',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 24848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2021}
2026-01-29 06:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX90385%27 HTTP/1.1" 200 None
2026-01-29 06:08:45 [auto1.fr] INFO: Saving data for PX90385: {'auction_closing_time': 1769703364.0, 'created_time': 1769580226.401372, 'last_price_update_time': 1769666925.818312}
2026-01-29 06:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PX90385') HTTP/1.1" 204 0
2026-01-29 06:08:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75bafa4b-45db-55a1-8ed2-411fb8304577 with identifier: JB94762
2026-01-29 06:08:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75bafa4b-45db-55a1-8ed2-411fb8304577 with scrape type 2
2026-01-29 06:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75bafa4b-45db-55a1-8ed2-411fb8304577 with scrape type 2
2026-01-29 06:08:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 75bafa4b-45db-55a1-8ed2-411fb8304577, identifier: JB94762
2026-01-29 06:08:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 75bafa4b-45db-55a1-8ed2-411fb8304577 with identifier: JB94762
2026-01-29 06:08:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 75bafa4b-45db-55a1-8ed2-411fb8304577 with identifier: JB94762
2026-01-29 06:08:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c5 x 1.6 puretech shine pack', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c5 x', 'transmission': 'automatic', 'odometer': 36469, 'odometer_reading_unit': 'km', 'registration_date': '2022-01-06', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jb94762', 'expiration_date': '2026-01-29t16:49:46z', 'origin_country_code': 'fr', 'trim': 'shine pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 181, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.6l', 'location': 'fr, marseille', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 147, 'id': '75bafa4b-45db-55a1-8ed2-411fb8304577', 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'citroen c5 x', 'sanitized_make': 'citroen', 'odometer_in_km': 36469}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': 147,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.6l',
     'engine_horse_power': 181,
     'expiration_date': '2026-01-29t16:49:46z',
     'fuel_type': 'petrol',
     'id': '75bafa4b-45db-55a1-8ed2-411fb8304577',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jb94762',
     'listing': 'auction',
     'location': 'fr, marseille',
     'make': 'citroen',
     'make_model': 'citroen c5 x',
     'model': 'c5 x',
     'odometer': 36469,
     'odometer_in_km': 36469,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-01-06',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c5 x 1.6 puretech shine pack',
     'transmission': 'automatic',
     'trim': 'shine pack',
     'year': 2022}
2026-01-29 06:08:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 75bafa4b-45db-55a1-8ed2-411fb8304577 spider: auto1.fr
2026-01-29 06:08:46 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 75bafa4b-45db-55a1-8ed2-411fb8304577 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c5 x 1.6 puretech shine pack', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c5 x', 'transmission': 'automatic', 'odometer': 36469, 'odometer_reading_unit': 'km', 'registration_date': '2022-01-06', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jb94762', 'expiration_date': '2026-01-29t16:49:46z', 'origin_country_code': 'fr', 'trim': 'shine pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 181, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.6l', 'location': 'fr, marseille', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 147, 'id': '75bafa4b-45db-55a1-8ed2-411fb8304577', 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'citroen c5 x', 'sanitized_make': 'citroen', 'odometer_in_km': 36469}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': 147,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.6l',
     'engine_horse_power': 181,
     'expiration_date': '2026-01-29t16:49:46z',
     'fuel_type': 'petrol',
     'id': '75bafa4b-45db-55a1-8ed2-411fb8304577',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jb94762',
     'listing': 'auction',
     'location': 'fr, marseille',
     'make': 'citroen',
     'make_model': 'citroen c5 x',
     'model': 'c5 x',
     'odometer': 36469,
     'odometer_in_km': 36469,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-01-06',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c5 x 1.6 puretech shine pack',
     'transmission': 'automatic',
     'trim': 'shine pack',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 181,
 'expiration_date': '2026-01-29T16:49:46Z',
 'fuel_type': 'petrol',
 'id': '75bafa4b-45db-55a1-8ed2-411fb8304577',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB94762',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Citroen',
 'model': 'C5 X',
 'odometer': 36469,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-01-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 X 1.6 PureTech Shine Pack',
 'transmission': 'automatic',
 'trim': 'Shine Pack',
 'year': 2022}
2026-01-29 06:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JB94762%27 HTTP/1.1" 200 None
2026-01-29 06:08:46 [auto1.fr] INFO: Saving data for JB94762: {'auction_closing_time': 1769705386.0, 'created_time': 1768905585.732655, 'last_price_update_time': 1769666926.127751}
2026-01-29 06:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JB94762') HTTP/1.1" 204 0
2026-01-29 06:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RK84609> (referer: https://www.auto1.com/v1/car-details-view/RK84609/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:08:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f4d6433-bcbc-53f4-89a7-f02a4742a434 with identifier: RK84609
2026-01-29 06:08:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f4d6433-bcbc-53f4-89a7-f02a4742a434 with scrape type 2
2026-01-29 06:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f4d6433-bcbc-53f4-89a7-f02a4742a434 with scrape type 2
2026-01-29 06:08:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4f4d6433-bcbc-53f4-89a7-f02a4742a434, identifier: RK84609
2026-01-29 06:08:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4f4d6433-bcbc-53f4-89a7-f02a4742a434 with identifier: RK84609
2026-01-29 06:08:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4f4d6433-bcbc-53f4-89a7-f02a4742a434 with identifier: RK84609
2026-01-29 06:08:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4f4d6433-bcbc-53f4-89a7-f02a4742a434 with identifier: RK84609 to the API
2026-01-29 06:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:08:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:08:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RK84609>
{'auction_title': '',
 'c_o_2_emission_value': 32,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 224,
 'expiration_date': '2026-01-29T16:45:09Z',
 'fuel_type': 'hybrid',
 'id': '4f4d6433-bcbc-53f4-89a7-f02a4742a434',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK84609',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 57466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.6 Plug-in Hybrid ë-EAT8 Shine Pack',
 'transmission': 'automatic',
 'trim': 'Shine Pack',
 'year': 2021}
2026-01-29 06:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RK84609%27 HTTP/1.1" 200 None
2026-01-29 06:08:47 [auto1.fr] INFO: Saving data for RK84609: {'auction_closing_time': 1769705109.0, 'created_time': 1769533581.594119, 'last_price_update_time': 1769666927.061167}
2026-01-29 06:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RK84609') HTTP/1.1" 204 0
2026-01-29 06:09:12 [scrapy.extensions.logstats] INFO: Crawled 693 pages (at 29 pages/min), scraped 150 items (at 5 items/min)
2026-01-29 06:09:34 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.990(s), this was the 1st time calling it.
2026-01-29 06:09:34 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.2963399188610776 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:09:34 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.041(s), this was the 1st time calling it.
2026-01-29 06:09:34 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.214080291421038 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:09:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NG09663/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:09:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:39 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:09:39 [auto1.fr] INFO: Found listing with ID: SJ25086
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SJ25086%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for SJ25086: 2
2026-01-29 06:09:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: CZ17147
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CZ17147%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for CZ17147: 0
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: WN77932
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WN77932%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for WN77932: 2
2026-01-29 06:09:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: GM21218
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GM21218%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for GM21218: 2
2026-01-29 06:09:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: LT01356
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LT01356%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for LT01356: 0
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: FC24694
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FC24694%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for FC24694: 2
2026-01-29 06:09:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: FR23059
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FR23059%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for FR23059: 2
2026-01-29 06:09:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: LZ46490
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LZ46490%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for LZ46490: 2
2026-01-29 06:09:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: HY90910
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HY90910%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for HY90910: 0
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: RE85571
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RE85571%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for RE85571: 2
2026-01-29 06:09:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: BS07935
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BS07935%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for BS07935: 2
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: UN82442
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN82442%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for UN82442: 2
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: SY58833
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SY58833%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for SY58833: 0
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: PS12764
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PS12764%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for PS12764: 0
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: JG06103
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG06103%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for JG06103: 2
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: FG13520
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FG13520%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for FG13520: 2
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: GJ54867
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GJ54867%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for GJ54867: 2
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: CR55622
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CR55622%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for CR55622: 0
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: PZ89879
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PZ89879%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for PZ89879: 2
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: XE08561
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XE08561%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for XE08561: 0
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: CV89119
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CV89119%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for CV89119: 2
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: YA07912
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YA07912%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for YA07912: 0
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: HN28013
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HN28013%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for HN28013: 0
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: RA18506
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RA18506%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for RA18506: 2
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: VY24210
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VY24210%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for VY24210: 0
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: DK16750
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DK16750%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for DK16750: 2
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: XG42198
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XG42198%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for XG42198: 2
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: SL02719
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL02719%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for SL02719: 2
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: XR75814
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XR75814%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for XR75814: 2
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: GT27181
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GT27181%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for GT27181: 2
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: VR79186
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VR79186%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for VR79186: 0
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: BB57639
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BB57639%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for BB57639: 0
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: VJ26258
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VJ26258%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for VJ26258: 2
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: RR81958
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RR81958%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for RR81958: 0
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: JF43127
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JF43127%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for JF43127: 2
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: YF43043
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YF43043%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for YF43043: 2
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: GG15377
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG15377%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for GG15377: 2
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: DJ29822
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DJ29822%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for DJ29822: 2
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: HJ14173
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HJ14173%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for HJ14173: 2
2026-01-29 06:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NG09663> (referer: https://www.auto1.com/v1/car-details-view/NG09663/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:40 [auto1.fr] INFO: Found listing with ID: UT14039
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT14039%27 HTTP/1.1" 200 None
2026-01-29 06:09:40 [auto1.fr] INFO: Scrape type for UT14039: 2
2026-01-29 06:09:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c69053c-c150-5bef-b842-ebd0134dfd71 with identifier: NG09663
2026-01-29 06:09:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c69053c-c150-5bef-b842-ebd0134dfd71 with scrape type 2
2026-01-29 06:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c69053c-c150-5bef-b842-ebd0134dfd71 with scrape type 2
2026-01-29 06:09:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3c69053c-c150-5bef-b842-ebd0134dfd71, identifier: NG09663
2026-01-29 06:09:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3c69053c-c150-5bef-b842-ebd0134dfd71 with identifier: NG09663
2026-01-29 06:09:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3c69053c-c150-5bef-b842-ebd0134dfd71 with identifier: NG09663
2026-01-29 06:09:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3c69053c-c150-5bef-b842-ebd0134dfd71 with identifier: NG09663 to the API
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:09:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NG09663>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:44:41Z',
 'fuel_type': 'diesel',
 'id': '3c69053c-c150-5bef-b842-ebd0134dfd71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG09663',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 110334,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-08-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2022}
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NG09663%27 HTTP/1.1" 200 None
2026-01-29 06:09:41 [auto1.fr] INFO: Saving data for NG09663: {'auction_closing_time': 1769705081.0, 'created_time': 1768891010.639097, 'last_price_update_time': 1769666981.390899}
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NG09663') HTTP/1.1" 204 0
2026-01-29 06:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FC24694/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GM21218/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SJ25086/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WN77932/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FR23059/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:41 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:09:41 [auto1.fr] INFO: Found listing with ID: GL48917
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GL48917%27 HTTP/1.1" 200 None
2026-01-29 06:09:41 [auto1.fr] INFO: Scrape type for GL48917: 2
2026-01-29 06:09:41 [auto1.fr] INFO: Found listing with ID: SZ70278
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SZ70278%27 HTTP/1.1" 200 None
2026-01-29 06:09:41 [auto1.fr] INFO: Scrape type for SZ70278: 0
2026-01-29 06:09:41 [auto1.fr] INFO: Found listing with ID: KL78063
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KL78063%27 HTTP/1.1" 200 None
2026-01-29 06:09:41 [auto1.fr] INFO: Scrape type for KL78063: 0
2026-01-29 06:09:41 [auto1.fr] INFO: Found listing with ID: NY93368
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NY93368%27 HTTP/1.1" 200 None
2026-01-29 06:09:41 [auto1.fr] INFO: Scrape type for NY93368: 0
2026-01-29 06:09:41 [auto1.fr] INFO: Found listing with ID: JY12381
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JY12381%27 HTTP/1.1" 200 None
2026-01-29 06:09:41 [auto1.fr] INFO: Scrape type for JY12381: 0
2026-01-29 06:09:41 [auto1.fr] INFO: Found listing with ID: YK59678
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YK59678%27 HTTP/1.1" 200 None
2026-01-29 06:09:41 [auto1.fr] INFO: Scrape type for YK59678: 0
2026-01-29 06:09:41 [auto1.fr] INFO: Found listing with ID: UW54895
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UW54895%27 HTTP/1.1" 200 None
2026-01-29 06:09:41 [auto1.fr] INFO: Scrape type for UW54895: 0
2026-01-29 06:09:41 [auto1.fr] INFO: Found listing with ID: TA58027
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA58027%27 HTTP/1.1" 200 None
2026-01-29 06:09:41 [auto1.fr] INFO: Scrape type for TA58027: 2
2026-01-29 06:09:41 [auto1.fr] INFO: Found listing with ID: YX73308
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YX73308%27 HTTP/1.1" 200 None
2026-01-29 06:09:41 [auto1.fr] INFO: Scrape type for YX73308: 2
2026-01-29 06:09:41 [auto1.fr] INFO: Found listing with ID: LR87544
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LR87544%27 HTTP/1.1" 200 None
2026-01-29 06:09:41 [auto1.fr] INFO: Scrape type for LR87544: 2
2026-01-29 06:09:41 [auto1.fr] INFO: Found listing with ID: XP15992
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XP15992%27 HTTP/1.1" 200 None
2026-01-29 06:09:41 [auto1.fr] INFO: Scrape type for XP15992: 0
2026-01-29 06:09:41 [auto1.fr] INFO: Found listing with ID: YJ87670
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YJ87670%27 HTTP/1.1" 200 None
2026-01-29 06:09:41 [auto1.fr] INFO: Scrape type for YJ87670: 2
2026-01-29 06:09:41 [auto1.fr] INFO: Found listing with ID: MT00628
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MT00628%27 HTTP/1.1" 200 None
2026-01-29 06:09:41 [auto1.fr] INFO: Scrape type for MT00628: 2
2026-01-29 06:09:41 [auto1.fr] INFO: Found listing with ID: FD02427
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FD02427%27 HTTP/1.1" 200 None
2026-01-29 06:09:41 [auto1.fr] INFO: Scrape type for FD02427: 2
2026-01-29 06:09:41 [auto1.fr] INFO: Found listing with ID: AY94997
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AY94997%27 HTTP/1.1" 200 None
2026-01-29 06:09:41 [auto1.fr] INFO: Scrape type for AY94997: 2
2026-01-29 06:09:41 [auto1.fr] INFO: Found listing with ID: KK77834
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KK77834%27 HTTP/1.1" 200 None
2026-01-29 06:09:41 [auto1.fr] INFO: Scrape type for KK77834: 0
2026-01-29 06:09:41 [auto1.fr] INFO: Found listing with ID: GB99357
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GB99357%27 HTTP/1.1" 200 None
2026-01-29 06:09:41 [auto1.fr] INFO: Scrape type for GB99357: 0
2026-01-29 06:09:41 [auto1.fr] INFO: Found listing with ID: PM65433
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PM65433%27 HTTP/1.1" 200 None
2026-01-29 06:09:41 [auto1.fr] INFO: Scrape type for PM65433: 0
2026-01-29 06:09:41 [auto1.fr] INFO: Found listing with ID: KA86675
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KA86675%27 HTTP/1.1" 200 None
2026-01-29 06:09:41 [auto1.fr] INFO: Scrape type for KA86675: 2
2026-01-29 06:09:41 [auto1.fr] INFO: Found listing with ID: YM09751
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YM09751%27 HTTP/1.1" 200 None
2026-01-29 06:09:41 [auto1.fr] INFO: Scrape type for YM09751: 0
2026-01-29 06:09:41 [auto1.fr] INFO: Found listing with ID: UG75818
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG75818%27 HTTP/1.1" 200 None
2026-01-29 06:09:41 [auto1.fr] INFO: Scrape type for UG75818: 2
2026-01-29 06:09:41 [auto1.fr] INFO: Found listing with ID: NB28845
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NB28845%27 HTTP/1.1" 200 None
2026-01-29 06:09:42 [auto1.fr] INFO: Scrape type for NB28845: 2
2026-01-29 06:09:42 [auto1.fr] INFO: Found listing with ID: YX00402
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YX00402%27 HTTP/1.1" 200 None
2026-01-29 06:09:42 [auto1.fr] INFO: Scrape type for YX00402: 0
2026-01-29 06:09:42 [auto1.fr] INFO: Found listing with ID: GC56093
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GC56093%27 HTTP/1.1" 200 None
2026-01-29 06:09:42 [auto1.fr] INFO: Scrape type for GC56093: 2
2026-01-29 06:09:42 [auto1.fr] INFO: Found listing with ID: GT43215
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GT43215%27 HTTP/1.1" 200 None
2026-01-29 06:09:42 [auto1.fr] INFO: Scrape type for GT43215: 2
2026-01-29 06:09:42 [auto1.fr] INFO: Found listing with ID: CE24246
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CE24246%27 HTTP/1.1" 200 None
2026-01-29 06:09:42 [auto1.fr] INFO: Scrape type for CE24246: 0
2026-01-29 06:09:42 [auto1.fr] INFO: Found listing with ID: PA24759
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PA24759%27 HTTP/1.1" 200 None
2026-01-29 06:09:42 [auto1.fr] INFO: Scrape type for PA24759: 2
2026-01-29 06:09:42 [auto1.fr] INFO: Found listing with ID: UU55981
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UU55981%27 HTTP/1.1" 200 None
2026-01-29 06:09:42 [auto1.fr] INFO: Scrape type for UU55981: 2
2026-01-29 06:09:42 [auto1.fr] INFO: Found listing with ID: UJ46336
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UJ46336%27 HTTP/1.1" 200 None
2026-01-29 06:09:42 [auto1.fr] INFO: Scrape type for UJ46336: 2
2026-01-29 06:09:42 [auto1.fr] INFO: Found listing with ID: CY34538
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY34538%27 HTTP/1.1" 200 None
2026-01-29 06:09:42 [auto1.fr] INFO: Scrape type for CY34538: 0
2026-01-29 06:09:42 [auto1.fr] INFO: Found listing with ID: YP58387
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP58387%27 HTTP/1.1" 200 None
2026-01-29 06:09:42 [auto1.fr] INFO: Scrape type for YP58387: 2
2026-01-29 06:09:42 [auto1.fr] INFO: Found listing with ID: TU93328
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU93328%27 HTTP/1.1" 200 None
2026-01-29 06:09:42 [auto1.fr] INFO: Scrape type for TU93328: 0
2026-01-29 06:09:42 [auto1.fr] INFO: Found listing with ID: SY35669
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SY35669%27 HTTP/1.1" 200 None
2026-01-29 06:09:42 [auto1.fr] INFO: Scrape type for SY35669: 0
2026-01-29 06:09:42 [auto1.fr] INFO: Found listing with ID: PP25941
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PP25941%27 HTTP/1.1" 200 None
2026-01-29 06:09:42 [auto1.fr] INFO: Scrape type for PP25941: 0
2026-01-29 06:09:42 [auto1.fr] INFO: Found listing with ID: BZ82947
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BZ82947%27 HTTP/1.1" 200 None
2026-01-29 06:09:42 [auto1.fr] INFO: Scrape type for BZ82947: 0
2026-01-29 06:09:42 [auto1.fr] INFO: Found listing with ID: PM25787
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PM25787%27 HTTP/1.1" 200 None
2026-01-29 06:09:42 [auto1.fr] INFO: Scrape type for PM25787: 0
2026-01-29 06:09:42 [auto1.fr] INFO: Found listing with ID: YV23889
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YV23889%27 HTTP/1.1" 200 None
2026-01-29 06:09:42 [auto1.fr] INFO: Scrape type for YV23889: 2
2026-01-29 06:09:42 [auto1.fr] INFO: Found listing with ID: TU35968
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU35968%27 HTTP/1.1" 200 None
2026-01-29 06:09:42 [auto1.fr] INFO: Scrape type for TU35968: 2
2026-01-29 06:09:42 [auto1.fr] INFO: Found listing with ID: US49756
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27US49756%27 HTTP/1.1" 200 None
2026-01-29 06:09:42 [auto1.fr] INFO: Scrape type for US49756: 2
2026-01-29 06:09:42 [auto1.fr] INFO: Found listing with ID: JW47367
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JW47367%27 HTTP/1.1" 200 None
2026-01-29 06:09:42 [auto1.fr] INFO: Scrape type for JW47367: 0
2026-01-29 06:09:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RE85571/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UN82442/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PZ89879/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GJ54867/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JG06103/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LZ46490/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BS07935/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CV89119/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HJ14173/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GG15377/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UT14039/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JF43127/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DJ29822/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/US49756/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RE85571> (referer: https://www.auto1.com/v1/car-details-view/RE85571/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TU35968/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d7c3e97-0128-5137-98d8-6946feb62160 with identifier: RE85571
2026-01-29 06:09:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d7c3e97-0128-5137-98d8-6946feb62160 with scrape type 2
2026-01-29 06:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d7c3e97-0128-5137-98d8-6946feb62160 with scrape type 2
2026-01-29 06:09:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8d7c3e97-0128-5137-98d8-6946feb62160, identifier: RE85571
2026-01-29 06:09:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8d7c3e97-0128-5137-98d8-6946feb62160 with identifier: RE85571
2026-01-29 06:09:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8d7c3e97-0128-5137-98d8-6946feb62160 with identifier: RE85571
2026-01-29 06:09:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel mokka x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'mokka x', 'transmission': 'automatic', 'odometer': 51854, 'odometer_reading_unit': 'km', 'registration_date': '2022-11-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/re85571', 'expiration_date': '2026-01-29t16:13:23z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marly-la-ville', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 132, 'id': '8d7c3e97-0128-5137-98d8-6946feb62160', 'current_year_diff': 4, 'age_in_months': 38, 'make_model': 'opel mokka x', 'sanitized_make': 'opel', 'odometer_in_km': 51854}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 38,
     'auction_title': '',
     'c_o_2_emission_value': 132,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:13:23z',
     'fuel_type': 'petrol',
     'id': '8d7c3e97-0128-5137-98d8-6946feb62160',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/re85571',
     'listing': 'auction',
     'location': 'fr, marly-la-ville',
     'make': 'opel',
     'make_model': 'opel mokka x',
     'model': 'mokka x',
     'odometer': 51854,
     'odometer_in_km': 51854,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-11-29',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel mokka x 1.2 turbo business elegance',
     'transmission': 'automatic',
     'trim': 'business elegance',
     'year': 2022}
2026-01-29 06:09:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 8d7c3e97-0128-5137-98d8-6946feb62160 spider: auto1.fr
2026-01-29 06:09:45 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 8d7c3e97-0128-5137-98d8-6946feb62160 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel mokka x 1.2 turbo business elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'mokka x', 'transmission': 'automatic', 'odometer': 51854, 'odometer_reading_unit': 'km', 'registration_date': '2022-11-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/re85571', 'expiration_date': '2026-01-29t16:13:23z', 'origin_country_code': 'fr', 'trim': 'business elegance', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marly-la-ville', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 132, 'id': '8d7c3e97-0128-5137-98d8-6946feb62160', 'current_year_diff': 4, 'age_in_months': 38, 'make_model': 'opel mokka x', 'sanitized_make': 'opel', 'odometer_in_km': 51854}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 38,
     'auction_title': '',
     'c_o_2_emission_value': 132,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:13:23z',
     'fuel_type': 'petrol',
     'id': '8d7c3e97-0128-5137-98d8-6946feb62160',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/re85571',
     'listing': 'auction',
     'location': 'fr, marly-la-ville',
     'make': 'opel',
     'make_model': 'opel mokka x',
     'model': 'mokka x',
     'odometer': 51854,
     'odometer_in_km': 51854,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-11-29',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel mokka x 1.2 turbo business elegance',
     'transmission': 'automatic',
     'trim': 'business elegance',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:13:23Z',
 'fuel_type': 'petrol',
 'id': '8d7c3e97-0128-5137-98d8-6946feb62160',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE85571',
 'listing': 'auction',
 'location': 'FR, Marly-la-ville',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 51854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka X 1.2 Turbo Business Elegance',
 'transmission': 'automatic',
 'trim': 'Business Elegance',
 'year': 2022}
2026-01-29 06:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RE85571%27 HTTP/1.1" 200 None
2026-01-29 06:09:45 [auto1.fr] INFO: Saving data for RE85571: {'auction_closing_time': 1769703203.0, 'created_time': 1768844412.429944, 'last_price_update_time': 1769666985.186496}
2026-01-29 06:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RE85571') HTTP/1.1" 204 0
2026-01-29 06:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PZ89879> (referer: https://www.auto1.com/v1/car-details-view/PZ89879/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VJ26258/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FG13520/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UN82442> (referer: https://www.auto1.com/v1/car-details-view/UN82442/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YF43043/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f6ec14b-1841-5969-99c0-b64f9529b2de with identifier: PZ89879
2026-01-29 06:09:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f6ec14b-1841-5969-99c0-b64f9529b2de with scrape type 2
2026-01-29 06:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f6ec14b-1841-5969-99c0-b64f9529b2de with scrape type 2
2026-01-29 06:09:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5f6ec14b-1841-5969-99c0-b64f9529b2de, identifier: PZ89879
2026-01-29 06:09:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5f6ec14b-1841-5969-99c0-b64f9529b2de with identifier: PZ89879
2026-01-29 06:09:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5f6ec14b-1841-5969-99c0-b64f9529b2de with identifier: PZ89879
2026-01-29 06:09:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'manual', 'odometer': 45805, 'odometer_reading_unit': 'km', 'registration_date': '2023-04-20', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pz89879', 'expiration_date': '2026-01-29t16:39:31z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, rodez', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 132, 'id': '5f6ec14b-1841-5969-99c0-b64f9529b2de', 'current_year_diff': 3, 'age_in_months': 33, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 45805}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 33,
     'auction_title': '',
     'c_o_2_emission_value': 132,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:39:31z',
     'fuel_type': 'petrol',
     'id': '5f6ec14b-1841-5969-99c0-b64f9529b2de',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pz89879',
     'listing': 'auction',
     'location': 'fr, rodez',
     'make': 'citroen',
     'make_model': 'citroen c3 aircross',
     'model': 'c3 aircross',
     'odometer': 45805,
     'odometer_in_km': 45805,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-04-20',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 aircross 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2023}
2026-01-29 06:09:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 5f6ec14b-1841-5969-99c0-b64f9529b2de spider: auto1.fr
2026-01-29 06:09:45 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 5f6ec14b-1841-5969-99c0-b64f9529b2de due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'manual', 'odometer': 45805, 'odometer_reading_unit': 'km', 'registration_date': '2023-04-20', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pz89879', 'expiration_date': '2026-01-29t16:39:31z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, rodez', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 132, 'id': '5f6ec14b-1841-5969-99c0-b64f9529b2de', 'current_year_diff': 3, 'age_in_months': 33, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 45805}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 33,
     'auction_title': '',
     'c_o_2_emission_value': 132,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:39:31z',
     'fuel_type': 'petrol',
     'id': '5f6ec14b-1841-5969-99c0-b64f9529b2de',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pz89879',
     'listing': 'auction',
     'location': 'fr, rodez',
     'make': 'citroen',
     'make_model': 'citroen c3 aircross',
     'model': 'c3 aircross',
     'odometer': 45805,
     'odometer_in_km': 45805,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-04-20',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 aircross 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:39:31Z',
 'fuel_type': 'petrol',
 'id': '5f6ec14b-1841-5969-99c0-b64f9529b2de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ89879',
 'listing': 'auction',
 'location': 'FR, Rodez',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 45805,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2023}
2026-01-29 06:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PZ89879%27 HTTP/1.1" 200 None
2026-01-29 06:09:45 [auto1.fr] INFO: Saving data for PZ89879: {'auction_closing_time': 1769704771.0, 'created_time': 1769580218.592491, 'last_price_update_time': 1769666985.678345}
2026-01-29 06:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PZ89879') HTTP/1.1" 204 0
2026-01-29 06:09:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fa850a9-1365-5a36-8813-00aa878cd47a with identifier: UN82442
2026-01-29 06:09:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fa850a9-1365-5a36-8813-00aa878cd47a with scrape type 2
2026-01-29 06:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fa850a9-1365-5a36-8813-00aa878cd47a with scrape type 2
2026-01-29 06:09:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9fa850a9-1365-5a36-8813-00aa878cd47a, identifier: UN82442
2026-01-29 06:09:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9fa850a9-1365-5a36-8813-00aa878cd47a with identifier: UN82442
2026-01-29 06:09:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9fa850a9-1365-5a36-8813-00aa878cd47a with identifier: UN82442
2026-01-29 06:09:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 vti allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 83426, 'odometer_reading_unit': 'km', 'registration_date': '2018-03-14', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/un82442', 'expiration_date': '2026-01-29t16:50:58z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, warluis', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 104, 'id': '9fa850a9-1365-5a36-8813-00aa878cd47a', 'current_year_diff': 8, 'age_in_months': 94, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 83426}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 94,
     'auction_title': '',
     'c_o_2_emission_value': 104,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:50:58z',
     'fuel_type': 'petrol',
     'id': '9fa850a9-1365-5a36-8813-00aa878cd47a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/un82442',
     'listing': 'auction',
     'location': 'fr, warluis',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 83426,
     'odometer_in_km': 83426,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-03-14',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 vti allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2018}
2026-01-29 06:09:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 9fa850a9-1365-5a36-8813-00aa878cd47a spider: auto1.fr
2026-01-29 06:09:45 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 9fa850a9-1365-5a36-8813-00aa878cd47a due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 vti allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 83426, 'odometer_reading_unit': 'km', 'registration_date': '2018-03-14', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/un82442', 'expiration_date': '2026-01-29t16:50:58z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, warluis', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 104, 'id': '9fa850a9-1365-5a36-8813-00aa878cd47a', 'current_year_diff': 8, 'age_in_months': 94, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 83426}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 94,
     'auction_title': '',
     'c_o_2_emission_value': 104,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:50:58z',
     'fuel_type': 'petrol',
     'id': '9fa850a9-1365-5a36-8813-00aa878cd47a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/un82442',
     'listing': 'auction',
     'location': 'fr, warluis',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 83426,
     'odometer_in_km': 83426,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-03-14',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 vti allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:50:58Z',
 'fuel_type': 'petrol',
 'id': '9fa850a9-1365-5a36-8813-00aa878cd47a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN82442',
 'listing': 'auction',
 'location': 'FR, Warluis',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 83426,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2018}
2026-01-29 06:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN82442%27 HTTP/1.1" 200 None
2026-01-29 06:09:45 [auto1.fr] INFO: Saving data for UN82442: {'auction_closing_time': 1769705458.0, 'created_time': 1769533799.398288, 'last_price_update_time': 1769666985.993525}
2026-01-29 06:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UN82442') HTTP/1.1" 204 0
2026-01-29 06:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YV23889/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BS07935> (referer: https://www.auto1.com/v1/car-details-view/BS07935/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a511bcb8-4261-5b38-bfdc-99eaf0c88c47 with identifier: BS07935
2026-01-29 06:09:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a511bcb8-4261-5b38-bfdc-99eaf0c88c47 with scrape type 2
2026-01-29 06:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a511bcb8-4261-5b38-bfdc-99eaf0c88c47 with scrape type 2
2026-01-29 06:09:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a511bcb8-4261-5b38-bfdc-99eaf0c88c47, identifier: BS07935
2026-01-29 06:09:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a511bcb8-4261-5b38-bfdc-99eaf0c88c47 with identifier: BS07935
2026-01-29 06:09:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a511bcb8-4261-5b38-bfdc-99eaf0c88c47 with identifier: BS07935
2026-01-29 06:09:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a511bcb8-4261-5b38-bfdc-99eaf0c88c47 with identifier: BS07935 to the API
2026-01-29 06:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:09:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:09:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BS07935>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:19:29Z',
 'fuel_type': 'petrol',
 'id': 'a511bcb8-4261-5b38-bfdc-99eaf0c88c47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS07935',
 'listing': 'auction',
 'location': 'FR, LE HAVRE',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 88394,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Carat',
 'transmission': 'manual',
 'trim': 'Carat',
 'year': 2020}
2026-01-29 06:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BS07935%27 HTTP/1.1" 200 None
2026-01-29 06:09:47 [auto1.fr] INFO: Saving data for BS07935: {'auction_closing_time': 1769703569.0, 'created_time': 1769533709.412267, 'last_price_update_time': 1769666987.154255}
2026-01-29 06:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BS07935') HTTP/1.1" 204 0
2026-01-29 06:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CV89119> (referer: https://www.auto1.com/v1/car-details-view/CV89119/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JG06103> (referer: https://www.auto1.com/v1/car-details-view/JG06103/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HJ14173> (referer: https://www.auto1.com/v1/car-details-view/HJ14173/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LZ46490> (referer: https://www.auto1.com/v1/car-details-view/LZ46490/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JF43127> (referer: https://www.auto1.com/v1/car-details-view/JF43127/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DJ29822> (referer: https://www.auto1.com/v1/car-details-view/DJ29822/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33eee371-c0fd-5404-80c1-2dec2afd61b8 with identifier: CV89119
2026-01-29 06:09:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33eee371-c0fd-5404-80c1-2dec2afd61b8 with scrape type 2
2026-01-29 06:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33eee371-c0fd-5404-80c1-2dec2afd61b8 with scrape type 2
2026-01-29 06:09:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 33eee371-c0fd-5404-80c1-2dec2afd61b8, identifier: CV89119
2026-01-29 06:09:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 33eee371-c0fd-5404-80c1-2dec2afd61b8 with identifier: CV89119
2026-01-29 06:09:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 33eee371-c0fd-5404-80c1-2dec2afd61b8 with identifier: CV89119
2026-01-29 06:09:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 33eee371-c0fd-5404-80c1-2dec2afd61b8 with identifier: CV89119 to the API
2026-01-29 06:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:09:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:09:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CV89119>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 91,
 'expiration_date': '2026-01-29T16:40:29Z',
 'fuel_type': 'petrol',
 'id': '33eee371-c0fd-5404-80c1-2dec2afd61b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV89119',
 'listing': 'auction',
 'location': 'FR, Montataire',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 55254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-01-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.0 TCe Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2021}
2026-01-29 06:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CV89119%27 HTTP/1.1" 200 None
2026-01-29 06:09:47 [auto1.fr] INFO: Saving data for CV89119: {'auction_closing_time': 1769704829.0, 'created_time': 1769534149.498377, 'last_price_update_time': 1769666987.655094}
2026-01-29 06:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CV89119') HTTP/1.1" 204 0
2026-01-29 06:09:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2c3beae-0506-59b8-a72e-95cf1241523c with identifier: JG06103
2026-01-29 06:09:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2c3beae-0506-59b8-a72e-95cf1241523c with scrape type 2
2026-01-29 06:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2c3beae-0506-59b8-a72e-95cf1241523c with scrape type 2
2026-01-29 06:09:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a2c3beae-0506-59b8-a72e-95cf1241523c, identifier: JG06103
2026-01-29 06:09:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 954438fe-cdf1-5649-ba65-d5fd9f57f353 with identifier: HJ14173
2026-01-29 06:09:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 954438fe-cdf1-5649-ba65-d5fd9f57f353 with scrape type 2
2026-01-29 06:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 954438fe-cdf1-5649-ba65-d5fd9f57f353 with scrape type 2
2026-01-29 06:09:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 954438fe-cdf1-5649-ba65-d5fd9f57f353, identifier: HJ14173
2026-01-29 06:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GJ54867> (referer: https://www.auto1.com/v1/car-details-view/GJ54867/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a2c3beae-0506-59b8-a72e-95cf1241523c with identifier: JG06103
2026-01-29 06:09:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a2c3beae-0506-59b8-a72e-95cf1241523c with identifier: JG06103
2026-01-29 06:09:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 176452 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    176452
2026-01-29 06:09:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: a2c3beae-0506-59b8-a72e-95cf1241523c spider: auto1.fr
2026-01-29 06:09:48 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: a2c3beae-0506-59b8-a72e-95cf1241523c due to rule: high_mileage_for_country.json, error: 176452 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    176452
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:40:02Z',
 'fuel_type': 'diesel',
 'id': 'a2c3beae-0506-59b8-a72e-95cf1241523c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG06103',
 'listing': 'auction',
 'location': 'FR, Wavrin',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 176452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-15',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.6 Blue-HDi Live',
 'transmission': 'manual',
 'trim': 'Live',
 'year': 2018}
2026-01-29 06:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG06103%27 HTTP/1.1" 200 None
2026-01-29 06:09:48 [auto1.fr] INFO: Saving data for JG06103: {'auction_closing_time': 1769704802.0, 'created_time': 1768928679.693077, 'last_price_update_time': 1769666988.135298}
2026-01-29 06:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JG06103') HTTP/1.1" 204 0
2026-01-29 06:09:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 954438fe-cdf1-5649-ba65-d5fd9f57f353 with identifier: HJ14173
2026-01-29 06:09:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 954438fe-cdf1-5649-ba65-d5fd9f57f353 with identifier: HJ14173
2026-01-29 06:09:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c5 aircross 1.6 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c5 aircross', 'transmission': 'automatic', 'odometer': 110836, 'odometer_reading_unit': 'km', 'registration_date': '2019-10-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hj14173', 'expiration_date': '2026-01-29t16:11:11z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 181, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.6l', 'location': 'fr, allennes-les-marais', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 128, 'id': '954438fe-cdf1-5649-ba65-d5fd9f57f353', 'current_year_diff': 7, 'age_in_months': 75, 'make_model': 'citroen c5 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 110836}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 75,
     'auction_title': '',
     'c_o_2_emission_value': 128,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.6l',
     'engine_horse_power': 181,
     'expiration_date': '2026-01-29t16:11:11z',
     'fuel_type': 'petrol',
     'id': '954438fe-cdf1-5649-ba65-d5fd9f57f353',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hj14173',
     'listing': 'auction',
     'location': 'fr, allennes-les-marais',
     'make': 'citroen',
     'make_model': 'citroen c5 aircross',
     'model': 'c5 aircross',
     'odometer': 110836,
     'odometer_in_km': 110836,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-10-29',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c5 aircross 1.6 puretech shine',
     'transmission': 'automatic',
     'trim': 'shine',
     'year': 2019}
2026-01-29 06:09:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 954438fe-cdf1-5649-ba65-d5fd9f57f353 spider: auto1.fr
2026-01-29 06:09:48 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 954438fe-cdf1-5649-ba65-d5fd9f57f353 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c5 aircross 1.6 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c5 aircross', 'transmission': 'automatic', 'odometer': 110836, 'odometer_reading_unit': 'km', 'registration_date': '2019-10-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hj14173', 'expiration_date': '2026-01-29t16:11:11z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 181, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.6l', 'location': 'fr, allennes-les-marais', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 128, 'id': '954438fe-cdf1-5649-ba65-d5fd9f57f353', 'current_year_diff': 7, 'age_in_months': 75, 'make_model': 'citroen c5 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 110836}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 75,
     'auction_title': '',
     'c_o_2_emission_value': 128,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.6l',
     'engine_horse_power': 181,
     'expiration_date': '2026-01-29t16:11:11z',
     'fuel_type': 'petrol',
     'id': '954438fe-cdf1-5649-ba65-d5fd9f57f353',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hj14173',
     'listing': 'auction',
     'location': 'fr, allennes-les-marais',
     'make': 'citroen',
     'make_model': 'citroen c5 aircross',
     'model': 'c5 aircross',
     'odometer': 110836,
     'odometer_in_km': 110836,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-10-29',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c5 aircross 1.6 puretech shine',
     'transmission': 'automatic',
     'trim': 'shine',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 181,
 'expiration_date': '2026-01-29T16:11:11Z',
 'fuel_type': 'petrol',
 'id': '954438fe-cdf1-5649-ba65-d5fd9f57f353',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ14173',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 110836,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.6 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2019}
2026-01-29 06:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HJ14173%27 HTTP/1.1" 200 None
2026-01-29 06:09:48 [auto1.fr] INFO: Saving data for HJ14173: {'auction_closing_time': 1769703071.0, 'created_time': 1768669248.049835, 'last_price_update_time': 1769666988.350852}
2026-01-29 06:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HJ14173') HTTP/1.1" 204 0
2026-01-29 06:09:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64d38f2a-621f-53d9-91a4-925344658ed9 with identifier: LZ46490
2026-01-29 06:09:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64d38f2a-621f-53d9-91a4-925344658ed9 with scrape type 2
2026-01-29 06:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64d38f2a-621f-53d9-91a4-925344658ed9 with scrape type 2
2026-01-29 06:09:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 64d38f2a-621f-53d9-91a4-925344658ed9, identifier: LZ46490
2026-01-29 06:09:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c371f746-d6b2-5614-9158-586cb36ad3fb with identifier: JF43127
2026-01-29 06:09:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c371f746-d6b2-5614-9158-586cb36ad3fb with scrape type 2
2026-01-29 06:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c371f746-d6b2-5614-9158-586cb36ad3fb with scrape type 2
2026-01-29 06:09:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c371f746-d6b2-5614-9158-586cb36ad3fb, identifier: JF43127
2026-01-29 06:09:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bc29799-83f2-5b5f-a8f2-e1dc0006c420 with identifier: DJ29822
2026-01-29 06:09:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bc29799-83f2-5b5f-a8f2-e1dc0006c420 with scrape type 2
2026-01-29 06:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bc29799-83f2-5b5f-a8f2-e1dc0006c420 with scrape type 2
2026-01-29 06:09:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0bc29799-83f2-5b5f-a8f2-e1dc0006c420, identifier: DJ29822
2026-01-29 06:09:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 64d38f2a-621f-53d9-91a4-925344658ed9 with identifier: LZ46490
2026-01-29 06:09:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 64d38f2a-621f-53d9-91a4-925344658ed9 with identifier: LZ46490
2026-01-29 06:09:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 64d38f2a-621f-53d9-91a4-925344658ed9 with identifier: LZ46490 to the API
2026-01-29 06:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:09:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:09:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LZ46490>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:00:09Z',
 'fuel_type': 'diesel',
 'id': '64d38f2a-621f-53d9-91a4-925344658ed9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ46490',
 'listing': 'auction',
 'location': 'Aubière',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 145955,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2019}
2026-01-29 06:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LZ46490%27 HTTP/1.1" 200 None
2026-01-29 06:09:49 [auto1.fr] INFO: Saving data for LZ46490: {'auction_closing_time': 1769702409.0, 'created_time': 1769534054.267239, 'last_price_update_time': 1769666989.007567}
2026-01-29 06:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LZ46490') HTTP/1.1" 204 0
2026-01-29 06:09:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c371f746-d6b2-5614-9158-586cb36ad3fb with identifier: JF43127
2026-01-29 06:09:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c371f746-d6b2-5614-9158-586cb36ad3fb with identifier: JF43127
2026-01-29 06:09:49 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech graphic', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 76668, 'odometer_reading_unit': 'km', 'registration_date': '2020-01-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jf43127', 'expiration_date': '2026-01-29t16:22:42z', 'origin_country_code': 'fr', 'trim': 'graphic', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 96, 'id': 'c371f746-d6b2-5614-9158-586cb36ad3fb', 'current_year_diff': 6, 'age_in_months': 72, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 76668}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 72,
     'auction_title': '',
     'c_o_2_emission_value': 96,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:22:42z',
     'fuel_type': 'petrol',
     'id': 'c371f746-d6b2-5614-9158-586cb36ad3fb',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jf43127',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 76668,
     'odometer_in_km': 76668,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-01-26',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech graphic',
     'transmission': 'manual',
     'trim': 'graphic',
     'year': 2020}
2026-01-29 06:09:49 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: c371f746-d6b2-5614-9158-586cb36ad3fb spider: auto1.fr
2026-01-29 06:09:49 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: c371f746-d6b2-5614-9158-586cb36ad3fb due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech graphic', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 76668, 'odometer_reading_unit': 'km', 'registration_date': '2020-01-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jf43127', 'expiration_date': '2026-01-29t16:22:42z', 'origin_country_code': 'fr', 'trim': 'graphic', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 96, 'id': 'c371f746-d6b2-5614-9158-586cb36ad3fb', 'current_year_diff': 6, 'age_in_months': 72, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 76668}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 72,
     'auction_title': '',
     'c_o_2_emission_value': 96,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:22:42z',
     'fuel_type': 'petrol',
     'id': 'c371f746-d6b2-5614-9158-586cb36ad3fb',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jf43127',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 76668,
     'odometer_in_km': 76668,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-01-26',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech graphic',
     'transmission': 'manual',
     'trim': 'graphic',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:22:42Z',
 'fuel_type': 'petrol',
 'id': 'c371f746-d6b2-5614-9158-586cb36ad3fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF43127',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 76668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Graphic',
 'transmission': 'manual',
 'trim': 'Graphic',
 'year': 2020}
2026-01-29 06:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JF43127%27 HTTP/1.1" 200 None
2026-01-29 06:09:49 [auto1.fr] INFO: Saving data for JF43127: {'auction_closing_time': 1769703762.0, 'created_time': 1769533792.110789, 'last_price_update_time': 1769666989.225717}
2026-01-29 06:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JF43127') HTTP/1.1" 204 0
2026-01-29 06:09:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0bc29799-83f2-5b5f-a8f2-e1dc0006c420 with identifier: DJ29822
2026-01-29 06:09:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0bc29799-83f2-5b5f-a8f2-e1dc0006c420 with identifier: DJ29822
2026-01-29 06:09:49 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c4 cactus 1.2 e-thp live', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c4 cactus', 'transmission': 'manual', 'odometer': 73306, 'odometer_reading_unit': 'km', 'registration_date': '2018-07-03', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dj29822', 'expiration_date': '2026-01-29t16:02:06z', 'origin_country_code': 'fr', 'trim': 'live', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, le boulou', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 104, 'id': '0bc29799-83f2-5b5f-a8f2-e1dc0006c420', 'current_year_diff': 8, 'age_in_months': 90, 'make_model': 'citroen c4 cactus', 'sanitized_make': 'citroen', 'odometer_in_km': 73306}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 90,
     'auction_title': '',
     'c_o_2_emission_value': 104,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:02:06z',
     'fuel_type': 'petrol',
     'id': '0bc29799-83f2-5b5f-a8f2-e1dc0006c420',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dj29822',
     'listing': 'auction',
     'location': 'fr, le boulou',
     'make': 'citroen',
     'make_model': 'citroen c4 cactus',
     'model': 'c4 cactus',
     'odometer': 73306,
     'odometer_in_km': 73306,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-07-03',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c4 cactus 1.2 e-thp live',
     'transmission': 'manual',
     'trim': 'live',
     'year': 2018}
2026-01-29 06:09:49 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 0bc29799-83f2-5b5f-a8f2-e1dc0006c420 spider: auto1.fr
2026-01-29 06:09:49 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 0bc29799-83f2-5b5f-a8f2-e1dc0006c420 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c4 cactus 1.2 e-thp live', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c4 cactus', 'transmission': 'manual', 'odometer': 73306, 'odometer_reading_unit': 'km', 'registration_date': '2018-07-03', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dj29822', 'expiration_date': '2026-01-29t16:02:06z', 'origin_country_code': 'fr', 'trim': 'live', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, le boulou', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 104, 'id': '0bc29799-83f2-5b5f-a8f2-e1dc0006c420', 'current_year_diff': 8, 'age_in_months': 90, 'make_model': 'citroen c4 cactus', 'sanitized_make': 'citroen', 'odometer_in_km': 73306}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 90,
     'auction_title': '',
     'c_o_2_emission_value': 104,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:02:06z',
     'fuel_type': 'petrol',
     'id': '0bc29799-83f2-5b5f-a8f2-e1dc0006c420',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dj29822',
     'listing': 'auction',
     'location': 'fr, le boulou',
     'make': 'citroen',
     'make_model': 'citroen c4 cactus',
     'model': 'c4 cactus',
     'odometer': 73306,
     'odometer_in_km': 73306,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-07-03',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c4 cactus 1.2 e-thp live',
     'transmission': 'manual',
     'trim': 'live',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:02:06Z',
 'fuel_type': 'petrol',
 'id': '0bc29799-83f2-5b5f-a8f2-e1dc0006c420',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ29822',
 'listing': 'auction',
 'location': 'FR, Le Boulou',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 73306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 e-THP Live',
 'transmission': 'manual',
 'trim': 'Live',
 'year': 2018}
2026-01-29 06:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DJ29822%27 HTTP/1.1" 200 None
2026-01-29 06:09:49 [auto1.fr] INFO: Saving data for DJ29822: {'auction_closing_time': 1769702526.0, 'created_time': 1769534546.833921, 'last_price_update_time': 1769666989.612916}
2026-01-29 06:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DJ29822') HTTP/1.1" 204 0
2026-01-29 06:09:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bb8ffe5-10dd-527c-8d5e-8d2b5788339a with identifier: GJ54867
2026-01-29 06:09:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bb8ffe5-10dd-527c-8d5e-8d2b5788339a with scrape type 2
2026-01-29 06:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bb8ffe5-10dd-527c-8d5e-8d2b5788339a with scrape type 2
2026-01-29 06:09:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9bb8ffe5-10dd-527c-8d5e-8d2b5788339a, identifier: GJ54867
2026-01-29 06:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YP58387/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UU55981/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9bb8ffe5-10dd-527c-8d5e-8d2b5788339a with identifier: GJ54867
2026-01-29 06:09:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9bb8ffe5-10dd-527c-8d5e-8d2b5788339a with identifier: GJ54867
2026-01-29 06:09:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9bb8ffe5-10dd-527c-8d5e-8d2b5788339a with identifier: GJ54867 to the API
2026-01-29 06:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:09:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:09:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GJ54867>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:50:20Z',
 'fuel_type': 'diesel',
 'id': '9bb8ffe5-10dd-527c-8d5e-8d2b5788339a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ54867',
 'listing': 'auction',
 'location': 'FR, Quincieux',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 95271,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-01-29 06:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GJ54867%27 HTTP/1.1" 200 None
2026-01-29 06:09:50 [auto1.fr] INFO: Saving data for GJ54867: {'auction_closing_time': 1769705420.0, 'created_time': 1769533828.205398, 'last_price_update_time': 1769666990.110428}
2026-01-29 06:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GJ54867') HTTP/1.1" 204 0
2026-01-29 06:09:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/US49756> (referer: https://www.auto1.com/v1/car-details-view/US49756/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UJ46336/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GG15377> (referer: https://www.auto1.com/v1/car-details-view/GG15377/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UT14039> (referer: https://www.auto1.com/v1/car-details-view/UT14039/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8394c3f-4d46-56a4-89f5-471505a55aca with identifier: US49756
2026-01-29 06:09:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8394c3f-4d46-56a4-89f5-471505a55aca with scrape type 2
2026-01-29 06:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8394c3f-4d46-56a4-89f5-471505a55aca with scrape type 2
2026-01-29 06:09:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c8394c3f-4d46-56a4-89f5-471505a55aca, identifier: US49756
2026-01-29 06:09:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c8394c3f-4d46-56a4-89f5-471505a55aca with identifier: US49756
2026-01-29 06:09:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c8394c3f-4d46-56a4-89f5-471505a55aca with identifier: US49756
2026-01-29 06:09:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 85000, 'odometer_reading_unit': 'km', 'registration_date': '2021-05-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/us49756', 'expiration_date': '2026-01-29t16:34:06z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, le boulou', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 118, 'id': 'c8394c3f-4d46-56a4-89f5-471505a55aca', 'current_year_diff': 5, 'age_in_months': 56, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 85000}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 56,
     'auction_title': '',
     'c_o_2_emission_value': 118,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:34:06z',
     'fuel_type': 'petrol',
     'id': 'c8394c3f-4d46-56a4-89f5-471505a55aca',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/us49756',
     'listing': 'auction',
     'location': 'fr, le boulou',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 85000,
     'odometer_in_km': 85000,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-05-27',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2021}
2026-01-29 06:09:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: c8394c3f-4d46-56a4-89f5-471505a55aca spider: auto1.fr
2026-01-29 06:09:50 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: c8394c3f-4d46-56a4-89f5-471505a55aca due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 85000, 'odometer_reading_unit': 'km', 'registration_date': '2021-05-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/us49756', 'expiration_date': '2026-01-29t16:34:06z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, le boulou', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 118, 'id': 'c8394c3f-4d46-56a4-89f5-471505a55aca', 'current_year_diff': 5, 'age_in_months': 56, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 85000}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 56,
     'auction_title': '',
     'c_o_2_emission_value': 118,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:34:06z',
     'fuel_type': 'petrol',
     'id': 'c8394c3f-4d46-56a4-89f5-471505a55aca',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/us49756',
     'listing': 'auction',
     'location': 'fr, le boulou',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 85000,
     'odometer_in_km': 85000,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-05-27',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:34:06Z',
 'fuel_type': 'petrol',
 'id': 'c8394c3f-4d46-56a4-89f5-471505a55aca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US49756',
 'listing': 'auction',
 'location': 'FR, Le Boulou',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 85000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2021}
2026-01-29 06:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27US49756%27 HTTP/1.1" 200 None
2026-01-29 06:09:50 [auto1.fr] INFO: Saving data for US49756: {'auction_closing_time': 1769704446.0, 'created_time': 1769534097.013862, 'last_price_update_time': 1769666990.511914}
2026-01-29 06:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='US49756') HTTP/1.1" 204 0
2026-01-29 06:09:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9c18dbd-6dce-52d4-802f-510ddd7def0b with identifier: GG15377
2026-01-29 06:09:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9c18dbd-6dce-52d4-802f-510ddd7def0b with scrape type 2
2026-01-29 06:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9c18dbd-6dce-52d4-802f-510ddd7def0b with scrape type 2
2026-01-29 06:09:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a9c18dbd-6dce-52d4-802f-510ddd7def0b, identifier: GG15377
2026-01-29 06:09:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db277672-3eef-5357-89a7-1201db244d3e with identifier: UT14039
2026-01-29 06:09:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db277672-3eef-5357-89a7-1201db244d3e with scrape type 2
2026-01-29 06:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db277672-3eef-5357-89a7-1201db244d3e with scrape type 2
2026-01-29 06:09:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: db277672-3eef-5357-89a7-1201db244d3e, identifier: UT14039
2026-01-29 06:09:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a9c18dbd-6dce-52d4-802f-510ddd7def0b with identifier: GG15377
2026-01-29 06:09:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a9c18dbd-6dce-52d4-802f-510ddd7def0b with identifier: GG15377
2026-01-29 06:09:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a9c18dbd-6dce-52d4-802f-510ddd7def0b with identifier: GG15377 to the API
2026-01-29 06:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:09:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:09:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GG15377>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 204,
 'expiration_date': '2026-01-29T16:22:05Z',
 'fuel_type': 'diesel',
 'id': 'a9c18dbd-6dce-52d4-802f-510ddd7def0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG15377',
 'listing': 'auction',
 'location': 'FR, Fos sur Mer',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 83762,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 40 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2022}
2026-01-29 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG15377%27 HTTP/1.1" 200 None
2026-01-29 06:09:52 [auto1.fr] INFO: Saving data for GG15377: {'auction_closing_time': 1769703725.0, 'created_time': 1769533800.1167, 'last_price_update_time': 1769666992.036407}
2026-01-29 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GG15377') HTTP/1.1" 204 0
2026-01-29 06:09:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: db277672-3eef-5357-89a7-1201db244d3e with identifier: UT14039
2026-01-29 06:09:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: db277672-3eef-5357-89a7-1201db244d3e with identifier: UT14039
2026-01-29 06:09:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: db277672-3eef-5357-89a7-1201db244d3e with identifier: UT14039 to the API
2026-01-29 06:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:09:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:09:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UT14039>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:38:41Z',
 'fuel_type': 'petrol',
 'id': 'db277672-3eef-5357-89a7-1201db244d3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT14039',
 'listing': 'auction',
 'location': 'FR, TARNOS',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 84638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500X 1.4 Turbo Club',
 'transmission': 'automatic',
 'trim': 'Club',
 'year': 2017}
2026-01-29 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT14039%27 HTTP/1.1" 200 None
2026-01-29 06:09:52 [auto1.fr] INFO: Saving data for UT14039: {'auction_closing_time': 1769704721.0, 'created_time': 1769533697.550862, 'last_price_update_time': 1769666992.378803}
2026-01-29 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UT14039') HTTP/1.1" 204 0
2026-01-29 06:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PA24759/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GC56093/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YF43043> (referer: https://www.auto1.com/v1/car-details-view/YF43043/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fae0ea14-05fb-529c-8ccf-47d1d70b560d with identifier: YF43043
2026-01-29 06:09:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fae0ea14-05fb-529c-8ccf-47d1d70b560d with scrape type 2
2026-01-29 06:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fae0ea14-05fb-529c-8ccf-47d1d70b560d with scrape type 2
2026-01-29 06:09:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fae0ea14-05fb-529c-8ccf-47d1d70b560d, identifier: YF43043
2026-01-29 06:09:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fae0ea14-05fb-529c-8ccf-47d1d70b560d with identifier: YF43043
2026-01-29 06:09:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fae0ea14-05fb-529c-8ccf-47d1d70b560d with identifier: YF43043
2026-01-29 06:09:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fae0ea14-05fb-529c-8ccf-47d1d70b560d with identifier: YF43043 to the API
2026-01-29 06:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:09:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:09:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YF43043>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 143,
 'expiration_date': '2026-01-29T16:53:54Z',
 'fuel_type': 'hybrid',
 'id': 'fae0ea14-05fb-529c-8ccf-47d1d70b560d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF43043',
 'listing': 'auction',
 'location': 'FR, Quincieux',
 'make': 'Renault',
 'model': 'Arkana',
 'odometer': 76537,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Arkana 1.6 Hybrid E-Tech R.S. Line',
 'transmission': 'automatic',
 'trim': 'R.S. Line',
 'year': 2022}
2026-01-29 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YF43043%27 HTTP/1.1" 200 None
2026-01-29 06:09:53 [auto1.fr] INFO: Saving data for YF43043: {'auction_closing_time': 1769705634.0, 'created_time': 1769533725.198105, 'last_price_update_time': 1769666993.615457}
2026-01-29 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YF43043') HTTP/1.1" 204 0
2026-01-29 06:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GT43215/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TU35968> (referer: https://www.auto1.com/v1/car-details-view/TU35968/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YV23889> (referer: https://www.auto1.com/v1/car-details-view/YV23889/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FG13520> (referer: https://www.auto1.com/v1/car-details-view/FG13520/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VJ26258> (referer: https://www.auto1.com/v1/car-details-view/VJ26258/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NB28845/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 192752a4-3406-50fc-a967-f5ebff440495 with identifier: TU35968
2026-01-29 06:09:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 192752a4-3406-50fc-a967-f5ebff440495 with scrape type 2
2026-01-29 06:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 192752a4-3406-50fc-a967-f5ebff440495 with scrape type 2
2026-01-29 06:09:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 192752a4-3406-50fc-a967-f5ebff440495, identifier: TU35968
2026-01-29 06:09:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5865faef-1d6a-5db0-bbe1-4fd2b3f88726 with identifier: YV23889
2026-01-29 06:09:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5865faef-1d6a-5db0-bbe1-4fd2b3f88726 with scrape type 2
2026-01-29 06:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5865faef-1d6a-5db0-bbe1-4fd2b3f88726 with scrape type 2
2026-01-29 06:09:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5865faef-1d6a-5db0-bbe1-4fd2b3f88726, identifier: YV23889
2026-01-29 06:09:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 192752a4-3406-50fc-a967-f5ebff440495 with identifier: TU35968
2026-01-29 06:09:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 192752a4-3406-50fc-a967-f5ebff440495 with identifier: TU35968
2026-01-29 06:09:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 192752a4-3406-50fc-a967-f5ebff440495 with identifier: TU35968 to the API
2026-01-29 06:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:09:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:09:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TU35968>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 159,
 'expiration_date': '2026-01-29T16:49:33Z',
 'fuel_type': 'petrol',
 'id': '192752a4-3406-50fc-a967-f5ebff440495',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU35968',
 'listing': 'auction',
 'location': 'FR, Marckolsheim',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 120380,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.3 TCe GT-Line',
 'transmission': 'automatic',
 'trim': 'GT-Line',
 'year': 2019}
2026-01-29 06:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU35968%27 HTTP/1.1" 200 None
2026-01-29 06:09:54 [auto1.fr] INFO: Saving data for TU35968: {'auction_closing_time': 1769705373.0, 'created_time': 1769580135.616, 'last_price_update_time': 1769666994.318961}
2026-01-29 06:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TU35968') HTTP/1.1" 204 0
2026-01-29 06:09:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5865faef-1d6a-5db0-bbe1-4fd2b3f88726 with identifier: YV23889
2026-01-29 06:09:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5865faef-1d6a-5db0-bbe1-4fd2b3f88726 with identifier: YV23889
2026-01-29 06:09:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'trafic' containing 'trafic'
2026-01-29 06:09:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 5865faef-1d6a-5db0-bbe1-4fd2b3f88726 spider: auto1.fr
2026-01-29 06:09:54 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 5865faef-1d6a-5db0-bbe1-4fd2b3f88726 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'trafic' containing 'trafic'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:30:03Z',
 'fuel_type': 'diesel',
 'id': '5865faef-1d6a-5db0-bbe1-4fd2b3f88726',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV23889',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 64250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-03-05',
 'seats_number': 9,
 'seller_name': None,
 'title': 'Renault Trafic 2.0 BLUE dCi L2H1 3,0t (8/9 Sitze) Life',
 'transmission': 'automatic',
 'trim': 'L2H1 3,0t (8/9 Sitze) Life',
 'year': 2024}
2026-01-29 06:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YV23889%27 HTTP/1.1" 200 None
2026-01-29 06:09:54 [auto1.fr] INFO: Saving data for YV23889: {'auction_closing_time': 1769704203.0, 'created_time': 1768889448.987989, 'last_price_update_time': 1769666994.558248}
2026-01-29 06:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YV23889') HTTP/1.1" 204 0
2026-01-29 06:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UG75818/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea1e868a-de8a-54eb-97c4-99ea840ba906 with identifier: FG13520
2026-01-29 06:09:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea1e868a-de8a-54eb-97c4-99ea840ba906 with scrape type 2
2026-01-29 06:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea1e868a-de8a-54eb-97c4-99ea840ba906 with scrape type 2
2026-01-29 06:09:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ea1e868a-de8a-54eb-97c4-99ea840ba906, identifier: FG13520
2026-01-29 06:09:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 633eafb4-0373-597a-a5ed-e0b320a75a63 with identifier: VJ26258
2026-01-29 06:09:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 633eafb4-0373-597a-a5ed-e0b320a75a63 with scrape type 2
2026-01-29 06:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 633eafb4-0373-597a-a5ed-e0b320a75a63 with scrape type 2
2026-01-29 06:09:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 633eafb4-0373-597a-a5ed-e0b320a75a63, identifier: VJ26258
2026-01-29 06:09:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ea1e868a-de8a-54eb-97c4-99ea840ba906 with identifier: FG13520
2026-01-29 06:09:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ea1e868a-de8a-54eb-97c4-99ea840ba906 with identifier: FG13520
2026-01-29 06:09:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 178449 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    178449
2026-01-29 06:09:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ea1e868a-de8a-54eb-97c4-99ea840ba906 spider: auto1.fr
2026-01-29 06:09:54 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: ea1e868a-de8a-54eb-97c4-99ea840ba906 due to rule: high_mileage_for_country.json, error: 178449 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    178449
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 205,
 'expiration_date': '2026-01-29T16:51:15Z',
 'fuel_type': 'diesel',
 'id': 'ea1e868a-de8a-54eb-97c4-99ea840ba906',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG13520',
 'listing': 'auction',
 'location': 'FR, Rodez',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 178449,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 d 4Matic Business',
 'transmission': 'automatic',
 'trim': '4Matic Business',
 'year': 2018}
2026-01-29 06:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FG13520%27 HTTP/1.1" 200 None
2026-01-29 06:09:54 [auto1.fr] INFO: Saving data for FG13520: {'auction_closing_time': 1769705475.0, 'created_time': 1769534415.04839, 'last_price_update_time': 1769666994.974293}
2026-01-29 06:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FG13520') HTTP/1.1" 204 0
2026-01-29 06:09:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 633eafb4-0373-597a-a5ed-e0b320a75a63 with identifier: VJ26258
2026-01-29 06:09:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 633eafb4-0373-597a-a5ed-e0b320a75a63 with identifier: VJ26258
2026-01-29 06:09:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c4 cactus 1.2 vti shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c4 cactus', 'transmission': 'manual', 'odometer': 115725, 'odometer_reading_unit': 'km', 'registration_date': '2017-07-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vj26258', 'expiration_date': '2026-01-29t16:06:05z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, quincieux', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 107, 'id': '633eafb4-0373-597a-a5ed-e0b320a75a63', 'current_year_diff': 9, 'age_in_months': 102, 'make_model': 'citroen c4 cactus', 'sanitized_make': 'citroen', 'odometer_in_km': 115725}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 102,
     'auction_title': '',
     'c_o_2_emission_value': 107,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:06:05z',
     'fuel_type': 'petrol',
     'id': '633eafb4-0373-597a-a5ed-e0b320a75a63',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vj26258',
     'listing': 'auction',
     'location': 'fr, quincieux',
     'make': 'citroen',
     'make_model': 'citroen c4 cactus',
     'model': 'c4 cactus',
     'odometer': 115725,
     'odometer_in_km': 115725,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-07-27',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c4 cactus 1.2 vti shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2017}
2026-01-29 06:09:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 633eafb4-0373-597a-a5ed-e0b320a75a63 spider: auto1.fr
2026-01-29 06:09:55 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 633eafb4-0373-597a-a5ed-e0b320a75a63 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c4 cactus 1.2 vti shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c4 cactus', 'transmission': 'manual', 'odometer': 115725, 'odometer_reading_unit': 'km', 'registration_date': '2017-07-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vj26258', 'expiration_date': '2026-01-29t16:06:05z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, quincieux', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 107, 'id': '633eafb4-0373-597a-a5ed-e0b320a75a63', 'current_year_diff': 9, 'age_in_months': 102, 'make_model': 'citroen c4 cactus', 'sanitized_make': 'citroen', 'odometer_in_km': 115725}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 102,
     'auction_title': '',
     'c_o_2_emission_value': 107,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:06:05z',
     'fuel_type': 'petrol',
     'id': '633eafb4-0373-597a-a5ed-e0b320a75a63',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vj26258',
     'listing': 'auction',
     'location': 'fr, quincieux',
     'make': 'citroen',
     'make_model': 'citroen c4 cactus',
     'model': 'c4 cactus',
     'odometer': 115725,
     'odometer_in_km': 115725,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-07-27',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c4 cactus 1.2 vti shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:06:05Z',
 'fuel_type': 'petrol',
 'id': '633eafb4-0373-597a-a5ed-e0b320a75a63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ26258',
 'listing': 'auction',
 'location': 'FR, Quincieux',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 115725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 VTi Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2017}
2026-01-29 06:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VJ26258%27 HTTP/1.1" 200 None
2026-01-29 06:09:55 [auto1.fr] INFO: Saving data for VJ26258: {'auction_closing_time': 1769702765.0, 'created_time': 1769446946.901183, 'last_price_update_time': 1769666995.221187}
2026-01-29 06:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VJ26258') HTTP/1.1" 204 0
2026-01-29 06:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KA86675/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FD02427/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MT00628/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LR87544/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UJ46336> (referer: https://www.auto1.com/v1/car-details-view/UJ46336/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7399a09-db3f-5cf8-ba0d-67a7559d06cc with identifier: UJ46336
2026-01-29 06:09:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7399a09-db3f-5cf8-ba0d-67a7559d06cc with scrape type 2
2026-01-29 06:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7399a09-db3f-5cf8-ba0d-67a7559d06cc with scrape type 2
2026-01-29 06:09:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d7399a09-db3f-5cf8-ba0d-67a7559d06cc, identifier: UJ46336
2026-01-29 06:09:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d7399a09-db3f-5cf8-ba0d-67a7559d06cc with identifier: UJ46336
2026-01-29 06:09:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d7399a09-db3f-5cf8-ba0d-67a7559d06cc with identifier: UJ46336
2026-01-29 06:09:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d7399a09-db3f-5cf8-ba0d-67a7559d06cc with identifier: UJ46336 to the API
2026-01-29 06:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:09:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:09:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UJ46336>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:24:48Z',
 'fuel_type': 'electro',
 'id': 'd7399a09-db3f-5cf8-ba0d-67a7559d06cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ46336',
 'listing': 'auction',
 'location': 'FR, LA CHAPELLE LONGUEVILLE',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 71500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 electric drive 100 kW e GT',
 'transmission': 'automatic',
 'trim': 'e GT',
 'year': 2020}
2026-01-29 06:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UJ46336%27 HTTP/1.1" 200 None
2026-01-29 06:09:56 [auto1.fr] INFO: Saving data for UJ46336: {'auction_closing_time': 1769703888.0, 'created_time': 1768064825.850254, 'last_price_update_time': 1769666996.653398}
2026-01-29 06:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UJ46336') HTTP/1.1" 204 0
2026-01-29 06:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PA24759> (referer: https://www.auto1.com/v1/car-details-view/PA24759/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UU55981> (referer: https://www.auto1.com/v1/car-details-view/UU55981/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05f14d79-9025-5d4b-872b-e1378a9d05e1 with identifier: PA24759
2026-01-29 06:09:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05f14d79-9025-5d4b-872b-e1378a9d05e1 with scrape type 2
2026-01-29 06:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05f14d79-9025-5d4b-872b-e1378a9d05e1 with scrape type 2
2026-01-29 06:09:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 05f14d79-9025-5d4b-872b-e1378a9d05e1, identifier: PA24759
2026-01-29 06:09:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 05f14d79-9025-5d4b-872b-e1378a9d05e1 with identifier: PA24759
2026-01-29 06:09:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 05f14d79-9025-5d4b-872b-e1378a9d05e1 with identifier: PA24759
2026-01-29 06:09:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 171908 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    171908
2026-01-29 06:09:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 05f14d79-9025-5d4b-872b-e1378a9d05e1 spider: auto1.fr
2026-01-29 06:09:57 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 05f14d79-9025-5d4b-872b-e1378a9d05e1 due to rule: high_mileage_for_country.json, error: 171908 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    171908
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:37:53Z',
 'fuel_type': 'diesel',
 'id': '05f14d79-9025-5d4b-872b-e1378a9d05e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA24759',
 'listing': 'auction',
 'location': 'FR, Marly-la-ville',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 171908,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi Lauréate Plus 4x2',
 'transmission': 'automatic',
 'trim': 'Lauréate Plus 4x2',
 'year': 2018}
2026-01-29 06:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PA24759%27 HTTP/1.1" 200 None
2026-01-29 06:09:57 [auto1.fr] INFO: Saving data for PA24759: {'auction_closing_time': 1769704673.0, 'created_time': 1768064646.154006, 'last_price_update_time': 1769666997.083585}
2026-01-29 06:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PA24759') HTTP/1.1" 204 0
2026-01-29 06:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YP58387> (referer: https://www.auto1.com/v1/car-details-view/YP58387/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcdf4bb5-08a3-57aa-bb9b-0cbdb9c7ebce with identifier: UU55981
2026-01-29 06:09:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcdf4bb5-08a3-57aa-bb9b-0cbdb9c7ebce with scrape type 2
2026-01-29 06:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcdf4bb5-08a3-57aa-bb9b-0cbdb9c7ebce with scrape type 2
2026-01-29 06:09:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: dcdf4bb5-08a3-57aa-bb9b-0cbdb9c7ebce, identifier: UU55981
2026-01-29 06:09:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AY94997/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dcdf4bb5-08a3-57aa-bb9b-0cbdb9c7ebce with identifier: UU55981
2026-01-29 06:09:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dcdf4bb5-08a3-57aa-bb9b-0cbdb9c7ebce with identifier: UU55981
2026-01-29 06:09:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 198023 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    198023
2026-01-29 06:09:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: dcdf4bb5-08a3-57aa-bb9b-0cbdb9c7ebce spider: auto1.fr
2026-01-29 06:09:57 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: dcdf4bb5-08a3-57aa-bb9b-0cbdb9c7ebce due to rule: high_mileage_for_country.json, error: 198023 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    198023
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-01-29T16:40:30Z',
 'fuel_type': 'diesel',
 'id': 'dcdf4bb5-08a3-57aa-bb9b-0cbdb9c7ebce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU55981',
 'listing': 'auction',
 'location': 'FR, Houecourt',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 198023,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 2.0 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2018}
2026-01-29 06:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UU55981%27 HTTP/1.1" 200 None
2026-01-29 06:09:57 [auto1.fr] INFO: Saving data for UU55981: {'auction_closing_time': 1769704830.0, 'created_time': 1768324123.619901, 'last_price_update_time': 1769666997.399529}
2026-01-29 06:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UU55981') HTTP/1.1" 204 0
2026-01-29 06:09:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YX73308/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GC56093> (referer: https://www.auto1.com/v1/car-details-view/GC56093/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a90b9912-0082-51f4-9df2-10b4f0e69748 with identifier: YP58387
2026-01-29 06:09:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a90b9912-0082-51f4-9df2-10b4f0e69748 with scrape type 2
2026-01-29 06:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a90b9912-0082-51f4-9df2-10b4f0e69748 with scrape type 2
2026-01-29 06:09:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a90b9912-0082-51f4-9df2-10b4f0e69748, identifier: YP58387
2026-01-29 06:09:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a90b9912-0082-51f4-9df2-10b4f0e69748 with identifier: YP58387
2026-01-29 06:09:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a90b9912-0082-51f4-9df2-10b4f0e69748 with identifier: YP58387
2026-01-29 06:09:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 145597 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    145597
2026-01-29 06:09:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: a90b9912-0082-51f4-9df2-10b4f0e69748 spider: auto1.fr
2026-01-29 06:09:57 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: a90b9912-0082-51f4-9df2-10b4f0e69748 due to rule: high_mileage_for_make.json, error: 145597 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    145597
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.7L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:31:08Z',
 'fuel_type': 'diesel',
 'id': 'a90b9912-0082-51f4-9df2-10b4f0e69748',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP58387',
 'listing': 'auction',
 'location': 'FR, Marly-la-ville',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 145597,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-15',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.7 BLUE dCi Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2019}
2026-01-29 06:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP58387%27 HTTP/1.1" 200 None
2026-01-29 06:09:57 [auto1.fr] INFO: Saving data for YP58387: {'auction_closing_time': 1769704268.0, 'created_time': 1767719365.828799, 'last_price_update_time': 1769666997.713828}
2026-01-29 06:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YP58387') HTTP/1.1" 204 0
2026-01-29 06:09:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6325f11-c5b5-5c26-9dcf-d56f6bb135dd with identifier: GC56093
2026-01-29 06:09:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6325f11-c5b5-5c26-9dcf-d56f6bb135dd with scrape type 2
2026-01-29 06:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6325f11-c5b5-5c26-9dcf-d56f6bb135dd with scrape type 2
2026-01-29 06:09:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c6325f11-c5b5-5c26-9dcf-d56f6bb135dd, identifier: GC56093
2026-01-29 06:09:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c6325f11-c5b5-5c26-9dcf-d56f6bb135dd with identifier: GC56093
2026-01-29 06:09:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c6325f11-c5b5-5c26-9dcf-d56f6bb135dd with identifier: GC56093
2026-01-29 06:09:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 198874 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    198874
2026-01-29 06:09:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c6325f11-c5b5-5c26-9dcf-d56f6bb135dd spider: auto1.fr
2026-01-29 06:09:58 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: c6325f11-c5b5-5c26-9dcf-d56f6bb135dd due to rule: high_mileage_for_country.json, error: 198874 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    198874
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:47:48Z',
 'fuel_type': 'diesel',
 'id': 'c6325f11-c5b5-5c26-9dcf-d56f6bb135dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC56093',
 'listing': 'auction',
 'location': 'Pornichet',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 198874,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Carat Exclusive BlueMotion',
 'transmission': 'automatic',
 'trim': 'Carat Exclusive BlueMotion',
 'year': 2018}
2026-01-29 06:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GC56093%27 HTTP/1.1" 200 None
2026-01-29 06:09:58 [auto1.fr] INFO: Saving data for GC56093: {'auction_closing_time': 1769705268.0, 'created_time': 1769015330.220461, 'last_price_update_time': 1769666998.02942}
2026-01-29 06:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GC56093') HTTP/1.1" 204 0
2026-01-29 06:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TA58027/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FR23059> (referer: https://www.auto1.com/v1/car-details-view/FR23059/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WN77932> (referer: https://www.auto1.com/v1/car-details-view/WN77932/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 060af172-775c-5bd1-86c0-1fa0b48686b9 with identifier: FR23059
2026-01-29 06:09:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 060af172-775c-5bd1-86c0-1fa0b48686b9 with scrape type 2
2026-01-29 06:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 060af172-775c-5bd1-86c0-1fa0b48686b9 with scrape type 2
2026-01-29 06:09:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 060af172-775c-5bd1-86c0-1fa0b48686b9, identifier: FR23059
2026-01-29 06:09:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 060af172-775c-5bd1-86c0-1fa0b48686b9 with identifier: FR23059
2026-01-29 06:09:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 060af172-775c-5bd1-86c0-1fa0b48686b9 with identifier: FR23059
2026-01-29 06:09:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine pack', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'automatic', 'odometer': 44624, 'odometer_reading_unit': 'km', 'registration_date': '2020-12-21', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fr23059', 'expiration_date': '2026-01-29t16:02:29z', 'origin_country_code': 'fr', 'trim': 'shine pack', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, le boulou', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 143, 'id': '060af172-775c-5bd1-86c0-1fa0b48686b9', 'current_year_diff': 6, 'age_in_months': 61, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 44624}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 61,
     'auction_title': '',
     'c_o_2_emission_value': 143,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:02:29z',
     'fuel_type': 'petrol',
     'id': '060af172-775c-5bd1-86c0-1fa0b48686b9',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fr23059',
     'listing': 'auction',
     'location': 'fr, le boulou',
     'make': 'citroen',
     'make_model': 'citroen c3 aircross',
     'model': 'c3 aircross',
     'odometer': 44624,
     'odometer_in_km': 44624,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-12-21',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 aircross 1.2 puretech shine pack',
     'transmission': 'automatic',
     'trim': 'shine pack',
     'year': 2020}
2026-01-29 06:09:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 060af172-775c-5bd1-86c0-1fa0b48686b9 spider: auto1.fr
2026-01-29 06:09:58 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 060af172-775c-5bd1-86c0-1fa0b48686b9 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine pack', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'automatic', 'odometer': 44624, 'odometer_reading_unit': 'km', 'registration_date': '2020-12-21', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fr23059', 'expiration_date': '2026-01-29t16:02:29z', 'origin_country_code': 'fr', 'trim': 'shine pack', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, le boulou', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 143, 'id': '060af172-775c-5bd1-86c0-1fa0b48686b9', 'current_year_diff': 6, 'age_in_months': 61, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 44624}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 61,
     'auction_title': '',
     'c_o_2_emission_value': 143,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:02:29z',
     'fuel_type': 'petrol',
     'id': '060af172-775c-5bd1-86c0-1fa0b48686b9',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fr23059',
     'listing': 'auction',
     'location': 'fr, le boulou',
     'make': 'citroen',
     'make_model': 'citroen c3 aircross',
     'model': 'c3 aircross',
     'odometer': 44624,
     'odometer_in_km': 44624,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-12-21',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 aircross 1.2 puretech shine pack',
     'transmission': 'automatic',
     'trim': 'shine pack',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:02:29Z',
 'fuel_type': 'petrol',
 'id': '060af172-775c-5bd1-86c0-1fa0b48686b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR23059',
 'listing': 'auction',
 'location': 'FR, Le Boulou',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 44624,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Shine Pack',
 'transmission': 'automatic',
 'trim': 'Shine Pack',
 'year': 2020}
2026-01-29 06:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FR23059%27 HTTP/1.1" 200 None
2026-01-29 06:09:58 [auto1.fr] INFO: Saving data for FR23059: {'auction_closing_time': 1769702549.0, 'created_time': 1766598031.459707, 'last_price_update_time': 1769666998.71984}
2026-01-29 06:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FR23059') HTTP/1.1" 204 0
2026-01-29 06:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GT43215> (referer: https://www.auto1.com/v1/car-details-view/GT43215/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b4d3dec-d6b6-5ba7-a7e0-d08744293d1b with identifier: WN77932
2026-01-29 06:09:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b4d3dec-d6b6-5ba7-a7e0-d08744293d1b with scrape type 2
2026-01-29 06:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b4d3dec-d6b6-5ba7-a7e0-d08744293d1b with scrape type 2
2026-01-29 06:09:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5b4d3dec-d6b6-5ba7-a7e0-d08744293d1b, identifier: WN77932
2026-01-29 06:09:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5b4d3dec-d6b6-5ba7-a7e0-d08744293d1b with identifier: WN77932
2026-01-29 06:09:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5b4d3dec-d6b6-5ba7-a7e0-d08744293d1b with identifier: WN77932
2026-01-29 06:09:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 139057 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    139057
2026-01-29 06:09:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 5b4d3dec-d6b6-5ba7-a7e0-d08744293d1b spider: auto1.fr
2026-01-29 06:09:59 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 5b4d3dec-d6b6-5ba7-a7e0-d08744293d1b due to rule: high_mileage_for_make.json, error: 139057 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    139057
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 86,
 'expiration_date': '2026-01-29T16:31:24Z',
 'fuel_type': 'diesel',
 'id': '5b4d3dec-d6b6-5ba7-a7e0-d08744293d1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN77932',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 139057,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.5 BLUE dCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2019}
2026-01-29 06:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WN77932%27 HTTP/1.1" 200 None
2026-01-29 06:09:59 [auto1.fr] INFO: Saving data for WN77932: {'auction_closing_time': 1769704284.0, 'created_time': 1768240370.798495, 'last_price_update_time': 1769666999.055853}
2026-01-29 06:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WN77932') HTTP/1.1" 204 0
2026-01-29 06:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NB28845> (referer: https://www.auto1.com/v1/car-details-view/NB28845/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KA86675> (referer: https://www.auto1.com/v1/car-details-view/KA86675/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UG75818> (referer: https://www.auto1.com/v1/car-details-view/UG75818/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: daf83346-2c27-58ce-8427-59a8b30a9a9b with identifier: GT43215
2026-01-29 06:09:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daf83346-2c27-58ce-8427-59a8b30a9a9b with scrape type 2
2026-01-29 06:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item daf83346-2c27-58ce-8427-59a8b30a9a9b with scrape type 2
2026-01-29 06:09:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: daf83346-2c27-58ce-8427-59a8b30a9a9b, identifier: GT43215
2026-01-29 06:09:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: daf83346-2c27-58ce-8427-59a8b30a9a9b with identifier: GT43215
2026-01-29 06:09:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: daf83346-2c27-58ce-8427-59a8b30a9a9b with identifier: GT43215
2026-01-29 06:09:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: daf83346-2c27-58ce-8427-59a8b30a9a9b with identifier: GT43215 to the API
2026-01-29 06:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:09:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:09:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GT43215>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:43:59Z',
 'fuel_type': 'diesel',
 'id': 'daf83346-2c27-58ce-8427-59a8b30a9a9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT43215',
 'listing': 'auction',
 'location': 'FR, Marly-la-ville',
 'make': 'Opel',
 'model': 'Grandland X',
 'odometer': 149195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Grandland X 1.5 CDTI Ultimate',
 'transmission': 'automatic',
 'trim': 'Ultimate',
 'year': 2020}
2026-01-29 06:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GT43215%27 HTTP/1.1" 200 None
2026-01-29 06:09:59 [auto1.fr] INFO: Saving data for GT43215: {'auction_closing_time': 1769705039.0, 'created_time': 1768412893.005557, 'last_price_update_time': 1769666999.47061}
2026-01-29 06:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GT43215') HTTP/1.1" 204 0
2026-01-29 06:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MT00628> (referer: https://www.auto1.com/v1/car-details-view/MT00628/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:09:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:09:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebf8f25f-a033-5d46-8eda-70caf41d3b39 with identifier: NB28845
2026-01-29 06:09:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebf8f25f-a033-5d46-8eda-70caf41d3b39 with scrape type 2
2026-01-29 06:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebf8f25f-a033-5d46-8eda-70caf41d3b39 with scrape type 2
2026-01-29 06:09:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ebf8f25f-a033-5d46-8eda-70caf41d3b39, identifier: NB28845
2026-01-29 06:09:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5fda5f9-1cc5-5345-9c08-b5bf33efc99c with identifier: KA86675
2026-01-29 06:09:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5fda5f9-1cc5-5345-9c08-b5bf33efc99c with scrape type 2
2026-01-29 06:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5fda5f9-1cc5-5345-9c08-b5bf33efc99c with scrape type 2
2026-01-29 06:09:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f5fda5f9-1cc5-5345-9c08-b5bf33efc99c, identifier: KA86675
2026-01-29 06:09:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b875fcf-4369-5192-a599-955951657cdf with identifier: UG75818
2026-01-29 06:09:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b875fcf-4369-5192-a599-955951657cdf with scrape type 2
2026-01-29 06:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b875fcf-4369-5192-a599-955951657cdf with scrape type 2
2026-01-29 06:09:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3b875fcf-4369-5192-a599-955951657cdf, identifier: UG75818
2026-01-29 06:09:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ebf8f25f-a033-5d46-8eda-70caf41d3b39 with identifier: NB28845
2026-01-29 06:09:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ebf8f25f-a033-5d46-8eda-70caf41d3b39 with identifier: NB28845
2026-01-29 06:09:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ebf8f25f-a033-5d46-8eda-70caf41d3b39 with identifier: NB28845 to the API
2026-01-29 06:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:09:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NB28845>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:57:59Z',
 'fuel_type': 'diesel',
 'id': 'ebf8f25f-a033-5d46-8eda-70caf41d3b39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB28845',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 149142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q2 30 TDI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2019}
2026-01-29 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NB28845%27 HTTP/1.1" 200 None
2026-01-29 06:10:00 [auto1.fr] INFO: Saving data for NB28845: {'auction_closing_time': 1769705879.0, 'created_time': 1768903450.60486, 'last_price_update_time': 1769667000.102467}
2026-01-29 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NB28845') HTTP/1.1" 204 0
2026-01-29 06:10:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f5fda5f9-1cc5-5345-9c08-b5bf33efc99c with identifier: KA86675
2026-01-29 06:10:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f5fda5f9-1cc5-5345-9c08-b5bf33efc99c with identifier: KA86675
2026-01-29 06:10:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f5fda5f9-1cc5-5345-9c08-b5bf33efc99c with identifier: KA86675 to the API
2026-01-29 06:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KA86675>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:05:22Z',
 'fuel_type': 'diesel',
 'id': 'f5fda5f9-1cc5-5345-9c08-b5bf33efc99c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA86675',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 132355,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-16',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2018}
2026-01-29 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KA86675%27 HTTP/1.1" 200 None
2026-01-29 06:10:00 [auto1.fr] INFO: Saving data for KA86675: {'auction_closing_time': 1769702722.0, 'created_time': 1767074617.271606, 'last_price_update_time': 1769667000.475592}
2026-01-29 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KA86675') HTTP/1.1" 204 0
2026-01-29 06:10:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3b875fcf-4369-5192-a599-955951657cdf with identifier: UG75818
2026-01-29 06:10:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3b875fcf-4369-5192-a599-955951657cdf with identifier: UG75818
2026-01-29 06:10:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3b875fcf-4369-5192-a599-955951657cdf with identifier: UG75818 to the API
2026-01-29 06:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UG75818>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:18:30Z',
 'fuel_type': 'diesel',
 'id': '3b875fcf-4369-5192-a599-955951657cdf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG75818',
 'listing': 'auction',
 'location': 'FR, Ambarès-et-Lagrave',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 142440,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X4 xDrive 20d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-01-29 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG75818%27 HTTP/1.1" 200 None
2026-01-29 06:10:00 [auto1.fr] INFO: Saving data for UG75818: {'auction_closing_time': 1769703510.0, 'created_time': 1769534150.747255, 'last_price_update_time': 1769667000.928602}
2026-01-29 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UG75818') HTTP/1.1" 204 0
2026-01-29 06:10:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SJ25086> (referer: https://www.auto1.com/v1/car-details-view/SJ25086/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FD02427> (referer: https://www.auto1.com/v1/car-details-view/FD02427/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LR87544> (referer: https://www.auto1.com/v1/car-details-view/LR87544/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24cbaf65-4b0f-5a33-a6f3-02aee21253e8 with identifier: MT00628
2026-01-29 06:10:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24cbaf65-4b0f-5a33-a6f3-02aee21253e8 with scrape type 2
2026-01-29 06:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24cbaf65-4b0f-5a33-a6f3-02aee21253e8 with scrape type 2
2026-01-29 06:10:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 24cbaf65-4b0f-5a33-a6f3-02aee21253e8, identifier: MT00628
2026-01-29 06:10:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 24cbaf65-4b0f-5a33-a6f3-02aee21253e8 with identifier: MT00628
2026-01-29 06:10:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 24cbaf65-4b0f-5a33-a6f3-02aee21253e8 with identifier: MT00628
2026-01-29 06:10:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 24cbaf65-4b0f-5a33-a6f3-02aee21253e8 with identifier: MT00628 to the API
2026-01-29 06:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MT00628>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:11:57Z',
 'fuel_type': 'petrol',
 'id': '24cbaf65-4b0f-5a33-a6f3-02aee21253e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT00628',
 'listing': 'auction',
 'location': 'FR, MONTIGNY-LE-BRETONNEUX',
 'make': 'Renault',
 'model': 'Arkana',
 'odometer': 59500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Arkana 1.3 TCe Mild-Hybrid Techno',
 'transmission': 'automatic',
 'trim': 'Techno',
 'year': 2024}
2026-01-29 06:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MT00628%27 HTTP/1.1" 200 None
2026-01-29 06:10:01 [auto1.fr] INFO: Saving data for MT00628: {'auction_closing_time': 1769703117.0, 'created_time': 1769533760.917846, 'last_price_update_time': 1769667001.456064}
2026-01-29 06:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MT00628') HTTP/1.1" 204 0
2026-01-29 06:10:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d747ccf-aeb4-5e19-821f-d8768b5fcb11 with identifier: SJ25086
2026-01-29 06:10:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d747ccf-aeb4-5e19-821f-d8768b5fcb11 with scrape type 2
2026-01-29 06:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d747ccf-aeb4-5e19-821f-d8768b5fcb11 with scrape type 2
2026-01-29 06:10:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1d747ccf-aeb4-5e19-821f-d8768b5fcb11, identifier: SJ25086
2026-01-29 06:10:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6532ca9e-6ae9-5f78-9ebc-97a41ef66f7a with identifier: FD02427
2026-01-29 06:10:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6532ca9e-6ae9-5f78-9ebc-97a41ef66f7a with scrape type 2
2026-01-29 06:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6532ca9e-6ae9-5f78-9ebc-97a41ef66f7a with scrape type 2
2026-01-29 06:10:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6532ca9e-6ae9-5f78-9ebc-97a41ef66f7a, identifier: FD02427
2026-01-29 06:10:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14fd7371-a655-5fdf-b71f-4181c4834226 with identifier: LR87544
2026-01-29 06:10:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14fd7371-a655-5fdf-b71f-4181c4834226 with scrape type 2
2026-01-29 06:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14fd7371-a655-5fdf-b71f-4181c4834226 with scrape type 2
2026-01-29 06:10:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 14fd7371-a655-5fdf-b71f-4181c4834226, identifier: LR87544
2026-01-29 06:10:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1d747ccf-aeb4-5e19-821f-d8768b5fcb11 with identifier: SJ25086
2026-01-29 06:10:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1d747ccf-aeb4-5e19-821f-d8768b5fcb11 with identifier: SJ25086
2026-01-29 06:10:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'orange', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 34036, 'odometer_reading_unit': 'km', 'registration_date': '2020-07-14', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sj25086', 'expiration_date': '2026-01-29t16:10:06z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'nice', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 131, 'id': '1d747ccf-aeb4-5e19-821f-d8768b5fcb11', 'current_year_diff': 6, 'age_in_months': 66, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 34036}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 66,
     'auction_title': '',
     'c_o_2_emission_value': 131,
     'category': None,
     'color': 'orange',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:10:06z',
     'fuel_type': 'petrol',
     'id': '1d747ccf-aeb4-5e19-821f-d8768b5fcb11',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sj25086',
     'listing': 'auction',
     'location': 'nice',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 34036,
     'odometer_in_km': 34036,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-07-14',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2020}
2026-01-29 06:10:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 1d747ccf-aeb4-5e19-821f-d8768b5fcb11 spider: auto1.fr
2026-01-29 06:10:01 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 1d747ccf-aeb4-5e19-821f-d8768b5fcb11 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'orange', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 34036, 'odometer_reading_unit': 'km', 'registration_date': '2020-07-14', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sj25086', 'expiration_date': '2026-01-29t16:10:06z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'nice', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 131, 'id': '1d747ccf-aeb4-5e19-821f-d8768b5fcb11', 'current_year_diff': 6, 'age_in_months': 66, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 34036}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 66,
     'auction_title': '',
     'c_o_2_emission_value': 131,
     'category': None,
     'color': 'orange',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:10:06z',
     'fuel_type': 'petrol',
     'id': '1d747ccf-aeb4-5e19-821f-d8768b5fcb11',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sj25086',
     'listing': 'auction',
     'location': 'nice',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 34036,
     'odometer_in_km': 34036,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-07-14',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:10:06Z',
 'fuel_type': 'petrol',
 'id': '1d747ccf-aeb4-5e19-821f-d8768b5fcb11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ25086',
 'listing': 'auction',
 'location': 'Nice',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 34036,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-01-29 06:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SJ25086%27 HTTP/1.1" 200 None
2026-01-29 06:10:01 [auto1.fr] INFO: Saving data for SJ25086: {'auction_closing_time': 1769703006.0, 'created_time': 1769450065.27604, 'last_price_update_time': 1769667001.985982}
2026-01-29 06:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SJ25086') HTTP/1.1" 204 0
2026-01-29 06:10:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6532ca9e-6ae9-5f78-9ebc-97a41ef66f7a with identifier: FD02427
2026-01-29 06:10:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6532ca9e-6ae9-5f78-9ebc-97a41ef66f7a with identifier: FD02427
2026-01-29 06:10:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6532ca9e-6ae9-5f78-9ebc-97a41ef66f7a with identifier: FD02427 to the API
2026-01-29 06:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FD02427>
{'auction_title': '',
 'c_o_2_emission_value': 27,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 204,
 'expiration_date': '2026-01-29T16:57:21Z',
 'fuel_type': 'hybrid',
 'id': '6532ca9e-6ae9-5f78-9ebc-97a41ef66f7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD02427',
 'listing': 'auction',
 'location': 'FR, Ambarès-et-Lagrave',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 41152,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Cupra Formentor 1.4 e-HYBRID',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-01-29 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FD02427%27 HTTP/1.1" 200 None
2026-01-29 06:10:02 [auto1.fr] INFO: Saving data for FD02427: {'auction_closing_time': 1769705841.0, 'created_time': 1769493659.055238, 'last_price_update_time': 1769667002.353484}
2026-01-29 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FD02427') HTTP/1.1" 204 0
2026-01-29 06:10:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 14fd7371-a655-5fdf-b71f-4181c4834226 with identifier: LR87544
2026-01-29 06:10:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 14fd7371-a655-5fdf-b71f-4181c4834226 with identifier: LR87544
2026-01-29 06:10:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 14fd7371-a655-5fdf-b71f-4181c4834226 with identifier: LR87544 to the API
2026-01-29 06:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LR87544>
{'auction_title': '',
 'c_o_2_emission_value': 51,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 320,
 'expiration_date': '2026-01-29T16:03:27Z',
 'fuel_type': 'hybrid',
 'id': '14fd7371-a655-5fdf-b71f-4181c4834226',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR87544',
 'listing': 'auction',
 'location': 'FR, Ingrandes sur Vienne',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 58331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 300e 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2021}
2026-01-29 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LR87544%27 HTTP/1.1" 200 None
2026-01-29 06:10:02 [auto1.fr] INFO: Saving data for LR87544: {'auction_closing_time': 1769702607.0, 'created_time': 1769580054.20893, 'last_price_update_time': 1769667002.709594}
2026-01-29 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LR87544') HTTP/1.1" 204 0
2026-01-29 06:10:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FC24694> (referer: https://www.auto1.com/v1/car-details-view/FC24694/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GL48917/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GM21218> (referer: https://www.auto1.com/v1/car-details-view/GM21218/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YJ87670/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:02 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:10:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 950360c6-34b5-533c-83ec-a7b8ec8278c5 with identifier: FC24694
2026-01-29 06:10:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 950360c6-34b5-533c-83ec-a7b8ec8278c5 with scrape type 2
2026-01-29 06:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 950360c6-34b5-533c-83ec-a7b8ec8278c5 with scrape type 2
2026-01-29 06:10:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 950360c6-34b5-533c-83ec-a7b8ec8278c5, identifier: FC24694
2026-01-29 06:10:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 950360c6-34b5-533c-83ec-a7b8ec8278c5 with identifier: FC24694
2026-01-29 06:10:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 950360c6-34b5-533c-83ec-a7b8ec8278c5 with identifier: FC24694
2026-01-29 06:10:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 950360c6-34b5-533c-83ec-a7b8ec8278c5 with identifier: FC24694 to the API
2026-01-29 06:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FC24694>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:21:27Z',
 'fuel_type': 'petrol',
 'id': '950360c6-34b5-533c-83ec-a7b8ec8278c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC24694',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 110628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ateca 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2019}
2026-01-29 06:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FC24694%27 HTTP/1.1" 200 None
2026-01-29 06:10:03 [auto1.fr] INFO: Saving data for FC24694: {'auction_closing_time': 1769703687.0, 'created_time': 1768456897.411679, 'last_price_update_time': 1769667003.298463}
2026-01-29 06:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FC24694') HTTP/1.1" 204 0
2026-01-29 06:10:03 [auto1.fr] INFO: Found listing with ID: TX59110
2026-01-29 06:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TX59110%27 HTTP/1.1" 200 None
2026-01-29 06:10:03 [auto1.fr] INFO: Scrape type for TX59110: 0
2026-01-29 06:10:03 [auto1.fr] INFO: Found listing with ID: PM10789
2026-01-29 06:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PM10789%27 HTTP/1.1" 200 None
2026-01-29 06:10:03 [auto1.fr] INFO: Scrape type for PM10789: 2
2026-01-29 06:10:03 [auto1.fr] INFO: Found listing with ID: RX22292
2026-01-29 06:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RX22292%27 HTTP/1.1" 200 None
2026-01-29 06:10:03 [auto1.fr] INFO: Scrape type for RX22292: 2
2026-01-29 06:10:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5d155c0-9435-5eb8-9116-59b191c2b55d with identifier: GM21218
2026-01-29 06:10:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5d155c0-9435-5eb8-9116-59b191c2b55d with scrape type 2
2026-01-29 06:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5d155c0-9435-5eb8-9116-59b191c2b55d with scrape type 2
2026-01-29 06:10:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c5d155c0-9435-5eb8-9116-59b191c2b55d, identifier: GM21218
2026-01-29 06:10:03 [auto1.fr] INFO: Found listing with ID: FA46951
2026-01-29 06:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FA46951%27 HTTP/1.1" 200 None
2026-01-29 06:10:03 [auto1.fr] INFO: Scrape type for FA46951: 0
2026-01-29 06:10:03 [auto1.fr] INFO: Found listing with ID: FG10571
2026-01-29 06:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FG10571%27 HTTP/1.1" 200 None
2026-01-29 06:10:03 [auto1.fr] INFO: Scrape type for FG10571: 0
2026-01-29 06:10:03 [auto1.fr] INFO: Found listing with ID: GM33700
2026-01-29 06:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GM33700%27 HTTP/1.1" 200 None
2026-01-29 06:10:03 [auto1.fr] INFO: Scrape type for GM33700: 2
2026-01-29 06:10:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c5d155c0-9435-5eb8-9116-59b191c2b55d with identifier: GM21218
2026-01-29 06:10:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c5d155c0-9435-5eb8-9116-59b191c2b55d with identifier: GM21218
2026-01-29 06:10:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c5d155c0-9435-5eb8-9116-59b191c2b55d with identifier: GM21218 to the API
2026-01-29 06:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GM21218>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 163,
 'expiration_date': '2026-01-29T16:00:09Z',
 'fuel_type': 'petrol',
 'id': 'c5d155c0-9435-5eb8-9116-59b191c2b55d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM21218',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 69297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GM21218%27 HTTP/1.1" 200 None
2026-01-29 06:10:04 [auto1.fr] INFO: Saving data for GM21218: {'auction_closing_time': 1769702409.0, 'created_time': 1768844631.02648, 'last_price_update_time': 1769667004.016133}
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GM21218') HTTP/1.1" 204 0
2026-01-29 06:10:04 [auto1.fr] INFO: Found listing with ID: RX66580
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RX66580%27 HTTP/1.1" 200 None
2026-01-29 06:10:04 [auto1.fr] INFO: Scrape type for RX66580: 2
2026-01-29 06:10:04 [auto1.fr] INFO: Found listing with ID: RV80862
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RV80862%27 HTTP/1.1" 200 None
2026-01-29 06:10:04 [auto1.fr] INFO: Scrape type for RV80862: 0
2026-01-29 06:10:04 [auto1.fr] INFO: Found listing with ID: XJ63957
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XJ63957%27 HTTP/1.1" 200 None
2026-01-29 06:10:04 [auto1.fr] INFO: Scrape type for XJ63957: 0
2026-01-29 06:10:04 [auto1.fr] INFO: Found listing with ID: AU80648
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AU80648%27 HTTP/1.1" 200 None
2026-01-29 06:10:04 [auto1.fr] INFO: Scrape type for AU80648: 2
2026-01-29 06:10:04 [auto1.fr] INFO: Found listing with ID: GY60794
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GY60794%27 HTTP/1.1" 200 None
2026-01-29 06:10:04 [auto1.fr] INFO: Scrape type for GY60794: 2
2026-01-29 06:10:04 [auto1.fr] INFO: Found listing with ID: MF14251
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MF14251%27 HTTP/1.1" 200 None
2026-01-29 06:10:04 [auto1.fr] INFO: Scrape type for MF14251: 0
2026-01-29 06:10:04 [auto1.fr] INFO: Found listing with ID: WL50922
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WL50922%27 HTTP/1.1" 200 None
2026-01-29 06:10:04 [auto1.fr] INFO: Scrape type for WL50922: 2
2026-01-29 06:10:04 [auto1.fr] INFO: Found listing with ID: UK74430
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UK74430%27 HTTP/1.1" 200 None
2026-01-29 06:10:04 [auto1.fr] INFO: Scrape type for UK74430: 2
2026-01-29 06:10:04 [auto1.fr] INFO: Found listing with ID: BG53960
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BG53960%27 HTTP/1.1" 200 None
2026-01-29 06:10:04 [auto1.fr] INFO: Scrape type for BG53960: 0
2026-01-29 06:10:04 [auto1.fr] INFO: Found listing with ID: FC59962
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FC59962%27 HTTP/1.1" 200 None
2026-01-29 06:10:04 [auto1.fr] INFO: Scrape type for FC59962: 0
2026-01-29 06:10:04 [auto1.fr] INFO: Found listing with ID: AB17139
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AB17139%27 HTTP/1.1" 200 None
2026-01-29 06:10:04 [auto1.fr] INFO: Scrape type for AB17139: 0
2026-01-29 06:10:04 [auto1.fr] INFO: Found listing with ID: XL37074
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XL37074%27 HTTP/1.1" 200 None
2026-01-29 06:10:04 [auto1.fr] INFO: Scrape type for XL37074: 2
2026-01-29 06:10:04 [auto1.fr] INFO: Found listing with ID: EZ84945
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EZ84945%27 HTTP/1.1" 200 None
2026-01-29 06:10:04 [auto1.fr] INFO: Scrape type for EZ84945: 0
2026-01-29 06:10:04 [auto1.fr] INFO: Found listing with ID: EZ25463
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EZ25463%27 HTTP/1.1" 200 None
2026-01-29 06:10:04 [auto1.fr] INFO: Scrape type for EZ25463: 2
2026-01-29 06:10:04 [auto1.fr] INFO: Found listing with ID: DX73001
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DX73001%27 HTTP/1.1" 200 None
2026-01-29 06:10:04 [auto1.fr] INFO: Scrape type for DX73001: 2
2026-01-29 06:10:04 [auto1.fr] INFO: Found listing with ID: NN91069
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NN91069%27 HTTP/1.1" 200 None
2026-01-29 06:10:04 [auto1.fr] INFO: Scrape type for NN91069: 2
2026-01-29 06:10:04 [auto1.fr] INFO: Found listing with ID: DN85744
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DN85744%27 HTTP/1.1" 200 None
2026-01-29 06:10:04 [auto1.fr] INFO: Scrape type for DN85744: 0
2026-01-29 06:10:04 [auto1.fr] INFO: Found listing with ID: KR01797
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KR01797%27 HTTP/1.1" 200 None
2026-01-29 06:10:04 [auto1.fr] INFO: Scrape type for KR01797: 0
2026-01-29 06:10:04 [auto1.fr] INFO: Found listing with ID: ZD99974
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZD99974%27 HTTP/1.1" 200 None
2026-01-29 06:10:04 [auto1.fr] INFO: Scrape type for ZD99974: 2
2026-01-29 06:10:04 [auto1.fr] INFO: Found listing with ID: JH98274
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JH98274%27 HTTP/1.1" 200 None
2026-01-29 06:10:04 [auto1.fr] INFO: Scrape type for JH98274: 0
2026-01-29 06:10:04 [auto1.fr] INFO: Found listing with ID: XK82724
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XK82724%27 HTTP/1.1" 200 None
2026-01-29 06:10:04 [auto1.fr] INFO: Scrape type for XK82724: 0
2026-01-29 06:10:04 [auto1.fr] INFO: Found listing with ID: HR52395
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HR52395%27 HTTP/1.1" 200 None
2026-01-29 06:10:04 [auto1.fr] INFO: Scrape type for HR52395: 2
2026-01-29 06:10:04 [auto1.fr] INFO: Found listing with ID: FP30059
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP30059%27 HTTP/1.1" 200 None
2026-01-29 06:10:04 [auto1.fr] INFO: Scrape type for FP30059: 0
2026-01-29 06:10:04 [auto1.fr] INFO: Found listing with ID: XT67917
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XT67917%27 HTTP/1.1" 200 None
2026-01-29 06:10:04 [auto1.fr] INFO: Scrape type for XT67917: 2
2026-01-29 06:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YX73308> (referer: https://www.auto1.com/v1/car-details-view/YX73308/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:04 [auto1.fr] INFO: Found listing with ID: ER10684
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER10684%27 HTTP/1.1" 200 None
2026-01-29 06:10:04 [auto1.fr] INFO: Scrape type for ER10684: 0
2026-01-29 06:10:04 [auto1.fr] INFO: Found listing with ID: DG84599
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DG84599%27 HTTP/1.1" 200 None
2026-01-29 06:10:04 [auto1.fr] INFO: Scrape type for DG84599: 2
2026-01-29 06:10:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:04 [auto1.fr] INFO: Found listing with ID: EB31317
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EB31317%27 HTTP/1.1" 200 None
2026-01-29 06:10:04 [auto1.fr] INFO: Scrape type for EB31317: 2
2026-01-29 06:10:04 [auto1.fr] INFO: Found listing with ID: SW52581
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SW52581%27 HTTP/1.1" 200 None
2026-01-29 06:10:04 [auto1.fr] INFO: Scrape type for SW52581: 2
2026-01-29 06:10:04 [auto1.fr] INFO: Found listing with ID: HL81547
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL81547%27 HTTP/1.1" 200 None
2026-01-29 06:10:04 [auto1.fr] INFO: Scrape type for HL81547: 0
2026-01-29 06:10:04 [auto1.fr] INFO: Found listing with ID: LA63700
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LA63700%27 HTTP/1.1" 200 None
2026-01-29 06:10:04 [auto1.fr] INFO: Scrape type for LA63700: 2
2026-01-29 06:10:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6867018a-eb31-5747-953f-d6e595d70887 with identifier: YX73308
2026-01-29 06:10:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6867018a-eb31-5747-953f-d6e595d70887 with scrape type 2
2026-01-29 06:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6867018a-eb31-5747-953f-d6e595d70887 with scrape type 2
2026-01-29 06:10:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6867018a-eb31-5747-953f-d6e595d70887, identifier: YX73308
2026-01-29 06:10:04 [auto1.fr] INFO: Found listing with ID: FG57874
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FG57874%27 HTTP/1.1" 200 None
2026-01-29 06:10:04 [auto1.fr] INFO: Scrape type for FG57874: 2
2026-01-29 06:10:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6867018a-eb31-5747-953f-d6e595d70887 with identifier: YX73308
2026-01-29 06:10:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6867018a-eb31-5747-953f-d6e595d70887 with identifier: YX73308
2026-01-29 06:10:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo opel 2020', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'automatic', 'odometer': 84424, 'odometer_reading_unit': 'km', 'registration_date': '2020-02-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yx73308', 'expiration_date': '2026-01-29t16:04:59z', 'origin_country_code': 'fr', 'trim': '2020', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, warluis', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 108, 'id': '6867018a-eb31-5747-953f-d6e595d70887', 'current_year_diff': 6, 'age_in_months': 71, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 84424}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 71,
     'auction_title': '',
     'c_o_2_emission_value': 108,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:04:59z',
     'fuel_type': 'petrol',
     'id': '6867018a-eb31-5747-953f-d6e595d70887',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yx73308',
     'listing': 'auction',
     'location': 'fr, warluis',
     'make': 'opel',
     'make_model': 'opel crossland x',
     'model': 'crossland x',
     'odometer': 84424,
     'odometer_in_km': 84424,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-02-27',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel crossland x 1.2 turbo opel 2020',
     'transmission': 'automatic',
     'trim': '2020',
     'year': 2020}
2026-01-29 06:10:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 6867018a-eb31-5747-953f-d6e595d70887 spider: auto1.fr
2026-01-29 06:10:04 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 6867018a-eb31-5747-953f-d6e595d70887 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo opel 2020', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'automatic', 'odometer': 84424, 'odometer_reading_unit': 'km', 'registration_date': '2020-02-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yx73308', 'expiration_date': '2026-01-29t16:04:59z', 'origin_country_code': 'fr', 'trim': '2020', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, warluis', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 108, 'id': '6867018a-eb31-5747-953f-d6e595d70887', 'current_year_diff': 6, 'age_in_months': 71, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 84424}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 71,
     'auction_title': '',
     'c_o_2_emission_value': 108,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:04:59z',
     'fuel_type': 'petrol',
     'id': '6867018a-eb31-5747-953f-d6e595d70887',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yx73308',
     'listing': 'auction',
     'location': 'fr, warluis',
     'make': 'opel',
     'make_model': 'opel crossland x',
     'model': 'crossland x',
     'odometer': 84424,
     'odometer_in_km': 84424,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-02-27',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel crossland x 1.2 turbo opel 2020',
     'transmission': 'automatic',
     'trim': '2020',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:04:59Z',
 'fuel_type': 'petrol',
 'id': '6867018a-eb31-5747-953f-d6e595d70887',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX73308',
 'listing': 'auction',
 'location': 'FR, Warluis',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 84424,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo Opel 2020',
 'transmission': 'automatic',
 'trim': '2020',
 'year': 2020}
2026-01-29 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YX73308%27 HTTP/1.1" 200 None
2026-01-29 06:10:05 [auto1.fr] INFO: Saving data for YX73308: {'auction_closing_time': 1769702699.0, 'created_time': 1768412948.066366, 'last_price_update_time': 1769667005.004843}
2026-01-29 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YX73308') HTTP/1.1" 204 0
2026-01-29 06:10:05 [auto1.fr] INFO: Found listing with ID: DB00479
2026-01-29 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DB00479%27 HTTP/1.1" 200 None
2026-01-29 06:10:05 [auto1.fr] INFO: Scrape type for DB00479: 0
2026-01-29 06:10:05 [auto1.fr] INFO: Found listing with ID: SH20103
2026-01-29 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SH20103%27 HTTP/1.1" 200 None
2026-01-29 06:10:05 [auto1.fr] INFO: Scrape type for SH20103: 0
2026-01-29 06:10:05 [auto1.fr] INFO: Found listing with ID: SG30852
2026-01-29 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SG30852%27 HTTP/1.1" 200 None
2026-01-29 06:10:05 [auto1.fr] INFO: Scrape type for SG30852: 0
2026-01-29 06:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SL02719/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DK16750/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AY94997> (referer: https://www.auto1.com/v1/car-details-view/AY94997/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XG42198/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GT27181/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 982a902c-40be-5250-ae45-64f6952c86dc with identifier: AY94997
2026-01-29 06:10:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 982a902c-40be-5250-ae45-64f6952c86dc with scrape type 2
2026-01-29 06:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 982a902c-40be-5250-ae45-64f6952c86dc with scrape type 2
2026-01-29 06:10:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 982a902c-40be-5250-ae45-64f6952c86dc, identifier: AY94997
2026-01-29 06:10:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 982a902c-40be-5250-ae45-64f6952c86dc with identifier: AY94997
2026-01-29 06:10:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 982a902c-40be-5250-ae45-64f6952c86dc with identifier: AY94997
2026-01-29 06:10:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 72522, 'odometer_reading_unit': 'km', 'registration_date': '2023-12-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ay94997', 'expiration_date': '2026-01-29t16:25:18z', 'origin_country_code': 'fr', 'trim': 'elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '982a902c-40be-5250-ae45-64f6952c86dc', 'current_year_diff': 3, 'age_in_months': 25, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 72522}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 25,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:25:18z',
     'fuel_type': 'petrol',
     'id': '982a902c-40be-5250-ae45-64f6952c86dc',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ay94997',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'opel',
     'make_model': 'opel crossland x',
     'model': 'crossland x',
     'odometer': 72522,
     'odometer_in_km': 72522,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-12-26',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel crossland x 1.2 turbo elegance',
     'transmission': 'manual',
     'trim': 'elegance',
     'year': 2023}
2026-01-29 06:10:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 982a902c-40be-5250-ae45-64f6952c86dc spider: auto1.fr
2026-01-29 06:10:05 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 982a902c-40be-5250-ae45-64f6952c86dc due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'manual', 'odometer': 72522, 'odometer_reading_unit': 'km', 'registration_date': '2023-12-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ay94997', 'expiration_date': '2026-01-29t16:25:18z', 'origin_country_code': 'fr', 'trim': 'elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '982a902c-40be-5250-ae45-64f6952c86dc', 'current_year_diff': 3, 'age_in_months': 25, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 72522}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 25,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:25:18z',
     'fuel_type': 'petrol',
     'id': '982a902c-40be-5250-ae45-64f6952c86dc',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ay94997',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'opel',
     'make_model': 'opel crossland x',
     'model': 'crossland x',
     'odometer': 72522,
     'odometer_in_km': 72522,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-12-26',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel crossland x 1.2 turbo elegance',
     'transmission': 'manual',
     'trim': 'elegance',
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:25:18Z',
 'fuel_type': 'petrol',
 'id': '982a902c-40be-5250-ae45-64f6952c86dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY94997',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 72522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2023}
2026-01-29 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AY94997%27 HTTP/1.1" 200 None
2026-01-29 06:10:05 [auto1.fr] INFO: Saving data for AY94997: {'auction_closing_time': 1769703918.0, 'created_time': 1769533766.354542, 'last_price_update_time': 1769667005.602743}
2026-01-29 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AY94997') HTTP/1.1" 204 0
2026-01-29 06:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TA58027> (referer: https://www.auto1.com/v1/car-details-view/TA58027/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a44247e-c314-5dd0-a99d-ddffbb1088a4 with identifier: TA58027
2026-01-29 06:10:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a44247e-c314-5dd0-a99d-ddffbb1088a4 with scrape type 2
2026-01-29 06:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a44247e-c314-5dd0-a99d-ddffbb1088a4 with scrape type 2
2026-01-29 06:10:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3a44247e-c314-5dd0-a99d-ddffbb1088a4, identifier: TA58027
2026-01-29 06:10:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3a44247e-c314-5dd0-a99d-ddffbb1088a4 with identifier: TA58027
2026-01-29 06:10:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3a44247e-c314-5dd0-a99d-ddffbb1088a4 with identifier: TA58027
2026-01-29 06:10:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'automatic', 'odometer': 97347, 'odometer_reading_unit': 'km', 'registration_date': '2017-01-12', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ta58027', 'expiration_date': '2026-01-29t16:19:20z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, allennes-les-marais', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 104, 'id': '3a44247e-c314-5dd0-a99d-ddffbb1088a4', 'current_year_diff': 9, 'age_in_months': 108, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 97347}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 108,
     'auction_title': '',
     'c_o_2_emission_value': 104,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:19:20z',
     'fuel_type': 'petrol',
     'id': '3a44247e-c314-5dd0-a99d-ddffbb1088a4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ta58027',
     'listing': 'auction',
     'location': 'fr, allennes-les-marais',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 97347,
     'odometer_in_km': 97347,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-01-12',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech allure',
     'transmission': 'automatic',
     'trim': 'allure',
     'year': 2017}
2026-01-29 06:10:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 3a44247e-c314-5dd0-a99d-ddffbb1088a4 spider: auto1.fr
2026-01-29 06:10:06 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 3a44247e-c314-5dd0-a99d-ddffbb1088a4 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'automatic', 'odometer': 97347, 'odometer_reading_unit': 'km', 'registration_date': '2017-01-12', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ta58027', 'expiration_date': '2026-01-29t16:19:20z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, allennes-les-marais', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 104, 'id': '3a44247e-c314-5dd0-a99d-ddffbb1088a4', 'current_year_diff': 9, 'age_in_months': 108, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 97347}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 108,
     'auction_title': '',
     'c_o_2_emission_value': 104,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:19:20z',
     'fuel_type': 'petrol',
     'id': '3a44247e-c314-5dd0-a99d-ddffbb1088a4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ta58027',
     'listing': 'auction',
     'location': 'fr, allennes-les-marais',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 97347,
     'odometer_in_km': 97347,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-01-12',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech allure',
     'transmission': 'automatic',
     'trim': 'allure',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:19:20Z',
 'fuel_type': 'petrol',
 'id': '3a44247e-c314-5dd0-a99d-ddffbb1088a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA58027',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 97347,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2017}
2026-01-29 06:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA58027%27 HTTP/1.1" 200 None
2026-01-29 06:10:06 [auto1.fr] INFO: Saving data for TA58027: {'auction_closing_time': 1769703560.0, 'created_time': 1768496719.214868, 'last_price_update_time': 1769667006.144596}
2026-01-29 06:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TA58027') HTTP/1.1" 204 0
2026-01-29 06:10:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RX22292/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PM10789/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GL48917> (referer: https://www.auto1.com/v1/car-details-view/GL48917/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 262b5da2-ec25-5822-9e6c-a45cb3248792 with identifier: GL48917
2026-01-29 06:10:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 262b5da2-ec25-5822-9e6c-a45cb3248792 with scrape type 2
2026-01-29 06:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 262b5da2-ec25-5822-9e6c-a45cb3248792 with scrape type 2
2026-01-29 06:10:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 262b5da2-ec25-5822-9e6c-a45cb3248792, identifier: GL48917
2026-01-29 06:10:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 262b5da2-ec25-5822-9e6c-a45cb3248792 with identifier: GL48917
2026-01-29 06:10:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 262b5da2-ec25-5822-9e6c-a45cb3248792 with identifier: GL48917
2026-01-29 06:10:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech c-series', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 41496, 'odometer_reading_unit': 'km', 'registration_date': '2023-03-21', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gl48917', 'expiration_date': '2026-01-29t16:47:50z', 'origin_country_code': 'fr', 'trim': 'c-series', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, boé', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 123, 'id': '262b5da2-ec25-5822-9e6c-a45cb3248792', 'current_year_diff': 3, 'age_in_months': 34, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 41496}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 34,
     'auction_title': '',
     'c_o_2_emission_value': 123,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:47:50z',
     'fuel_type': 'petrol',
     'id': '262b5da2-ec25-5822-9e6c-a45cb3248792',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gl48917',
     'listing': 'auction',
     'location': 'fr, boé',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 41496,
     'odometer_in_km': 41496,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-03-21',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech c-series',
     'transmission': 'manual',
     'trim': 'c-series',
     'year': 2023}
2026-01-29 06:10:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 262b5da2-ec25-5822-9e6c-a45cb3248792 spider: auto1.fr
2026-01-29 06:10:06 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 262b5da2-ec25-5822-9e6c-a45cb3248792 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech c-series', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 41496, 'odometer_reading_unit': 'km', 'registration_date': '2023-03-21', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gl48917', 'expiration_date': '2026-01-29t16:47:50z', 'origin_country_code': 'fr', 'trim': 'c-series', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, boé', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 123, 'id': '262b5da2-ec25-5822-9e6c-a45cb3248792', 'current_year_diff': 3, 'age_in_months': 34, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 41496}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 34,
     'auction_title': '',
     'c_o_2_emission_value': 123,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:47:50z',
     'fuel_type': 'petrol',
     'id': '262b5da2-ec25-5822-9e6c-a45cb3248792',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gl48917',
     'listing': 'auction',
     'location': 'fr, boé',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 41496,
     'odometer_in_km': 41496,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-03-21',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech c-series',
     'transmission': 'manual',
     'trim': 'c-series',
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:47:50Z',
 'fuel_type': 'petrol',
 'id': '262b5da2-ec25-5822-9e6c-a45cb3248792',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL48917',
 'listing': 'auction',
 'location': 'FR, Boé',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 41496,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech C-Series',
 'transmission': 'manual',
 'trim': 'C-Series',
 'year': 2023}
2026-01-29 06:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GL48917%27 HTTP/1.1" 200 None
2026-01-29 06:10:06 [auto1.fr] INFO: Saving data for GL48917: {'auction_closing_time': 1769705270.0, 'created_time': 1767175473.153685, 'last_price_update_time': 1769667006.93333}
2026-01-29 06:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GL48917') HTTP/1.1" 204 0
2026-01-29 06:10:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YJ87670> (referer: https://www.auto1.com/v1/car-details-view/YJ87670/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:06 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:10:06 [auto1.fr] INFO: Found listing with ID: CY79346
2026-01-29 06:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY79346%27 HTTP/1.1" 200 None
2026-01-29 06:10:06 [auto1.fr] INFO: Scrape type for CY79346: 2
2026-01-29 06:10:06 [auto1.fr] INFO: Found listing with ID: ZM99861
2026-01-29 06:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZM99861%27 HTTP/1.1" 200 None
2026-01-29 06:10:07 [auto1.fr] INFO: Scrape type for ZM99861: 0
2026-01-29 06:10:07 [auto1.fr] INFO: Found listing with ID: MH52543
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MH52543%27 HTTP/1.1" 200 None
2026-01-29 06:10:07 [auto1.fr] INFO: Scrape type for MH52543: 0
2026-01-29 06:10:07 [auto1.fr] INFO: Found listing with ID: DK27288
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DK27288%27 HTTP/1.1" 200 None
2026-01-29 06:10:07 [auto1.fr] INFO: Scrape type for DK27288: 2
2026-01-29 06:10:07 [auto1.fr] INFO: Found listing with ID: CD90552
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CD90552%27 HTTP/1.1" 200 None
2026-01-29 06:10:07 [auto1.fr] INFO: Scrape type for CD90552: 2
2026-01-29 06:10:07 [auto1.fr] INFO: Found listing with ID: YB41417
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YB41417%27 HTTP/1.1" 200 None
2026-01-29 06:10:07 [auto1.fr] INFO: Scrape type for YB41417: 2
2026-01-29 06:10:07 [auto1.fr] INFO: Found listing with ID: AN06030
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AN06030%27 HTTP/1.1" 200 None
2026-01-29 06:10:07 [auto1.fr] INFO: Scrape type for AN06030: 0
2026-01-29 06:10:07 [auto1.fr] INFO: Found listing with ID: DY52158
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DY52158%27 HTTP/1.1" 200 None
2026-01-29 06:10:07 [auto1.fr] INFO: Scrape type for DY52158: 2
2026-01-29 06:10:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca2079ae-65eb-5ad7-a35e-28afe6a65be9 with identifier: YJ87670
2026-01-29 06:10:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca2079ae-65eb-5ad7-a35e-28afe6a65be9 with scrape type 2
2026-01-29 06:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca2079ae-65eb-5ad7-a35e-28afe6a65be9 with scrape type 2
2026-01-29 06:10:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ca2079ae-65eb-5ad7-a35e-28afe6a65be9, identifier: YJ87670
2026-01-29 06:10:07 [auto1.fr] INFO: Found listing with ID: RZ21744
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RZ21744%27 HTTP/1.1" 200 None
2026-01-29 06:10:07 [auto1.fr] INFO: Scrape type for RZ21744: 2
2026-01-29 06:10:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ca2079ae-65eb-5ad7-a35e-28afe6a65be9 with identifier: YJ87670
2026-01-29 06:10:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ca2079ae-65eb-5ad7-a35e-28afe6a65be9 with identifier: YJ87670
2026-01-29 06:10:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ca2079ae-65eb-5ad7-a35e-28afe6a65be9 with identifier: YJ87670 to the API
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YJ87670>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:57:57Z',
 'fuel_type': 'petrol',
 'id': 'ca2079ae-65eb-5ad7-a35e-28afe6a65be9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ87670',
 'listing': 'auction',
 'location': 'FR, Quincieux',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 93762,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Kadjar 1.3 TCe Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2019}
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YJ87670%27 HTTP/1.1" 200 None
2026-01-29 06:10:07 [auto1.fr] INFO: Saving data for YJ87670: {'auction_closing_time': 1769705877.0, 'created_time': 1768669371.446356, 'last_price_update_time': 1769667007.613063}
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YJ87670') HTTP/1.1" 204 0
2026-01-29 06:10:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RX66580/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:07 [auto1.fr] INFO: Found listing with ID: JC55859
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JC55859%27 HTTP/1.1" 200 None
2026-01-29 06:10:07 [auto1.fr] INFO: Scrape type for JC55859: 0
2026-01-29 06:10:07 [auto1.fr] INFO: Found listing with ID: US73773
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27US73773%27 HTTP/1.1" 200 None
2026-01-29 06:10:07 [auto1.fr] INFO: Scrape type for US73773: 0
2026-01-29 06:10:07 [auto1.fr] INFO: Found listing with ID: YE93175
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YE93175%27 HTTP/1.1" 200 None
2026-01-29 06:10:07 [auto1.fr] INFO: Scrape type for YE93175: 0
2026-01-29 06:10:07 [auto1.fr] INFO: Found listing with ID: AW56765
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW56765%27 HTTP/1.1" 200 None
2026-01-29 06:10:07 [auto1.fr] INFO: Scrape type for AW56765: 2
2026-01-29 06:10:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FG57874/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GM33700/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XT67917/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:07 [auto1.fr] INFO: Found listing with ID: NX65649
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NX65649%27 HTTP/1.1" 200 None
2026-01-29 06:10:07 [auto1.fr] INFO: Scrape type for NX65649: 0
2026-01-29 06:10:07 [auto1.fr] INFO: Found listing with ID: AF52457
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AF52457%27 HTTP/1.1" 200 None
2026-01-29 06:10:07 [auto1.fr] INFO: Scrape type for AF52457: 2
2026-01-29 06:10:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:07 [auto1.fr] INFO: Found listing with ID: NT33381
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NT33381%27 HTTP/1.1" 200 None
2026-01-29 06:10:07 [auto1.fr] INFO: Scrape type for NT33381: 0
2026-01-29 06:10:07 [auto1.fr] INFO: Found listing with ID: MZ94536
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MZ94536%27 HTTP/1.1" 200 None
2026-01-29 06:10:07 [auto1.fr] INFO: Scrape type for MZ94536: 0
2026-01-29 06:10:07 [auto1.fr] INFO: Found listing with ID: LP76331
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LP76331%27 HTTP/1.1" 200 None
2026-01-29 06:10:07 [auto1.fr] INFO: Scrape type for LP76331: 0
2026-01-29 06:10:07 [auto1.fr] INFO: Found listing with ID: TL83290
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TL83290%27 HTTP/1.1" 200 None
2026-01-29 06:10:07 [auto1.fr] INFO: Scrape type for TL83290: 0
2026-01-29 06:10:07 [auto1.fr] INFO: Found listing with ID: LF86877
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LF86877%27 HTTP/1.1" 200 None
2026-01-29 06:10:07 [auto1.fr] INFO: Scrape type for LF86877: 0
2026-01-29 06:10:07 [auto1.fr] INFO: Found listing with ID: NN74677
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NN74677%27 HTTP/1.1" 200 None
2026-01-29 06:10:07 [auto1.fr] INFO: Scrape type for NN74677: 2
2026-01-29 06:10:07 [auto1.fr] INFO: Found listing with ID: HN21789
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HN21789%27 HTTP/1.1" 200 None
2026-01-29 06:10:07 [auto1.fr] INFO: Scrape type for HN21789: 2
2026-01-29 06:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LA63700/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:08 [auto1.fr] INFO: Found listing with ID: MN61417
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MN61417%27 HTTP/1.1" 200 None
2026-01-29 06:10:08 [auto1.fr] INFO: Scrape type for MN61417: 0
2026-01-29 06:10:08 [auto1.fr] INFO: Found listing with ID: SD79052
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SD79052%27 HTTP/1.1" 200 None
2026-01-29 06:10:08 [auto1.fr] INFO: Scrape type for SD79052: 0
2026-01-29 06:10:08 [auto1.fr] INFO: Found listing with ID: DG18947
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DG18947%27 HTTP/1.1" 200 None
2026-01-29 06:10:08 [auto1.fr] INFO: Scrape type for DG18947: 2
2026-01-29 06:10:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:08 [auto1.fr] INFO: Found listing with ID: HG81818
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HG81818%27 HTTP/1.1" 200 None
2026-01-29 06:10:08 [auto1.fr] INFO: Scrape type for HG81818: 0
2026-01-29 06:10:08 [auto1.fr] INFO: Found listing with ID: VT22230
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VT22230%27 HTTP/1.1" 200 None
2026-01-29 06:10:08 [auto1.fr] INFO: Scrape type for VT22230: 0
2026-01-29 06:10:08 [auto1.fr] INFO: Found listing with ID: MJ27655
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MJ27655%27 HTTP/1.1" 200 None
2026-01-29 06:10:08 [auto1.fr] INFO: Scrape type for MJ27655: 2
2026-01-29 06:10:08 [auto1.fr] INFO: Found listing with ID: VS08569
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS08569%27 HTTP/1.1" 200 None
2026-01-29 06:10:08 [auto1.fr] INFO: Scrape type for VS08569: 2
2026-01-29 06:10:08 [auto1.fr] INFO: Found listing with ID: PN04905
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PN04905%27 HTTP/1.1" 200 None
2026-01-29 06:10:08 [auto1.fr] INFO: Scrape type for PN04905: 2
2026-01-29 06:10:08 [auto1.fr] INFO: Found listing with ID: FU88469
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FU88469%27 HTTP/1.1" 200 None
2026-01-29 06:10:08 [auto1.fr] INFO: Scrape type for FU88469: 0
2026-01-29 06:10:08 [auto1.fr] INFO: Found listing with ID: PS15708
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PS15708%27 HTTP/1.1" 200 None
2026-01-29 06:10:08 [auto1.fr] INFO: Scrape type for PS15708: 2
2026-01-29 06:10:08 [auto1.fr] INFO: Found listing with ID: RE01250
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RE01250%27 HTTP/1.1" 200 None
2026-01-29 06:10:08 [auto1.fr] INFO: Scrape type for RE01250: 0
2026-01-29 06:10:08 [auto1.fr] INFO: Found listing with ID: AS08204
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AS08204%27 HTTP/1.1" 200 None
2026-01-29 06:10:08 [auto1.fr] INFO: Scrape type for AS08204: 0
2026-01-29 06:10:08 [auto1.fr] INFO: Found listing with ID: VU18730
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VU18730%27 HTTP/1.1" 200 None
2026-01-29 06:10:08 [auto1.fr] INFO: Scrape type for VU18730: 0
2026-01-29 06:10:08 [auto1.fr] INFO: Found listing with ID: PE68055
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PE68055%27 HTTP/1.1" 200 None
2026-01-29 06:10:08 [auto1.fr] INFO: Scrape type for PE68055: 2
2026-01-29 06:10:08 [auto1.fr] INFO: Found listing with ID: DJ66574
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DJ66574%27 HTTP/1.1" 200 None
2026-01-29 06:10:08 [auto1.fr] INFO: Scrape type for DJ66574: 2
2026-01-29 06:10:08 [auto1.fr] INFO: Found listing with ID: UC69029
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UC69029%27 HTTP/1.1" 200 None
2026-01-29 06:10:08 [auto1.fr] INFO: Scrape type for UC69029: 2
2026-01-29 06:10:08 [auto1.fr] INFO: Found listing with ID: UF80477
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UF80477%27 HTTP/1.1" 200 None
2026-01-29 06:10:08 [auto1.fr] INFO: Scrape type for UF80477: 2
2026-01-29 06:10:08 [auto1.fr] INFO: Found listing with ID: RC08800
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RC08800%27 HTTP/1.1" 200 None
2026-01-29 06:10:08 [auto1.fr] INFO: Scrape type for RC08800: 2
2026-01-29 06:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SW52581/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DG84599/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XG42198> (referer: https://www.auto1.com/v1/car-details-view/XG42198/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GT27181> (referer: https://www.auto1.com/v1/car-details-view/GT27181/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5cf3722-73d7-5edb-a40c-c8b524dee6b0 with identifier: XG42198
2026-01-29 06:10:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5cf3722-73d7-5edb-a40c-c8b524dee6b0 with scrape type 2
2026-01-29 06:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5cf3722-73d7-5edb-a40c-c8b524dee6b0 with scrape type 2
2026-01-29 06:10:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f5cf3722-73d7-5edb-a40c-c8b524dee6b0, identifier: XG42198
2026-01-29 06:10:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f5cf3722-73d7-5edb-a40c-c8b524dee6b0 with identifier: XG42198
2026-01-29 06:10:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f5cf3722-73d7-5edb-a40c-c8b524dee6b0 with identifier: XG42198
2026-01-29 06:10:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech active business', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 79706, 'odometer_reading_unit': 'km', 'registration_date': '2019-04-14', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xg42198', 'expiration_date': '2026-01-29t16:08:24z', 'origin_country_code': 'fr', 'trim': 'active business', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 112, 'id': 'f5cf3722-73d7-5edb-a40c-c8b524dee6b0', 'current_year_diff': 7, 'age_in_months': 81, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 79706}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 81,
     'auction_title': '',
     'c_o_2_emission_value': 112,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:08:24z',
     'fuel_type': 'petrol',
     'id': 'f5cf3722-73d7-5edb-a40c-c8b524dee6b0',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xg42198',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 79706,
     'odometer_in_km': 79706,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-04-14',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech active business',
     'transmission': 'manual',
     'trim': 'active business',
     'year': 2019}
2026-01-29 06:10:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: f5cf3722-73d7-5edb-a40c-c8b524dee6b0 spider: auto1.fr
2026-01-29 06:10:09 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: f5cf3722-73d7-5edb-a40c-c8b524dee6b0 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech active business', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 79706, 'odometer_reading_unit': 'km', 'registration_date': '2019-04-14', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xg42198', 'expiration_date': '2026-01-29t16:08:24z', 'origin_country_code': 'fr', 'trim': 'active business', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 112, 'id': 'f5cf3722-73d7-5edb-a40c-c8b524dee6b0', 'current_year_diff': 7, 'age_in_months': 81, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 79706}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 81,
     'auction_title': '',
     'c_o_2_emission_value': 112,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:08:24z',
     'fuel_type': 'petrol',
     'id': 'f5cf3722-73d7-5edb-a40c-c8b524dee6b0',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xg42198',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 79706,
     'odometer_in_km': 79706,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-04-14',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech active business',
     'transmission': 'manual',
     'trim': 'active business',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:08:24Z',
 'fuel_type': 'petrol',
 'id': 'f5cf3722-73d7-5edb-a40c-c8b524dee6b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG42198',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 79706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Active Business',
 'transmission': 'manual',
 'trim': 'Active Business',
 'year': 2019}
2026-01-29 06:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XG42198%27 HTTP/1.1" 200 None
2026-01-29 06:10:09 [auto1.fr] INFO: Saving data for XG42198: {'auction_closing_time': 1769702904.0, 'created_time': 1765386679.501886, 'last_price_update_time': 1769667009.578883}
2026-01-29 06:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XG42198') HTTP/1.1" 204 0
2026-01-29 06:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EB31317/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DK16750> (referer: https://www.auto1.com/v1/car-details-view/DK16750/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a73f20f-9c66-5395-b0b4-ec11f6d7122c with identifier: GT27181
2026-01-29 06:10:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a73f20f-9c66-5395-b0b4-ec11f6d7122c with scrape type 2
2026-01-29 06:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a73f20f-9c66-5395-b0b4-ec11f6d7122c with scrape type 2
2026-01-29 06:10:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7a73f20f-9c66-5395-b0b4-ec11f6d7122c, identifier: GT27181
2026-01-29 06:10:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7a73f20f-9c66-5395-b0b4-ec11f6d7122c with identifier: GT27181
2026-01-29 06:10:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7a73f20f-9c66-5395-b0b4-ec11f6d7122c with identifier: GT27181
2026-01-29 06:10:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 166527 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    166527
2026-01-29 06:10:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 7a73f20f-9c66-5395-b0b4-ec11f6d7122c spider: auto1.fr
2026-01-29 06:10:09 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 7a73f20f-9c66-5395-b0b4-ec11f6d7122c due to rule: high_mileage_for_country.json, error: 166527 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    166527
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:03:17Z',
 'fuel_type': 'diesel',
 'id': '7a73f20f-9c66-5395-b0b4-ec11f6d7122c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT27181',
 'listing': 'auction',
 'location': 'FR, Limoges',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 166527,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 xDrive 20d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-01-29 06:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GT27181%27 HTTP/1.1" 200 None
2026-01-29 06:10:10 [auto1.fr] INFO: Saving data for GT27181: {'auction_closing_time': 1769702597.0, 'created_time': 1769534687.822108, 'last_price_update_time': 1769667010.011271}
2026-01-29 06:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GT27181') HTTP/1.1" 204 0
2026-01-29 06:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XR75814/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6084c87e-811b-5cce-bf95-321fd0d204cf with identifier: DK16750
2026-01-29 06:10:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6084c87e-811b-5cce-bf95-321fd0d204cf with scrape type 2
2026-01-29 06:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6084c87e-811b-5cce-bf95-321fd0d204cf with scrape type 2
2026-01-29 06:10:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6084c87e-811b-5cce-bf95-321fd0d204cf, identifier: DK16750
2026-01-29 06:10:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6084c87e-811b-5cce-bf95-321fd0d204cf with identifier: DK16750
2026-01-29 06:10:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6084c87e-811b-5cce-bf95-321fd0d204cf with identifier: DK16750
2026-01-29 06:10:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6084c87e-811b-5cce-bf95-321fd0d204cf with identifier: DK16750 to the API
2026-01-29 06:10:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DK16750>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 178,
 'expiration_date': '2026-01-29T16:05:36Z',
 'fuel_type': 'petrol',
 'id': '6084c87e-811b-5cce-bf95-321fd0d204cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK16750',
 'listing': 'auction',
 'location': 'FR, Warluis',
 'make': 'BMW',
 'model': '1er',
 'odometer': 74487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 120i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-01-29 06:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DK16750%27 HTTP/1.1" 200 None
2026-01-29 06:10:10 [auto1.fr] INFO: Saving data for DK16750: {'auction_closing_time': 1769702736.0, 'created_time': 1768989734.969194, 'last_price_update_time': 1769667010.663106}
2026-01-29 06:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DK16750') HTTP/1.1" 204 0
2026-01-29 06:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RX22292> (referer: https://www.auto1.com/v1/car-details-view/RX22292/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SL02719> (referer: https://www.auto1.com/v1/car-details-view/SL02719/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 408749eb-d42f-5a11-ab9f-4e37c743622e with identifier: RX22292
2026-01-29 06:10:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 408749eb-d42f-5a11-ab9f-4e37c743622e with scrape type 2
2026-01-29 06:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 408749eb-d42f-5a11-ab9f-4e37c743622e with scrape type 2
2026-01-29 06:10:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 408749eb-d42f-5a11-ab9f-4e37c743622e, identifier: RX22292
2026-01-29 06:10:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 408749eb-d42f-5a11-ab9f-4e37c743622e with identifier: RX22292
2026-01-29 06:10:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 408749eb-d42f-5a11-ab9f-4e37c743622e with identifier: RX22292
2026-01-29 06:10:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'nissan qashqai 1.2 n-connecta', 'price': 0, 'currency': 'eur', 'make': 'nissan', 'model': 'qashqai', 'transmission': 'manual', 'odometer': 48332, 'odometer_reading_unit': 'km', 'registration_date': '2017-11-20', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/rx22292', 'expiration_date': '2026-01-29t16:37:34z', 'origin_country_code': 'fr', 'trim': 'n-connecta', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 115, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 129, 'id': '408749eb-d42f-5a11-ab9f-4e37c743622e', 'current_year_diff': 9, 'age_in_months': 98, 'make_model': 'nissan qashqai', 'sanitized_make': 'nissan', 'odometer_in_km': 48332}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 98,
     'auction_title': '',
     'c_o_2_emission_value': 129,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 115,
     'expiration_date': '2026-01-29t16:37:34z',
     'fuel_type': 'petrol',
     'id': '408749eb-d42f-5a11-ab9f-4e37c743622e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/rx22292',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'nissan',
     'make_model': 'nissan qashqai',
     'model': 'qashqai',
     'odometer': 48332,
     'odometer_in_km': 48332,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-11-20',
     'sanitized_make': 'nissan',
     'seats_number': 5,
     'seller_name': None,
     'title': 'nissan qashqai 1.2 n-connecta',
     'transmission': 'manual',
     'trim': 'n-connecta',
     'year': 2017}
2026-01-29 06:10:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 408749eb-d42f-5a11-ab9f-4e37c743622e spider: auto1.fr
2026-01-29 06:10:11 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 408749eb-d42f-5a11-ab9f-4e37c743622e due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'nissan qashqai 1.2 n-connecta', 'price': 0, 'currency': 'eur', 'make': 'nissan', 'model': 'qashqai', 'transmission': 'manual', 'odometer': 48332, 'odometer_reading_unit': 'km', 'registration_date': '2017-11-20', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/rx22292', 'expiration_date': '2026-01-29t16:37:34z', 'origin_country_code': 'fr', 'trim': 'n-connecta', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 115, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 129, 'id': '408749eb-d42f-5a11-ab9f-4e37c743622e', 'current_year_diff': 9, 'age_in_months': 98, 'make_model': 'nissan qashqai', 'sanitized_make': 'nissan', 'odometer_in_km': 48332}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 98,
     'auction_title': '',
     'c_o_2_emission_value': 129,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 115,
     'expiration_date': '2026-01-29t16:37:34z',
     'fuel_type': 'petrol',
     'id': '408749eb-d42f-5a11-ab9f-4e37c743622e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/rx22292',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'nissan',
     'make_model': 'nissan qashqai',
     'model': 'qashqai',
     'odometer': 48332,
     'odometer_in_km': 48332,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-11-20',
     'sanitized_make': 'nissan',
     'seats_number': 5,
     'seller_name': None,
     'title': 'nissan qashqai 1.2 n-connecta',
     'transmission': 'manual',
     'trim': 'n-connecta',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:37:34Z',
 'fuel_type': 'petrol',
 'id': '408749eb-d42f-5a11-ab9f-4e37c743622e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX22292',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 48332,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2017}
2026-01-29 06:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RX22292%27 HTTP/1.1" 200 None
2026-01-29 06:10:11 [auto1.fr] INFO: Saving data for RX22292: {'auction_closing_time': 1769704654.0, 'created_time': 1769533763.218786, 'last_price_update_time': 1769667011.081919}
2026-01-29 06:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RX22292') HTTP/1.1" 204 0
2026-01-29 06:10:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PM10789> (referer: https://www.auto1.com/v1/car-details-view/PM10789/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RZ21744/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee5b8358-274a-5e59-a6d7-b22d9f6b055c with identifier: SL02719
2026-01-29 06:10:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee5b8358-274a-5e59-a6d7-b22d9f6b055c with scrape type 2
2026-01-29 06:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee5b8358-274a-5e59-a6d7-b22d9f6b055c with scrape type 2
2026-01-29 06:10:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ee5b8358-274a-5e59-a6d7-b22d9f6b055c, identifier: SL02719
2026-01-29 06:10:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ee5b8358-274a-5e59-a6d7-b22d9f6b055c with identifier: SL02719
2026-01-29 06:10:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ee5b8358-274a-5e59-a6d7-b22d9f6b055c with identifier: SL02719
2026-01-29 06:10:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ee5b8358-274a-5e59-a6d7-b22d9f6b055c with identifier: SL02719 to the API
2026-01-29 06:10:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SL02719>
{'auction_title': '',
 'c_o_2_emission_value': 58,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 320,
 'expiration_date': '2026-01-29T16:25:47Z',
 'fuel_type': 'hybrid',
 'id': 'ee5b8358-274a-5e59-a6d7-b22d9f6b055c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL02719',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 91684,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-05-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 300e 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2020}
2026-01-29 06:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL02719%27 HTTP/1.1" 200 None
2026-01-29 06:10:11 [auto1.fr] INFO: Saving data for SL02719: {'auction_closing_time': 1769703947.0, 'created_time': 1769533861.240144, 'last_price_update_time': 1769667011.503825}
2026-01-29 06:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SL02719') HTTP/1.1" 204 0
2026-01-29 06:10:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AW56765/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9a51442-ad98-5748-bb23-2e10b5bdc5c6 with identifier: PM10789
2026-01-29 06:10:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9a51442-ad98-5748-bb23-2e10b5bdc5c6 with scrape type 2
2026-01-29 06:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9a51442-ad98-5748-bb23-2e10b5bdc5c6 with scrape type 2
2026-01-29 06:10:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f9a51442-ad98-5748-bb23-2e10b5bdc5c6, identifier: PM10789
2026-01-29 06:10:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f9a51442-ad98-5748-bb23-2e10b5bdc5c6 with identifier: PM10789
2026-01-29 06:10:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f9a51442-ad98-5748-bb23-2e10b5bdc5c6 with identifier: PM10789
2026-01-29 06:10:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 156585 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    156585
2026-01-29 06:10:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f9a51442-ad98-5748-bb23-2e10b5bdc5c6 spider: auto1.fr
2026-01-29 06:10:11 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: f9a51442-ad98-5748-bb23-2e10b5bdc5c6 due to rule: high_mileage_for_country.json, error: 156585 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    156585
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:44:43Z',
 'fuel_type': 'petrol',
 'id': 'f9a51442-ad98-5748-bb23-2e10b5bdc5c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM10789',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 156585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 1.4 TFSI ACT S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2018}
2026-01-29 06:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PM10789%27 HTTP/1.1" 200 None
2026-01-29 06:10:11 [auto1.fr] INFO: Saving data for PM10789: {'auction_closing_time': 1769705083.0, 'created_time': 1768903568.418487, 'last_price_update_time': 1769667011.834271}
2026-01-29 06:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PM10789') HTTP/1.1" 204 0
2026-01-29 06:10:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DY52158/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YB41417/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RC08800/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:12 [scrapy.extensions.logstats] INFO: Crawled 807 pages (at 114 pages/min), scraped 172 items (at 22 items/min)
2026-01-29 06:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RX66580> (referer: https://www.auto1.com/v1/car-details-view/RX66580/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51140a1b-bce2-5ad2-bfe2-b711e61b8cda with identifier: RX66580
2026-01-29 06:10:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51140a1b-bce2-5ad2-bfe2-b711e61b8cda with scrape type 2
2026-01-29 06:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51140a1b-bce2-5ad2-bfe2-b711e61b8cda with scrape type 2
2026-01-29 06:10:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 51140a1b-bce2-5ad2-bfe2-b711e61b8cda, identifier: RX66580
2026-01-29 06:10:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 51140a1b-bce2-5ad2-bfe2-b711e61b8cda with identifier: RX66580
2026-01-29 06:10:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 51140a1b-bce2-5ad2-bfe2-b711e61b8cda with identifier: RX66580
2026-01-29 06:10:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 51140a1b-bce2-5ad2-bfe2-b711e61b8cda with identifier: RX66580 to the API
2026-01-29 06:10:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RX66580>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:54:48Z',
 'fuel_type': 'diesel',
 'id': '51140a1b-bce2-5ad2-bfe2-b711e61b8cda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX66580',
 'listing': 'auction',
 'location': 'FR, Saint-Saulve',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 71769,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TDI Life 1st',
 'transmission': 'automatic',
 'trim': 'Life 1st',
 'year': 2021}
2026-01-29 06:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RX66580%27 HTTP/1.1" 200 None
2026-01-29 06:10:12 [auto1.fr] INFO: Saving data for RX66580: {'auction_closing_time': 1769705688.0, 'created_time': 1769534164.493516, 'last_price_update_time': 1769667012.949344}
2026-01-29 06:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RX66580') HTTP/1.1" 204 0
2026-01-29 06:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UF80477/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SW52581> (referer: https://www.auto1.com/v1/car-details-view/SW52581/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DJ66574/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a139a7dd-52c6-5f8e-b32b-57267307e3bf with identifier: SW52581
2026-01-29 06:10:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a139a7dd-52c6-5f8e-b32b-57267307e3bf with scrape type 2
2026-01-29 06:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a139a7dd-52c6-5f8e-b32b-57267307e3bf with scrape type 2
2026-01-29 06:10:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a139a7dd-52c6-5f8e-b32b-57267307e3bf, identifier: SW52581
2026-01-29 06:10:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a139a7dd-52c6-5f8e-b32b-57267307e3bf with identifier: SW52581
2026-01-29 06:10:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a139a7dd-52c6-5f8e-b32b-57267307e3bf with identifier: SW52581
2026-01-29 06:10:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a139a7dd-52c6-5f8e-b32b-57267307e3bf with identifier: SW52581 to the API
2026-01-29 06:10:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SW52581>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:03:15Z',
 'fuel_type': 'petrol',
 'id': 'a139a7dd-52c6-5f8e-b32b-57267307e3bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW52581',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 56783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Kona 1.0 TGDI Initia 2WD',
 'transmission': 'manual',
 'trim': 'Initia 2WD',
 'year': 2021}
2026-01-29 06:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SW52581%27 HTTP/1.1" 200 None
2026-01-29 06:10:13 [auto1.fr] INFO: Saving data for SW52581: {'auction_closing_time': 1769702595.0, 'created_time': 1769533468.399395, 'last_price_update_time': 1769667013.473352}
2026-01-29 06:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SW52581') HTTP/1.1" 204 0
2026-01-29 06:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UC69029/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DG84599> (referer: https://www.auto1.com/v1/car-details-view/DG84599/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PE68055/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43b2afa2-53ce-5cb6-a9a3-4096a2ba96b6 with identifier: DG84599
2026-01-29 06:10:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43b2afa2-53ce-5cb6-a9a3-4096a2ba96b6 with scrape type 2
2026-01-29 06:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43b2afa2-53ce-5cb6-a9a3-4096a2ba96b6 with scrape type 2
2026-01-29 06:10:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 43b2afa2-53ce-5cb6-a9a3-4096a2ba96b6, identifier: DG84599
2026-01-29 06:10:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 43b2afa2-53ce-5cb6-a9a3-4096a2ba96b6 with identifier: DG84599
2026-01-29 06:10:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 43b2afa2-53ce-5cb6-a9a3-4096a2ba96b6 with identifier: DG84599
2026-01-29 06:10:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 43b2afa2-53ce-5cb6-a9a3-4096a2ba96b6 with identifier: DG84599 to the API
2026-01-29 06:10:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DG84599>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 299,
 'expiration_date': '2026-01-29T16:36:49Z',
 'fuel_type': 'hybrid',
 'id': '43b2afa2-53ce-5cb6-a9a3-4096a2ba96b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG84599',
 'listing': 'auction',
 'location': 'FR, Warluis',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 108964,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Hybrid GT Pack',
 'transmission': 'automatic',
 'trim': 'GT Pack',
 'year': 2021}
2026-01-29 06:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DG84599%27 HTTP/1.1" 200 None
2026-01-29 06:10:13 [auto1.fr] INFO: Saving data for DG84599: {'auction_closing_time': 1769704609.0, 'created_time': 1769533739.860125, 'last_price_update_time': 1769667013.992332}
2026-01-29 06:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DG84599') HTTP/1.1" 204 0
2026-01-29 06:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EB31317> (referer: https://www.auto1.com/v1/car-details-view/EB31317/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dfa862f-6a7c-54fa-97e6-04f425b79efb with identifier: EB31317
2026-01-29 06:10:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dfa862f-6a7c-54fa-97e6-04f425b79efb with scrape type 2
2026-01-29 06:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2dfa862f-6a7c-54fa-97e6-04f425b79efb with scrape type 2
2026-01-29 06:10:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2dfa862f-6a7c-54fa-97e6-04f425b79efb, identifier: EB31317
2026-01-29 06:10:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2dfa862f-6a7c-54fa-97e6-04f425b79efb with identifier: EB31317
2026-01-29 06:10:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2dfa862f-6a7c-54fa-97e6-04f425b79efb with identifier: EB31317
2026-01-29 06:10:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2dfa862f-6a7c-54fa-97e6-04f425b79efb with identifier: EB31317 to the API
2026-01-29 06:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EB31317>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:26:45Z',
 'fuel_type': 'petrol',
 'id': '2dfa862f-6a7c-54fa-97e6-04f425b79efb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB31317',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 4913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i20 1.0 T-GDI Mild-Hybrid Creative',
 'transmission': 'manual',
 'trim': 'Creative',
 'year': 2024}
2026-01-29 06:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EB31317%27 HTTP/1.1" 200 None
2026-01-29 06:10:14 [auto1.fr] INFO: Saving data for EB31317: {'auction_closing_time': 1769704005.0, 'created_time': 1769534649.497361, 'last_price_update_time': 1769667014.654113}
2026-01-29 06:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EB31317') HTTP/1.1" 204 0
2026-01-29 06:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RA18506/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VS08569/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PS15708/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XR75814> (referer: https://www.auto1.com/v1/car-details-view/XR75814/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 202cebe9-0fa6-5de9-8b4e-613df3261034 with identifier: XR75814
2026-01-29 06:10:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 202cebe9-0fa6-5de9-8b4e-613df3261034 with scrape type 2
2026-01-29 06:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 202cebe9-0fa6-5de9-8b4e-613df3261034 with scrape type 2
2026-01-29 06:10:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 202cebe9-0fa6-5de9-8b4e-613df3261034, identifier: XR75814
2026-01-29 06:10:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 202cebe9-0fa6-5de9-8b4e-613df3261034 with identifier: XR75814
2026-01-29 06:10:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 202cebe9-0fa6-5de9-8b4e-613df3261034 with identifier: XR75814
2026-01-29 06:10:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 202cebe9-0fa6-5de9-8b4e-613df3261034 with identifier: XR75814 to the API
2026-01-29 06:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XR75814>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:54:59Z',
 'fuel_type': 'diesel',
 'id': '202cebe9-0fa6-5de9-8b4e-613df3261034',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR75814',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 90311,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-01-26',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Peugeot 208 1.5 Blue-HDi Road Trip',
 'transmission': 'manual',
 'trim': 'Road Trip',
 'year': 2022}
2026-01-29 06:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XR75814%27 HTTP/1.1" 200 None
2026-01-29 06:10:15 [auto1.fr] INFO: Saving data for XR75814: {'auction_closing_time': 1769705699.0, 'created_time': 1769533675.583159, 'last_price_update_time': 1769667015.278263}
2026-01-29 06:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XR75814') HTTP/1.1" 204 0
2026-01-29 06:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LA63700> (referer: https://www.auto1.com/v1/car-details-view/LA63700/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PN04905/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdedae38-3c1b-5827-b5f2-a83219682019 with identifier: LA63700
2026-01-29 06:10:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdedae38-3c1b-5827-b5f2-a83219682019 with scrape type 2
2026-01-29 06:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdedae38-3c1b-5827-b5f2-a83219682019 with scrape type 2
2026-01-29 06:10:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bdedae38-3c1b-5827-b5f2-a83219682019, identifier: LA63700
2026-01-29 06:10:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bdedae38-3c1b-5827-b5f2-a83219682019 with identifier: LA63700
2026-01-29 06:10:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bdedae38-3c1b-5827-b5f2-a83219682019 with identifier: LA63700
2026-01-29 06:10:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bdedae38-3c1b-5827-b5f2-a83219682019 with identifier: LA63700 to the API
2026-01-29 06:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LA63700>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 67,
 'expiration_date': '2026-01-29T16:31:31Z',
 'fuel_type': 'petrol',
 'id': 'bdedae38-3c1b-5827-b5f2-a83219682019',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA63700',
 'listing': 'auction',
 'location': 'FR, LE HAVRE',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 37993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Initia',
 'transmission': 'manual',
 'trim': 'Initia',
 'year': 2021}
2026-01-29 06:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LA63700%27 HTTP/1.1" 200 None
2026-01-29 06:10:15 [auto1.fr] INFO: Saving data for LA63700: {'auction_closing_time': 1769704291.0, 'created_time': 1768844173.028123, 'last_price_update_time': 1769667015.815407}
2026-01-29 06:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LA63700') HTTP/1.1" 204 0
2026-01-29 06:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RZ21744> (referer: https://www.auto1.com/v1/car-details-view/RZ21744/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 262120af-d9cd-5767-80d9-5be9561e5aca with identifier: RZ21744
2026-01-29 06:10:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 262120af-d9cd-5767-80d9-5be9561e5aca with scrape type 2
2026-01-29 06:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 262120af-d9cd-5767-80d9-5be9561e5aca with scrape type 2
2026-01-29 06:10:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 262120af-d9cd-5767-80d9-5be9561e5aca, identifier: RZ21744
2026-01-29 06:10:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 262120af-d9cd-5767-80d9-5be9561e5aca with identifier: RZ21744
2026-01-29 06:10:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 262120af-d9cd-5767-80d9-5be9561e5aca with identifier: RZ21744
2026-01-29 06:10:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 262120af-d9cd-5767-80d9-5be9561e5aca with identifier: RZ21744 to the API
2026-01-29 06:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RZ21744>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:27:39Z',
 'fuel_type': 'diesel',
 'id': '262120af-d9cd-5767-80d9-5be9561e5aca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ21744',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 114348,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Kadjar 1.5 dCi Energy Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2018}
2026-01-29 06:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RZ21744%27 HTTP/1.1" 200 None
2026-01-29 06:10:16 [auto1.fr] INFO: Saving data for RZ21744: {'auction_closing_time': 1769704059.0, 'created_time': 1769533715.007226, 'last_price_update_time': 1769667016.316178}
2026-01-29 06:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RZ21744') HTTP/1.1" 204 0
2026-01-29 06:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AW56765> (referer: https://www.auto1.com/v1/car-details-view/AW56765/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RC08800> (referer: https://www.auto1.com/v1/car-details-view/RC08800/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94b9d92b-e0a8-5c81-ab81-bce530fe911a with identifier: AW56765
2026-01-29 06:10:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94b9d92b-e0a8-5c81-ab81-bce530fe911a with scrape type 2
2026-01-29 06:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94b9d92b-e0a8-5c81-ab81-bce530fe911a with scrape type 2
2026-01-29 06:10:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 94b9d92b-e0a8-5c81-ab81-bce530fe911a, identifier: AW56765
2026-01-29 06:10:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 491df17c-9f07-5b45-a7c6-6f372e077250 with identifier: RC08800
2026-01-29 06:10:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 491df17c-9f07-5b45-a7c6-6f372e077250 with scrape type 2
2026-01-29 06:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 491df17c-9f07-5b45-a7c6-6f372e077250 with scrape type 2
2026-01-29 06:10:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 491df17c-9f07-5b45-a7c6-6f372e077250, identifier: RC08800
2026-01-29 06:10:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 94b9d92b-e0a8-5c81-ab81-bce530fe911a with identifier: AW56765
2026-01-29 06:10:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 94b9d92b-e0a8-5c81-ab81-bce530fe911a with identifier: AW56765
2026-01-29 06:10:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
2026-01-29 06:10:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 94b9d92b-e0a8-5c81-ab81-bce530fe911a spider: auto1.fr
2026-01-29 06:10:16 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 94b9d92b-e0a8-5c81-ab81-bce530fe911a due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 179,
 'expiration_date': '2026-01-29T16:43:04Z',
 'fuel_type': 'diesel',
 'id': '94b9d92b-e0a8-5c81-ab81-bce530fe911a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW56765',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 114440,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-27',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi Asphalt L2',
 'transmission': 'automatic',
 'trim': 'Asphalt L2',
 'year': 2021}
2026-01-29 06:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW56765%27 HTTP/1.1" 200 None
2026-01-29 06:10:16 [auto1.fr] INFO: Saving data for AW56765: {'auction_closing_time': 1769704984.0, 'created_time': 1769533811.463695, 'last_price_update_time': 1769667016.908031}
2026-01-29 06:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AW56765') HTTP/1.1" 204 0
2026-01-29 06:10:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 491df17c-9f07-5b45-a7c6-6f372e077250 with identifier: RC08800
2026-01-29 06:10:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 491df17c-9f07-5b45-a7c6-6f372e077250 with identifier: RC08800
2026-01-29 06:10:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 491df17c-9f07-5b45-a7c6-6f372e077250 with identifier: RC08800 to the API
2026-01-29 06:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RC08800>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:15:32Z',
 'fuel_type': 'diesel',
 'id': '491df17c-9f07-5b45-a7c6-6f372e077250',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC08800',
 'listing': 'auction',
 'location': 'FR, Marly-la-ville',
 'make': 'BMW',
 'model': '4er',
 'odometer': 67401,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 4er 420d Gran Coupé Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2018}
2026-01-29 06:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RC08800%27 HTTP/1.1" 200 None
2026-01-29 06:10:17 [auto1.fr] INFO: Saving data for RC08800: {'auction_closing_time': 1769703332.0, 'created_time': 1769534121.676236, 'last_price_update_time': 1769667017.231839}
2026-01-29 06:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RC08800') HTTP/1.1" 204 0
2026-01-29 06:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MJ27655/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DJ66574> (referer: https://www.auto1.com/v1/car-details-view/DJ66574/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UF80477> (referer: https://www.auto1.com/v1/car-details-view/UF80477/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e4b6458-22c7-59a6-a662-34a5c8dfd23a with identifier: DJ66574
2026-01-29 06:10:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e4b6458-22c7-59a6-a662-34a5c8dfd23a with scrape type 2
2026-01-29 06:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e4b6458-22c7-59a6-a662-34a5c8dfd23a with scrape type 2
2026-01-29 06:10:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4e4b6458-22c7-59a6-a662-34a5c8dfd23a, identifier: DJ66574
2026-01-29 06:10:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4e4b6458-22c7-59a6-a662-34a5c8dfd23a with identifier: DJ66574
2026-01-29 06:10:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4e4b6458-22c7-59a6-a662-34a5c8dfd23a with identifier: DJ66574
2026-01-29 06:10:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4e4b6458-22c7-59a6-a662-34a5c8dfd23a with identifier: DJ66574 to the API
2026-01-29 06:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DJ66574>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 155,
 'expiration_date': '2026-01-29T16:13:54Z',
 'fuel_type': 'petrol',
 'id': '4e4b6458-22c7-59a6-a662-34a5c8dfd23a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ66574',
 'listing': 'auction',
 'location': 'FR, LE HAVRE',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 70687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 Fascination',
 'transmission': 'automatic',
 'trim': 'Fascination',
 'year': 2019}
2026-01-29 06:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DJ66574%27 HTTP/1.1" 200 None
2026-01-29 06:10:17 [auto1.fr] INFO: Saving data for DJ66574: {'auction_closing_time': 1769703234.0, 'created_time': 1769103335.183792, 'last_price_update_time': 1769667017.770169}
2026-01-29 06:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DJ66574') HTTP/1.1" 204 0
2026-01-29 06:10:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0200a6c8-959a-5d7d-be39-1537ab2f60ff with identifier: UF80477
2026-01-29 06:10:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0200a6c8-959a-5d7d-be39-1537ab2f60ff with scrape type 2
2026-01-29 06:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0200a6c8-959a-5d7d-be39-1537ab2f60ff with scrape type 2
2026-01-29 06:10:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0200a6c8-959a-5d7d-be39-1537ab2f60ff, identifier: UF80477
2026-01-29 06:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XT67917> (referer: https://www.auto1.com/v1/car-details-view/XT67917/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0200a6c8-959a-5d7d-be39-1537ab2f60ff with identifier: UF80477
2026-01-29 06:10:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0200a6c8-959a-5d7d-be39-1537ab2f60ff with identifier: UF80477
2026-01-29 06:10:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 99490, 'odometer_reading_unit': 'km', 'registration_date': '2017-05-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uf80477', 'expiration_date': '2026-01-29t16:27:38z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': '0200a6c8-959a-5d7d-be39-1537ab2f60ff', 'current_year_diff': 9, 'age_in_months': 104, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 99490}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 104,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:27:38z',
     'fuel_type': 'petrol',
     'id': '0200a6c8-959a-5d7d-be39-1537ab2f60ff',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uf80477',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 99490,
     'odometer_in_km': 99490,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-05-29',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2017}
2026-01-29 06:10:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 0200a6c8-959a-5d7d-be39-1537ab2f60ff spider: auto1.fr
2026-01-29 06:10:18 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 0200a6c8-959a-5d7d-be39-1537ab2f60ff due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 99490, 'odometer_reading_unit': 'km', 'registration_date': '2017-05-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uf80477', 'expiration_date': '2026-01-29t16:27:38z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': '0200a6c8-959a-5d7d-be39-1537ab2f60ff', 'current_year_diff': 9, 'age_in_months': 104, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 99490}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 104,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:27:38z',
     'fuel_type': 'petrol',
     'id': '0200a6c8-959a-5d7d-be39-1537ab2f60ff',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uf80477',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 99490,
     'odometer_in_km': 99490,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-05-29',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:27:38Z',
 'fuel_type': 'petrol',
 'id': '0200a6c8-959a-5d7d-be39-1537ab2f60ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF80477',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 99490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2017}
2026-01-29 06:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UF80477%27 HTTP/1.1" 200 None
2026-01-29 06:10:18 [auto1.fr] INFO: Saving data for UF80477: {'auction_closing_time': 1769704058.0, 'created_time': 1768669493.408922, 'last_price_update_time': 1769667018.122865}
2026-01-29 06:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UF80477') HTTP/1.1" 204 0
2026-01-29 06:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YB41417> (referer: https://www.auto1.com/v1/car-details-view/YB41417/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UC69029> (referer: https://www.auto1.com/v1/car-details-view/UC69029/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4164566-f6ef-5460-a2db-16a3b54863ce with identifier: XT67917
2026-01-29 06:10:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4164566-f6ef-5460-a2db-16a3b54863ce with scrape type 2
2026-01-29 06:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4164566-f6ef-5460-a2db-16a3b54863ce with scrape type 2
2026-01-29 06:10:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c4164566-f6ef-5460-a2db-16a3b54863ce, identifier: XT67917
2026-01-29 06:10:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c4164566-f6ef-5460-a2db-16a3b54863ce with identifier: XT67917
2026-01-29 06:10:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c4164566-f6ef-5460-a2db-16a3b54863ce with identifier: XT67917
2026-01-29 06:10:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c4164566-f6ef-5460-a2db-16a3b54863ce with identifier: XT67917 to the API
2026-01-29 06:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XT67917>
{'auction_title': '',
 'c_o_2_emission_value': 49,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 224,
 'expiration_date': '2026-01-29T16:22:29Z',
 'fuel_type': 'hybrid',
 'id': 'c4164566-f6ef-5460-a2db-16a3b54863ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT67917',
 'listing': 'auction',
 'location': 'FR, Marly-la-ville',
 'make': 'BMW',
 'model': '2er',
 'odometer': 110301,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2er 225xe Active Tourer M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-01-29 06:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XT67917%27 HTTP/1.1" 200 None
2026-01-29 06:10:18 [auto1.fr] INFO: Saving data for XT67917: {'auction_closing_time': 1769703749.0, 'created_time': 1768842486.434935, 'last_price_update_time': 1769667018.587648}
2026-01-29 06:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XT67917') HTTP/1.1" 204 0
2026-01-29 06:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PE68055> (referer: https://www.auto1.com/v1/car-details-view/PE68055/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 188d95d4-4033-5d2c-bb3e-fce69c91baa3 with identifier: YB41417
2026-01-29 06:10:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 188d95d4-4033-5d2c-bb3e-fce69c91baa3 with scrape type 2
2026-01-29 06:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 188d95d4-4033-5d2c-bb3e-fce69c91baa3 with scrape type 2
2026-01-29 06:10:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 188d95d4-4033-5d2c-bb3e-fce69c91baa3, identifier: YB41417
2026-01-29 06:10:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10683076-a845-5761-bda2-c25a97779929 with identifier: UC69029
2026-01-29 06:10:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10683076-a845-5761-bda2-c25a97779929 with scrape type 2
2026-01-29 06:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10683076-a845-5761-bda2-c25a97779929 with scrape type 2
2026-01-29 06:10:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 10683076-a845-5761-bda2-c25a97779929, identifier: UC69029
2026-01-29 06:10:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 188d95d4-4033-5d2c-bb3e-fce69c91baa3 with identifier: YB41417
2026-01-29 06:10:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 188d95d4-4033-5d2c-bb3e-fce69c91baa3 with identifier: YB41417
2026-01-29 06:10:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 149105 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    149105
2026-01-29 06:10:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 188d95d4-4033-5d2c-bb3e-fce69c91baa3 spider: auto1.fr
2026-01-29 06:10:19 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 188d95d4-4033-5d2c-bb3e-fce69c91baa3 due to rule: high_mileage_for_make.json, error: 149105 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    149105
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-01-29T16:40:14Z',
 'fuel_type': 'diesel',
 'id': '188d95d4-4033-5d2c-bb3e-fce69c91baa3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB41417',
 'listing': 'auction',
 'location': 'FR, Saint-Quentin',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 149105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-29',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 2.0 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2018}
2026-01-29 06:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YB41417%27 HTTP/1.1" 200 None
2026-01-29 06:10:19 [auto1.fr] INFO: Saving data for YB41417: {'auction_closing_time': 1769704814.0, 'created_time': 1769534240.543295, 'last_price_update_time': 1769667019.033436}
2026-01-29 06:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YB41417') HTTP/1.1" 204 0
2026-01-29 06:10:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 10683076-a845-5761-bda2-c25a97779929 with identifier: UC69029
2026-01-29 06:10:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 10683076-a845-5761-bda2-c25a97779929 with identifier: UC69029
2026-01-29 06:10:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'automatic', 'odometer': 18711, 'odometer_reading_unit': 'km', 'registration_date': '2022-04-20', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uc69029', 'expiration_date': '2026-01-29t16:44:40z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, tarnos', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '10683076-a845-5761-bda2-c25a97779929', 'current_year_diff': 4, 'age_in_months': 45, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 18711}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 45,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:44:40z',
     'fuel_type': 'petrol',
     'id': '10683076-a845-5761-bda2-c25a97779929',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uc69029',
     'listing': 'auction',
     'location': 'fr, tarnos',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 18711,
     'odometer_in_km': 18711,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-04-20',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech shine',
     'transmission': 'automatic',
     'trim': 'shine',
     'year': 2022}
2026-01-29 06:10:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 10683076-a845-5761-bda2-c25a97779929 spider: auto1.fr
2026-01-29 06:10:19 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 10683076-a845-5761-bda2-c25a97779929 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'automatic', 'odometer': 18711, 'odometer_reading_unit': 'km', 'registration_date': '2022-04-20', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uc69029', 'expiration_date': '2026-01-29t16:44:40z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, tarnos', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '10683076-a845-5761-bda2-c25a97779929', 'current_year_diff': 4, 'age_in_months': 45, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 18711}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 45,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:44:40z',
     'fuel_type': 'petrol',
     'id': '10683076-a845-5761-bda2-c25a97779929',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uc69029',
     'listing': 'auction',
     'location': 'fr, tarnos',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 18711,
     'odometer_in_km': 18711,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-04-20',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech shine',
     'transmission': 'automatic',
     'trim': 'shine',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:44:40Z',
 'fuel_type': 'petrol',
 'id': '10683076-a845-5761-bda2-c25a97779929',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC69029',
 'listing': 'auction',
 'location': 'FR, Tarnos',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 18711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2022}
2026-01-29 06:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UC69029%27 HTTP/1.1" 200 None
2026-01-29 06:10:19 [auto1.fr] INFO: Saving data for UC69029: {'auction_closing_time': 1769705080.0, 'created_time': 1769533351.937323, 'last_price_update_time': 1769667019.248803}
2026-01-29 06:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UC69029') HTTP/1.1" 204 0
2026-01-29 06:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DY52158> (referer: https://www.auto1.com/v1/car-details-view/DY52158/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9081e12-cb81-589f-945b-ad462e0f5fa9 with identifier: PE68055
2026-01-29 06:10:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9081e12-cb81-589f-945b-ad462e0f5fa9 with scrape type 2
2026-01-29 06:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9081e12-cb81-589f-945b-ad462e0f5fa9 with scrape type 2
2026-01-29 06:10:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e9081e12-cb81-589f-945b-ad462e0f5fa9, identifier: PE68055
2026-01-29 06:10:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e9081e12-cb81-589f-945b-ad462e0f5fa9 with identifier: PE68055
2026-01-29 06:10:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e9081e12-cb81-589f-945b-ad462e0f5fa9 with identifier: PE68055
2026-01-29 06:10:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e9081e12-cb81-589f-945b-ad462e0f5fa9 with identifier: PE68055 to the API
2026-01-29 06:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PE68055>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:29:54Z',
 'fuel_type': 'petrol',
 'id': 'e9081e12-cb81-589f-945b-ad462e0f5fa9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE68055',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 80940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500X 1.4 Turbo City Cross',
 'transmission': 'automatic',
 'trim': 'City Cross',
 'year': 2018}
2026-01-29 06:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PE68055%27 HTTP/1.1" 200 None
2026-01-29 06:10:19 [auto1.fr] INFO: Saving data for PE68055: {'auction_closing_time': 1769704194.0, 'created_time': 1769449120.418545, 'last_price_update_time': 1769667019.709138}
2026-01-29 06:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PE68055') HTTP/1.1" 204 0
2026-01-29 06:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GM33700> (referer: https://www.auto1.com/v1/car-details-view/GM33700/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FG57874> (referer: https://www.auto1.com/v1/car-details-view/FG57874/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3764aba3-2391-5834-9c0a-d6e529e0df85 with identifier: DY52158
2026-01-29 06:10:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3764aba3-2391-5834-9c0a-d6e529e0df85 with scrape type 2
2026-01-29 06:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3764aba3-2391-5834-9c0a-d6e529e0df85 with scrape type 2
2026-01-29 06:10:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3764aba3-2391-5834-9c0a-d6e529e0df85, identifier: DY52158
2026-01-29 06:10:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3764aba3-2391-5834-9c0a-d6e529e0df85 with identifier: DY52158
2026-01-29 06:10:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3764aba3-2391-5834-9c0a-d6e529e0df85 with identifier: DY52158
2026-01-29 06:10:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 25184, 'odometer_reading_unit': 'km', 'registration_date': '2023-06-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dy52158', 'expiration_date': '2026-01-29t16:03:13z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marly-la-ville', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 130, 'id': '3764aba3-2391-5834-9c0a-d6e529e0df85', 'current_year_diff': 3, 'age_in_months': 31, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 25184}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 31,
     'auction_title': '',
     'c_o_2_emission_value': 130,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:03:13z',
     'fuel_type': 'petrol',
     'id': '3764aba3-2391-5834-9c0a-d6e529e0df85',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dy52158',
     'listing': 'auction',
     'location': 'fr, marly-la-ville',
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 25184,
     'odometer_in_km': 25184,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-06-29',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 1.2 puretech gt',
     'transmission': 'automatic',
     'trim': 'gt',
     'year': 2023}
2026-01-29 06:10:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 3764aba3-2391-5834-9c0a-d6e529e0df85 spider: auto1.fr
2026-01-29 06:10:20 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 3764aba3-2391-5834-9c0a-d6e529e0df85 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 25184, 'odometer_reading_unit': 'km', 'registration_date': '2023-06-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dy52158', 'expiration_date': '2026-01-29t16:03:13z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marly-la-ville', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 130, 'id': '3764aba3-2391-5834-9c0a-d6e529e0df85', 'current_year_diff': 3, 'age_in_months': 31, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 25184}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 31,
     'auction_title': '',
     'c_o_2_emission_value': 130,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:03:13z',
     'fuel_type': 'petrol',
     'id': '3764aba3-2391-5834-9c0a-d6e529e0df85',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dy52158',
     'listing': 'auction',
     'location': 'fr, marly-la-ville',
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 25184,
     'odometer_in_km': 25184,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-06-29',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 1.2 puretech gt',
     'transmission': 'automatic',
     'trim': 'gt',
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:03:13Z',
 'fuel_type': 'petrol',
 'id': '3764aba3-2391-5834-9c0a-d6e529e0df85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY52158',
 'listing': 'auction',
 'location': 'FR, Marly-la-ville',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 25184,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.2 PureTech GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2023}
2026-01-29 06:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DY52158%27 HTTP/1.1" 200 None
2026-01-29 06:10:20 [auto1.fr] INFO: Saving data for DY52158: {'auction_closing_time': 1769702593.0, 'created_time': 1768844168.43792, 'last_price_update_time': 1769667020.036524}
2026-01-29 06:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DY52158') HTTP/1.1" 204 0
2026-01-29 06:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DG18947/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VS08569> (referer: https://www.auto1.com/v1/car-details-view/VS08569/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 675d1c28-8ce6-53ad-b530-4f28ef727f31 with identifier: GM33700
2026-01-29 06:10:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 675d1c28-8ce6-53ad-b530-4f28ef727f31 with scrape type 2
2026-01-29 06:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 675d1c28-8ce6-53ad-b530-4f28ef727f31 with scrape type 2
2026-01-29 06:10:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 675d1c28-8ce6-53ad-b530-4f28ef727f31, identifier: GM33700
2026-01-29 06:10:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f53d3271-53b9-5bae-8e6d-853ce60e45e8 with identifier: FG57874
2026-01-29 06:10:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f53d3271-53b9-5bae-8e6d-853ce60e45e8 with scrape type 2
2026-01-29 06:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f53d3271-53b9-5bae-8e6d-853ce60e45e8 with scrape type 2
2026-01-29 06:10:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f53d3271-53b9-5bae-8e6d-853ce60e45e8, identifier: FG57874
2026-01-29 06:10:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 675d1c28-8ce6-53ad-b530-4f28ef727f31 with identifier: GM33700
2026-01-29 06:10:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 675d1c28-8ce6-53ad-b530-4f28ef727f31 with identifier: GM33700
2026-01-29 06:10:20 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 161659 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    161659
2026-01-29 06:10:20 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 675d1c28-8ce6-53ad-b530-4f28ef727f31 spider: auto1.fr
2026-01-29 06:10:20 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 675d1c28-8ce6-53ad-b530-4f28ef727f31 due to rule: high_mileage_for_country.json, error: 161659 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    161659
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 179,
 'expiration_date': '2026-01-29T16:00:06Z',
 'fuel_type': 'diesel',
 'id': '675d1c28-8ce6-53ad-b530-4f28ef727f31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM33700',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 161659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 508 2.0 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2019}
2026-01-29 06:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GM33700%27 HTTP/1.1" 200 None
2026-01-29 06:10:20 [auto1.fr] INFO: Saving data for GM33700: {'auction_closing_time': 1769702406.0, 'created_time': 1769447199.984424, 'last_price_update_time': 1769667020.485963}
2026-01-29 06:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GM33700') HTTP/1.1" 204 0
2026-01-29 06:10:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f53d3271-53b9-5bae-8e6d-853ce60e45e8 with identifier: FG57874
2026-01-29 06:10:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f53d3271-53b9-5bae-8e6d-853ce60e45e8 with identifier: FG57874
2026-01-29 06:10:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f53d3271-53b9-5bae-8e6d-853ce60e45e8 with identifier: FG57874 to the API
2026-01-29 06:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FG57874>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:00:05Z',
 'fuel_type': 'diesel',
 'id': 'f53d3271-53b9-5bae-8e6d-853ce60e45e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG57874',
 'listing': 'auction',
 'location': 'FR',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 106660,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Duster 1.5 Blue dCi Prestige',
 'transmission': 'manual',
 'trim': 'Prestige',
 'year': 2019}
2026-01-29 06:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FG57874%27 HTTP/1.1" 200 None
2026-01-29 06:10:22 [auto1.fr] INFO: Saving data for FG57874: {'auction_closing_time': 1769702405.0, 'created_time': 1769449073.778441, 'last_price_update_time': 1769667022.655406}
2026-01-29 06:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FG57874') HTTP/1.1" 204 0
2026-01-29 06:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PN04905> (referer: https://www.auto1.com/v1/car-details-view/PN04905/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RA18506> (referer: https://www.auto1.com/v1/car-details-view/RA18506/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PS15708> (referer: https://www.auto1.com/v1/car-details-view/PS15708/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f420050e-855e-5bcc-8579-00a7abd309cf with identifier: VS08569
2026-01-29 06:10:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f420050e-855e-5bcc-8579-00a7abd309cf with scrape type 2
2026-01-29 06:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f420050e-855e-5bcc-8579-00a7abd309cf with scrape type 2
2026-01-29 06:10:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f420050e-855e-5bcc-8579-00a7abd309cf, identifier: VS08569
2026-01-29 06:10:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f420050e-855e-5bcc-8579-00a7abd309cf with identifier: VS08569
2026-01-29 06:10:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f420050e-855e-5bcc-8579-00a7abd309cf with identifier: VS08569
2026-01-29 06:10:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f420050e-855e-5bcc-8579-00a7abd309cf with identifier: VS08569 to the API
2026-01-29 06:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VS08569>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:19:18Z',
 'fuel_type': 'petrol',
 'id': 'f420050e-855e-5bcc-8579-00a7abd309cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS08569',
 'listing': 'auction',
 'location': 'FR, MOUGINS',
 'make': 'BMW',
 'model': '2er',
 'odometer': 66349,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2er 218i Active Tourer Luxury Line',
 'transmission': 'automatic',
 'trim': 'Luxury Line',
 'year': 2022}
2026-01-29 06:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS08569%27 HTTP/1.1" 200 None
2026-01-29 06:10:23 [auto1.fr] INFO: Saving data for VS08569: {'auction_closing_time': 1769703558.0, 'created_time': 1769533748.386214, 'last_price_update_time': 1769667023.131962}
2026-01-29 06:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VS08569') HTTP/1.1" 204 0
2026-01-29 06:10:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6f6663c-4035-590f-94b8-c0a0ddc5c294 with identifier: PN04905
2026-01-29 06:10:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6f6663c-4035-590f-94b8-c0a0ddc5c294 with scrape type 2
2026-01-29 06:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6f6663c-4035-590f-94b8-c0a0ddc5c294 with scrape type 2
2026-01-29 06:10:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e6f6663c-4035-590f-94b8-c0a0ddc5c294, identifier: PN04905
2026-01-29 06:10:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2b9f0d3-2543-5d6d-9e18-48b33a3dcf1b with identifier: RA18506
2026-01-29 06:10:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2b9f0d3-2543-5d6d-9e18-48b33a3dcf1b with scrape type 2
2026-01-29 06:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2b9f0d3-2543-5d6d-9e18-48b33a3dcf1b with scrape type 2
2026-01-29 06:10:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f2b9f0d3-2543-5d6d-9e18-48b33a3dcf1b, identifier: RA18506
2026-01-29 06:10:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b873a2d-db2c-560f-9bcf-adcb2c192e27 with identifier: PS15708
2026-01-29 06:10:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b873a2d-db2c-560f-9bcf-adcb2c192e27 with scrape type 2
2026-01-29 06:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b873a2d-db2c-560f-9bcf-adcb2c192e27 with scrape type 2
2026-01-29 06:10:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7b873a2d-db2c-560f-9bcf-adcb2c192e27, identifier: PS15708
2026-01-29 06:10:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e6f6663c-4035-590f-94b8-c0a0ddc5c294 with identifier: PN04905
2026-01-29 06:10:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e6f6663c-4035-590f-94b8-c0a0ddc5c294 with identifier: PN04905
2026-01-29 06:10:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e6f6663c-4035-590f-94b8-c0a0ddc5c294 with identifier: PN04905 to the API
2026-01-29 06:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PN04905>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:48:43Z',
 'fuel_type': 'diesel',
 'id': 'e6f6663c-4035-590f-94b8-c0a0ddc5c294',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN04905',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 122336,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.5 Blue-HDi Auto-Ecole',
 'transmission': 'manual',
 'trim': 'Auto-Ecole',
 'year': 2021}
2026-01-29 06:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PN04905%27 HTTP/1.1" 200 None
2026-01-29 06:10:23 [auto1.fr] INFO: Saving data for PN04905: {'auction_closing_time': 1769705323.0, 'created_time': 1768905621.571164, 'last_price_update_time': 1769667023.77663}
2026-01-29 06:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PN04905') HTTP/1.1" 204 0
2026-01-29 06:10:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f2b9f0d3-2543-5d6d-9e18-48b33a3dcf1b with identifier: RA18506
2026-01-29 06:10:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f2b9f0d3-2543-5d6d-9e18-48b33a3dcf1b with identifier: RA18506
2026-01-29 06:10:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 puretech active business', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 169597, 'odometer_reading_unit': 'km', 'registration_date': '2019-06-12', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ra18506', 'expiration_date': '2026-01-29t16:52:59z', 'origin_country_code': 'fr', 'trim': 'active business', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, vezin-le-coquet', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 117, 'id': 'f2b9f0d3-2543-5d6d-9e18-48b33a3dcf1b', 'current_year_diff': 7, 'age_in_months': 79, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 169597}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 79,
     'auction_title': '',
     'c_o_2_emission_value': 117,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:52:59z',
     'fuel_type': 'petrol',
     'id': 'f2b9f0d3-2543-5d6d-9e18-48b33a3dcf1b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ra18506',
     'listing': 'auction',
     'location': 'fr, vezin-le-coquet',
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 169597,
     'odometer_in_km': 169597,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-06-12',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 1.2 puretech active business',
     'transmission': 'automatic',
     'trim': 'active business',
     'year': 2019}
2026-01-29 06:10:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: f2b9f0d3-2543-5d6d-9e18-48b33a3dcf1b spider: auto1.fr
2026-01-29 06:10:23 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: f2b9f0d3-2543-5d6d-9e18-48b33a3dcf1b due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 puretech active business', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 169597, 'odometer_reading_unit': 'km', 'registration_date': '2019-06-12', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ra18506', 'expiration_date': '2026-01-29t16:52:59z', 'origin_country_code': 'fr', 'trim': 'active business', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, vezin-le-coquet', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 117, 'id': 'f2b9f0d3-2543-5d6d-9e18-48b33a3dcf1b', 'current_year_diff': 7, 'age_in_months': 79, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 169597}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 79,
     'auction_title': '',
     'c_o_2_emission_value': 117,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:52:59z',
     'fuel_type': 'petrol',
     'id': 'f2b9f0d3-2543-5d6d-9e18-48b33a3dcf1b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ra18506',
     'listing': 'auction',
     'location': 'fr, vezin-le-coquet',
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 169597,
     'odometer_in_km': 169597,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-06-12',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 1.2 puretech active business',
     'transmission': 'automatic',
     'trim': 'active business',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:52:59Z',
 'fuel_type': 'petrol',
 'id': 'f2b9f0d3-2543-5d6d-9e18-48b33a3dcf1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA18506',
 'listing': 'auction',
 'location': 'FR, Vezin-le-Coquet',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 169597,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.2 PureTech Active Business',
 'transmission': 'automatic',
 'trim': 'Active Business',
 'year': 2019}
2026-01-29 06:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RA18506%27 HTTP/1.1" 200 None
2026-01-29 06:10:23 [auto1.fr] INFO: Saving data for RA18506: {'auction_closing_time': 1769705579.0, 'created_time': 1769580156.18485, 'last_price_update_time': 1769667023.995305}
2026-01-29 06:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RA18506') HTTP/1.1" 204 0
2026-01-29 06:10:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7b873a2d-db2c-560f-9bcf-adcb2c192e27 with identifier: PS15708
2026-01-29 06:10:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7b873a2d-db2c-560f-9bcf-adcb2c192e27 with identifier: PS15708
2026-01-29 06:10:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 60026, 'odometer_reading_unit': 'km', 'registration_date': '2018-05-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ps15708', 'expiration_date': '2026-01-29t16:04:15z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marseille', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 103, 'id': '7b873a2d-db2c-560f-9bcf-adcb2c192e27', 'current_year_diff': 8, 'age_in_months': 92, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 60026}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 92,
     'auction_title': '',
     'c_o_2_emission_value': 103,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:04:15z',
     'fuel_type': 'petrol',
     'id': '7b873a2d-db2c-560f-9bcf-adcb2c192e27',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ps15708',
     'listing': 'auction',
     'location': 'fr, marseille',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 60026,
     'odometer_in_km': 60026,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-05-28',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech gt line',
     'transmission': 'manual',
     'trim': 'gt line',
     'year': 2018}
2026-01-29 06:10:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 7b873a2d-db2c-560f-9bcf-adcb2c192e27 spider: auto1.fr
2026-01-29 06:10:24 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 7b873a2d-db2c-560f-9bcf-adcb2c192e27 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 60026, 'odometer_reading_unit': 'km', 'registration_date': '2018-05-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ps15708', 'expiration_date': '2026-01-29t16:04:15z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marseille', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 103, 'id': '7b873a2d-db2c-560f-9bcf-adcb2c192e27', 'current_year_diff': 8, 'age_in_months': 92, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 60026}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 92,
     'auction_title': '',
     'c_o_2_emission_value': 103,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:04:15z',
     'fuel_type': 'petrol',
     'id': '7b873a2d-db2c-560f-9bcf-adcb2c192e27',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ps15708',
     'listing': 'auction',
     'location': 'fr, marseille',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 60026,
     'odometer_in_km': 60026,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-05-28',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech gt line',
     'transmission': 'manual',
     'trim': 'gt line',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:04:15Z',
 'fuel_type': 'petrol',
 'id': '7b873a2d-db2c-560f-9bcf-adcb2c192e27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS15708',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 60026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2018}
2026-01-29 06:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PS15708%27 HTTP/1.1" 200 None
2026-01-29 06:10:24 [auto1.fr] INFO: Saving data for PS15708: {'auction_closing_time': 1769702655.0, 'created_time': 1769450091.628964, 'last_price_update_time': 1769667024.202217}
2026-01-29 06:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PS15708') HTTP/1.1" 204 0
2026-01-29 06:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MJ27655> (referer: https://www.auto1.com/v1/car-details-view/MJ27655/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CD90552/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NN74677/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AF52457/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b81c21c6-682c-5fcb-9d0d-2985eba2c453 with identifier: MJ27655
2026-01-29 06:10:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b81c21c6-682c-5fcb-9d0d-2985eba2c453 with scrape type 2
2026-01-29 06:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b81c21c6-682c-5fcb-9d0d-2985eba2c453 with scrape type 2
2026-01-29 06:10:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b81c21c6-682c-5fcb-9d0d-2985eba2c453, identifier: MJ27655
2026-01-29 06:10:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b81c21c6-682c-5fcb-9d0d-2985eba2c453 with identifier: MJ27655
2026-01-29 06:10:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b81c21c6-682c-5fcb-9d0d-2985eba2c453 with identifier: MJ27655
2026-01-29 06:10:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech affaire premium', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 129116, 'odometer_reading_unit': 'km', 'registration_date': '2017-12-10', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mj27655', 'expiration_date': '2026-01-29t16:55:26z', 'origin_country_code': 'fr', 'trim': 'affaire premium', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, beaucaire', 'category': None, 'seats_number': 2, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': 'b81c21c6-682c-5fcb-9d0d-2985eba2c453', 'current_year_diff': 9, 'age_in_months': 97, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 129116}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 97,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:55:26z',
     'fuel_type': 'petrol',
     'id': 'b81c21c6-682c-5fcb-9d0d-2985eba2c453',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mj27655',
     'listing': 'auction',
     'location': 'fr, beaucaire',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 129116,
     'odometer_in_km': 129116,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-12-10',
     'sanitized_make': 'peugeot',
     'seats_number': 2,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech affaire premium',
     'transmission': 'manual',
     'trim': 'affaire premium',
     'year': 2017}
2026-01-29 06:10:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: b81c21c6-682c-5fcb-9d0d-2985eba2c453 spider: auto1.fr
2026-01-29 06:10:24 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: b81c21c6-682c-5fcb-9d0d-2985eba2c453 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech affaire premium', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 129116, 'odometer_reading_unit': 'km', 'registration_date': '2017-12-10', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mj27655', 'expiration_date': '2026-01-29t16:55:26z', 'origin_country_code': 'fr', 'trim': 'affaire premium', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, beaucaire', 'category': None, 'seats_number': 2, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': 'b81c21c6-682c-5fcb-9d0d-2985eba2c453', 'current_year_diff': 9, 'age_in_months': 97, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 129116}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 97,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:55:26z',
     'fuel_type': 'petrol',
     'id': 'b81c21c6-682c-5fcb-9d0d-2985eba2c453',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mj27655',
     'listing': 'auction',
     'location': 'fr, beaucaire',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 129116,
     'odometer_in_km': 129116,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-12-10',
     'sanitized_make': 'peugeot',
     'seats_number': 2,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech affaire premium',
     'transmission': 'manual',
     'trim': 'affaire premium',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:55:26Z',
 'fuel_type': 'petrol',
 'id': 'b81c21c6-682c-5fcb-9d0d-2985eba2c453',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ27655',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 129116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Affaire Premium',
 'transmission': 'manual',
 'trim': 'Affaire Premium',
 'year': 2017}
2026-01-29 06:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MJ27655%27 HTTP/1.1" 200 None
2026-01-29 06:10:24 [auto1.fr] INFO: Saving data for MJ27655: {'auction_closing_time': 1769705726.0, 'created_time': 1769016927.183975, 'last_price_update_time': 1769667024.635126}
2026-01-29 06:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MJ27655') HTTP/1.1" 204 0
2026-01-29 06:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HR52395/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CY79346/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DX73001/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DK27288/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:25 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:10:25 [auto1.fr] INFO: Found listing with ID: PB84696
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PB84696%27 HTTP/1.1" 200 None
2026-01-29 06:10:25 [auto1.fr] INFO: Scrape type for PB84696: 0
2026-01-29 06:10:25 [auto1.fr] INFO: Found listing with ID: ZH27356
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZH27356%27 HTTP/1.1" 200 None
2026-01-29 06:10:25 [auto1.fr] INFO: Scrape type for ZH27356: 2
2026-01-29 06:10:25 [auto1.fr] INFO: Found listing with ID: YU72456
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YU72456%27 HTTP/1.1" 200 None
2026-01-29 06:10:25 [auto1.fr] INFO: Scrape type for YU72456: 2
2026-01-29 06:10:25 [auto1.fr] INFO: Found listing with ID: RS97711
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RS97711%27 HTTP/1.1" 200 None
2026-01-29 06:10:25 [auto1.fr] INFO: Scrape type for RS97711: 0
2026-01-29 06:10:25 [auto1.fr] INFO: Found listing with ID: PV73378
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PV73378%27 HTTP/1.1" 200 None
2026-01-29 06:10:25 [auto1.fr] INFO: Scrape type for PV73378: 0
2026-01-29 06:10:25 [auto1.fr] INFO: Found listing with ID: UR78175
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UR78175%27 HTTP/1.1" 200 None
2026-01-29 06:10:25 [auto1.fr] INFO: Scrape type for UR78175: 2
2026-01-29 06:10:25 [auto1.fr] INFO: Found listing with ID: HK44264
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK44264%27 HTTP/1.1" 200 None
2026-01-29 06:10:25 [auto1.fr] INFO: Scrape type for HK44264: 2
2026-01-29 06:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NN91069/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:25 [auto1.fr] INFO: Found listing with ID: PU76778
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PU76778%27 HTTP/1.1" 200 None
2026-01-29 06:10:25 [auto1.fr] INFO: Scrape type for PU76778: 2
2026-01-29 06:10:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:25 [auto1.fr] INFO: Found listing with ID: DU96376
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DU96376%27 HTTP/1.1" 200 None
2026-01-29 06:10:25 [auto1.fr] INFO: Scrape type for DU96376: 0
2026-01-29 06:10:25 [auto1.fr] INFO: Found listing with ID: MM14413
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MM14413%27 HTTP/1.1" 200 None
2026-01-29 06:10:25 [auto1.fr] INFO: Scrape type for MM14413: 2
2026-01-29 06:10:25 [auto1.fr] INFO: Found listing with ID: YL11984
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YL11984%27 HTTP/1.1" 200 None
2026-01-29 06:10:25 [auto1.fr] INFO: Scrape type for YL11984: 2
2026-01-29 06:10:25 [auto1.fr] INFO: Found listing with ID: UG59231
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG59231%27 HTTP/1.1" 200 None
2026-01-29 06:10:25 [auto1.fr] INFO: Scrape type for UG59231: 0
2026-01-29 06:10:25 [auto1.fr] INFO: Found listing with ID: WE00312
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WE00312%27 HTTP/1.1" 200 None
2026-01-29 06:10:25 [auto1.fr] INFO: Scrape type for WE00312: 0
2026-01-29 06:10:25 [auto1.fr] INFO: Found listing with ID: ZB44249
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZB44249%27 HTTP/1.1" 200 None
2026-01-29 06:10:25 [auto1.fr] INFO: Scrape type for ZB44249: 2
2026-01-29 06:10:25 [auto1.fr] INFO: Found listing with ID: EV30011
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EV30011%27 HTTP/1.1" 200 None
2026-01-29 06:10:25 [auto1.fr] INFO: Scrape type for EV30011: 0
2026-01-29 06:10:25 [auto1.fr] INFO: Found listing with ID: GG26374
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG26374%27 HTTP/1.1" 200 None
2026-01-29 06:10:25 [auto1.fr] INFO: Scrape type for GG26374: 2
2026-01-29 06:10:25 [auto1.fr] INFO: Found listing with ID: VG61348
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG61348%27 HTTP/1.1" 200 None
2026-01-29 06:10:25 [auto1.fr] INFO: Scrape type for VG61348: 0
2026-01-29 06:10:25 [auto1.fr] INFO: Found listing with ID: LF24785
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LF24785%27 HTTP/1.1" 200 None
2026-01-29 06:10:25 [auto1.fr] INFO: Scrape type for LF24785: 0
2026-01-29 06:10:25 [auto1.fr] INFO: Found listing with ID: VR87679
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VR87679%27 HTTP/1.1" 200 None
2026-01-29 06:10:25 [auto1.fr] INFO: Scrape type for VR87679: 0
2026-01-29 06:10:25 [auto1.fr] INFO: Found listing with ID: MD88660
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MD88660%27 HTTP/1.1" 200 None
2026-01-29 06:10:25 [auto1.fr] INFO: Scrape type for MD88660: 0
2026-01-29 06:10:25 [auto1.fr] INFO: Found listing with ID: SF76043
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF76043%27 HTTP/1.1" 200 None
2026-01-29 06:10:25 [auto1.fr] INFO: Scrape type for SF76043: 2
2026-01-29 06:10:25 [auto1.fr] INFO: Found listing with ID: EN73258
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EN73258%27 HTTP/1.1" 200 None
2026-01-29 06:10:25 [auto1.fr] INFO: Scrape type for EN73258: 0
2026-01-29 06:10:25 [auto1.fr] INFO: Found listing with ID: MC59021
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC59021%27 HTTP/1.1" 200 None
2026-01-29 06:10:25 [auto1.fr] INFO: Scrape type for MC59021: 0
2026-01-29 06:10:25 [auto1.fr] INFO: Found listing with ID: CU00803
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CU00803%27 HTTP/1.1" 200 None
2026-01-29 06:10:25 [auto1.fr] INFO: Scrape type for CU00803: 0
2026-01-29 06:10:25 [auto1.fr] INFO: Found listing with ID: YA12680
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YA12680%27 HTTP/1.1" 200 None
2026-01-29 06:10:25 [auto1.fr] INFO: Scrape type for YA12680: 2
2026-01-29 06:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZD99974/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:25 [auto1.fr] INFO: Found listing with ID: RV53008
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RV53008%27 HTTP/1.1" 200 None
2026-01-29 06:10:25 [auto1.fr] INFO: Scrape type for RV53008: 0
2026-01-29 06:10:25 [auto1.fr] INFO: Found listing with ID: PH02343
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH02343%27 HTTP/1.1" 200 None
2026-01-29 06:10:25 [auto1.fr] INFO: Scrape type for PH02343: 2
2026-01-29 06:10:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:25 [auto1.fr] INFO: Found listing with ID: AF01916
2026-01-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AF01916%27 HTTP/1.1" 200 None
2026-01-29 06:10:26 [auto1.fr] INFO: Scrape type for AF01916: 2
2026-01-29 06:10:26 [auto1.fr] INFO: Found listing with ID: KS72696
2026-01-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KS72696%27 HTTP/1.1" 200 None
2026-01-29 06:10:26 [auto1.fr] INFO: Scrape type for KS72696: 2
2026-01-29 06:10:26 [auto1.fr] INFO: Found listing with ID: WV31927
2026-01-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WV31927%27 HTTP/1.1" 200 None
2026-01-29 06:10:26 [auto1.fr] INFO: Scrape type for WV31927: 0
2026-01-29 06:10:26 [auto1.fr] INFO: Found listing with ID: SR13713
2026-01-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SR13713%27 HTTP/1.1" 200 None
2026-01-29 06:10:26 [auto1.fr] INFO: Scrape type for SR13713: 0
2026-01-29 06:10:26 [auto1.fr] INFO: Found listing with ID: GA07543
2026-01-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GA07543%27 HTTP/1.1" 200 None
2026-01-29 06:10:26 [auto1.fr] INFO: Scrape type for GA07543: 2
2026-01-29 06:10:26 [auto1.fr] INFO: Found listing with ID: MZ13992
2026-01-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MZ13992%27 HTTP/1.1" 200 None
2026-01-29 06:10:26 [auto1.fr] INFO: Scrape type for MZ13992: 2
2026-01-29 06:10:26 [auto1.fr] INFO: Found listing with ID: PT30703
2026-01-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PT30703%27 HTTP/1.1" 200 None
2026-01-29 06:10:26 [auto1.fr] INFO: Scrape type for PT30703: 2
2026-01-29 06:10:26 [auto1.fr] INFO: Found listing with ID: PP86148
2026-01-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PP86148%27 HTTP/1.1" 200 None
2026-01-29 06:10:26 [auto1.fr] INFO: Scrape type for PP86148: 2
2026-01-29 06:10:26 [auto1.fr] INFO: Found listing with ID: FT10167
2026-01-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FT10167%27 HTTP/1.1" 200 None
2026-01-29 06:10:26 [auto1.fr] INFO: Scrape type for FT10167: 0
2026-01-29 06:10:26 [auto1.fr] INFO: Found listing with ID: MP79882
2026-01-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP79882%27 HTTP/1.1" 200 None
2026-01-29 06:10:26 [auto1.fr] INFO: Scrape type for MP79882: 0
2026-01-29 06:10:26 [auto1.fr] INFO: Found listing with ID: PZ17441
2026-01-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PZ17441%27 HTTP/1.1" 200 None
2026-01-29 06:10:26 [auto1.fr] INFO: Scrape type for PZ17441: 2
2026-01-29 06:10:26 [auto1.fr] INFO: Found listing with ID: CA08683
2026-01-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA08683%27 HTTP/1.1" 200 None
2026-01-29 06:10:26 [auto1.fr] INFO: Scrape type for CA08683: 2
2026-01-29 06:10:26 [auto1.fr] INFO: Found listing with ID: GK75380
2026-01-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GK75380%27 HTTP/1.1" 200 None
2026-01-29 06:10:26 [auto1.fr] INFO: Scrape type for GK75380: 2
2026-01-29 06:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UK74430/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XL37074/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EZ25463/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WL50922/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DG18947> (referer: https://www.auto1.com/v1/car-details-view/DG18947/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4803b8b-940d-5560-8d04-875020f5c19a with identifier: DG18947
2026-01-29 06:10:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4803b8b-940d-5560-8d04-875020f5c19a with scrape type 2
2026-01-29 06:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4803b8b-940d-5560-8d04-875020f5c19a with scrape type 2
2026-01-29 06:10:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f4803b8b-940d-5560-8d04-875020f5c19a, identifier: DG18947
2026-01-29 06:10:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f4803b8b-940d-5560-8d04-875020f5c19a with identifier: DG18947
2026-01-29 06:10:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f4803b8b-940d-5560-8d04-875020f5c19a with identifier: DG18947
2026-01-29 06:10:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 39491, 'odometer_reading_unit': 'km', 'registration_date': '2023-10-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dg18947', 'expiration_date': '2026-01-29t16:17:18z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, miramas', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 130, 'id': 'f4803b8b-940d-5560-8d04-875020f5c19a', 'current_year_diff': 3, 'age_in_months': 27, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 39491}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 27,
     'auction_title': '',
     'c_o_2_emission_value': 130,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:17:18z',
     'fuel_type': 'petrol',
     'id': 'f4803b8b-940d-5560-8d04-875020f5c19a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dg18947',
     'listing': 'auction',
     'location': 'fr, miramas',
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 39491,
     'odometer_in_km': 39491,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-10-29',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 1.2 puretech gt',
     'transmission': 'automatic',
     'trim': 'gt',
     'year': 2023}
2026-01-29 06:10:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: f4803b8b-940d-5560-8d04-875020f5c19a spider: auto1.fr
2026-01-29 06:10:26 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: f4803b8b-940d-5560-8d04-875020f5c19a due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 39491, 'odometer_reading_unit': 'km', 'registration_date': '2023-10-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dg18947', 'expiration_date': '2026-01-29t16:17:18z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, miramas', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 130, 'id': 'f4803b8b-940d-5560-8d04-875020f5c19a', 'current_year_diff': 3, 'age_in_months': 27, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 39491}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 27,
     'auction_title': '',
     'c_o_2_emission_value': 130,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:17:18z',
     'fuel_type': 'petrol',
     'id': 'f4803b8b-940d-5560-8d04-875020f5c19a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dg18947',
     'listing': 'auction',
     'location': 'fr, miramas',
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 39491,
     'odometer_in_km': 39491,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-10-29',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 1.2 puretech gt',
     'transmission': 'automatic',
     'trim': 'gt',
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:17:18Z',
 'fuel_type': 'petrol',
 'id': 'f4803b8b-940d-5560-8d04-875020f5c19a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG18947',
 'listing': 'auction',
 'location': 'FR, MIRAMAS',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 39491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.2 PureTech GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2023}
2026-01-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DG18947%27 HTTP/1.1" 200 None
2026-01-29 06:10:26 [auto1.fr] INFO: Saving data for DG18947: {'auction_closing_time': 1769703438.0, 'created_time': 1768669566.540491, 'last_price_update_time': 1769667026.933287}
2026-01-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DG18947') HTTP/1.1" 204 0
2026-01-29 06:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GY60794/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AU80648/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CD90552> (referer: https://www.auto1.com/v1/car-details-view/CD90552/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AF52457> (referer: https://www.auto1.com/v1/car-details-view/AF52457/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99eceb47-81bb-52b1-b912-895e4c000788 with identifier: CD90552
2026-01-29 06:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99eceb47-81bb-52b1-b912-895e4c000788 with scrape type 2
2026-01-29 06:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99eceb47-81bb-52b1-b912-895e4c000788 with scrape type 2
2026-01-29 06:10:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 99eceb47-81bb-52b1-b912-895e4c000788, identifier: CD90552
2026-01-29 06:10:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 99eceb47-81bb-52b1-b912-895e4c000788 with identifier: CD90552
2026-01-29 06:10:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 99eceb47-81bb-52b1-b912-895e4c000788 with identifier: CD90552
2026-01-29 06:10:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 99eceb47-81bb-52b1-b912-895e4c000788 with identifier: CD90552 to the API
2026-01-29 06:10:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CD90552>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 205,
 'expiration_date': '2026-01-29T16:22:31Z',
 'fuel_type': 'diesel',
 'id': '99eceb47-81bb-52b1-b912-895e4c000788',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD90552',
 'listing': 'auction',
 'location': 'FR, Ambarès-et-Lagrave',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 130086,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 250 d 4Matic Executive',
 'transmission': 'automatic',
 'trim': '4Matic Executive',
 'year': 2017}
2026-01-29 06:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CD90552%27 HTTP/1.1" 200 None
2026-01-29 06:10:27 [auto1.fr] INFO: Saving data for CD90552: {'auction_closing_time': 1769703751.0, 'created_time': 1768844226.650573, 'last_price_update_time': 1769667027.758153}
2026-01-29 06:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CD90552') HTTP/1.1" 204 0
2026-01-29 06:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NN74677> (referer: https://www.auto1.com/v1/car-details-view/NN74677/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d02e175-3628-5304-a1a8-2686cbbc78b0 with identifier: AF52457
2026-01-29 06:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d02e175-3628-5304-a1a8-2686cbbc78b0 with scrape type 2
2026-01-29 06:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d02e175-3628-5304-a1a8-2686cbbc78b0 with scrape type 2
2026-01-29 06:10:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6d02e175-3628-5304-a1a8-2686cbbc78b0, identifier: AF52457
2026-01-29 06:10:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6d02e175-3628-5304-a1a8-2686cbbc78b0 with identifier: AF52457
2026-01-29 06:10:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6d02e175-3628-5304-a1a8-2686cbbc78b0 with identifier: AF52457
2026-01-29 06:10:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6d02e175-3628-5304-a1a8-2686cbbc78b0 with identifier: AF52457 to the API
2026-01-29 06:10:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AF52457>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 182,
 'expiration_date': '2026-01-29T16:23:29Z',
 'fuel_type': 'petrol',
 'id': '6d02e175-3628-5304-a1a8-2686cbbc78b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF52457',
 'listing': 'auction',
 'location': 'FR, LA CHAPELLE LONGUEVILLE',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 36334,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda Civic 1.5 VTEC Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2020}
2026-01-29 06:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AF52457%27 HTTP/1.1" 200 None
2026-01-29 06:10:28 [auto1.fr] INFO: Saving data for AF52457: {'auction_closing_time': 1769703809.0, 'created_time': 1768412940.008878, 'last_price_update_time': 1769667028.223457}
2026-01-29 06:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AF52457') HTTP/1.1" 204 0
2026-01-29 06:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CY79346> (referer: https://www.auto1.com/v1/car-details-view/CY79346/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HR52395> (referer: https://www.auto1.com/v1/car-details-view/HR52395/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0b3b005-e843-56eb-8dc7-3a3137203eea with identifier: NN74677
2026-01-29 06:10:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0b3b005-e843-56eb-8dc7-3a3137203eea with scrape type 2
2026-01-29 06:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0b3b005-e843-56eb-8dc7-3a3137203eea with scrape type 2
2026-01-29 06:10:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f0b3b005-e843-56eb-8dc7-3a3137203eea, identifier: NN74677
2026-01-29 06:10:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f0b3b005-e843-56eb-8dc7-3a3137203eea with identifier: NN74677
2026-01-29 06:10:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f0b3b005-e843-56eb-8dc7-3a3137203eea with identifier: NN74677
2026-01-29 06:10:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 181365 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    181365
2026-01-29 06:10:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f0b3b005-e843-56eb-8dc7-3a3137203eea spider: auto1.fr
2026-01-29 06:10:28 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: f0b3b005-e843-56eb-8dc7-3a3137203eea due to rule: high_mileage_for_country.json, error: 181365 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    181365
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:44:20Z',
 'fuel_type': 'petrol',
 'id': 'f0b3b005-e843-56eb-8dc7-3a3137203eea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN74677',
 'listing': 'auction',
 'location': 'FR, Marckolsheim',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 181365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.5 TSI ACT Carat BlueMotion',
 'transmission': 'automatic',
 'trim': 'Carat BlueMotion',
 'year': 2018}
2026-01-29 06:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NN74677%27 HTTP/1.1" 200 None
2026-01-29 06:10:28 [auto1.fr] INFO: Saving data for NN74677: {'auction_closing_time': 1769705060.0, 'created_time': 1769534237.93446, 'last_price_update_time': 1769667028.550805}
2026-01-29 06:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NN74677') HTTP/1.1" 204 0
2026-01-29 06:10:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db42d2fc-8f02-5a5b-8f23-0561c090bfd4 with identifier: CY79346
2026-01-29 06:10:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db42d2fc-8f02-5a5b-8f23-0561c090bfd4 with scrape type 2
2026-01-29 06:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db42d2fc-8f02-5a5b-8f23-0561c090bfd4 with scrape type 2
2026-01-29 06:10:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: db42d2fc-8f02-5a5b-8f23-0561c090bfd4, identifier: CY79346
2026-01-29 06:10:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 679e1581-aa42-559e-9dd6-ce61c2ddf038 with identifier: HR52395
2026-01-29 06:10:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 679e1581-aa42-559e-9dd6-ce61c2ddf038 with scrape type 2
2026-01-29 06:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 679e1581-aa42-559e-9dd6-ce61c2ddf038 with scrape type 2
2026-01-29 06:10:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 679e1581-aa42-559e-9dd6-ce61c2ddf038, identifier: HR52395
2026-01-29 06:10:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: db42d2fc-8f02-5a5b-8f23-0561c090bfd4 with identifier: CY79346
2026-01-29 06:10:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: db42d2fc-8f02-5a5b-8f23-0561c090bfd4 with identifier: CY79346
2026-01-29 06:10:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'yellow', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'automatic', 'odometer': 97855, 'odometer_reading_unit': 'km', 'registration_date': '2021-06-14', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cy79346', 'expiration_date': '2026-01-29t16:07:52z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ambarès-et-lagrave', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 123, 'id': 'db42d2fc-8f02-5a5b-8f23-0561c090bfd4', 'current_year_diff': 5, 'age_in_months': 55, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 97855}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 55,
     'auction_title': '',
     'c_o_2_emission_value': 123,
     'category': None,
     'color': 'yellow',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:07:52z',
     'fuel_type': 'petrol',
     'id': 'db42d2fc-8f02-5a5b-8f23-0561c090bfd4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cy79346',
     'listing': 'auction',
     'location': 'fr, ambarès-et-lagrave',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 97855,
     'odometer_in_km': 97855,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-06-14',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech gt',
     'transmission': 'automatic',
     'trim': 'gt',
     'year': 2021}
2026-01-29 06:10:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: db42d2fc-8f02-5a5b-8f23-0561c090bfd4 spider: auto1.fr
2026-01-29 06:10:28 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: db42d2fc-8f02-5a5b-8f23-0561c090bfd4 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'yellow', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'automatic', 'odometer': 97855, 'odometer_reading_unit': 'km', 'registration_date': '2021-06-14', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cy79346', 'expiration_date': '2026-01-29t16:07:52z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ambarès-et-lagrave', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 123, 'id': 'db42d2fc-8f02-5a5b-8f23-0561c090bfd4', 'current_year_diff': 5, 'age_in_months': 55, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 97855}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 55,
     'auction_title': '',
     'c_o_2_emission_value': 123,
     'category': None,
     'color': 'yellow',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:07:52z',
     'fuel_type': 'petrol',
     'id': 'db42d2fc-8f02-5a5b-8f23-0561c090bfd4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cy79346',
     'listing': 'auction',
     'location': 'fr, ambarès-et-lagrave',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 97855,
     'odometer_in_km': 97855,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-06-14',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech gt',
     'transmission': 'automatic',
     'trim': 'gt',
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:07:52Z',
 'fuel_type': 'petrol',
 'id': 'db42d2fc-8f02-5a5b-8f23-0561c090bfd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY79346',
 'listing': 'auction',
 'location': 'FR, Ambarès-et-Lagrave',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 97855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2021}
2026-01-29 06:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY79346%27 HTTP/1.1" 200 None
2026-01-29 06:10:28 [auto1.fr] INFO: Saving data for CY79346: {'auction_closing_time': 1769702872.0, 'created_time': 1769534273.771251, 'last_price_update_time': 1769667028.968862}
2026-01-29 06:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CY79346') HTTP/1.1" 204 0
2026-01-29 06:10:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 679e1581-aa42-559e-9dd6-ce61c2ddf038 with identifier: HR52395
2026-01-29 06:10:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 679e1581-aa42-559e-9dd6-ce61c2ddf038 with identifier: HR52395
2026-01-29 06:10:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 679e1581-aa42-559e-9dd6-ce61c2ddf038 with identifier: HR52395 to the API
2026-01-29 06:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HR52395>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:28:01Z',
 'fuel_type': 'petrol',
 'id': '679e1581-aa42-559e-9dd6-ce61c2ddf038',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR52395',
 'listing': 'auction',
 'location': 'FR, Wavrin',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 50290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Karoq 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2018}
2026-01-29 06:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HR52395%27 HTTP/1.1" 200 None
2026-01-29 06:10:29 [auto1.fr] INFO: Saving data for HR52395: {'auction_closing_time': 1769704081.0, 'created_time': 1768905567.025422, 'last_price_update_time': 1769667029.287727}
2026-01-29 06:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HR52395') HTTP/1.1" 204 0
2026-01-29 06:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GK75380/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HK44264/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CA08683/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YA12680/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:29 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:10:29 [auto1.fr] INFO: Found listing with ID: SP38358
2026-01-29 06:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SP38358%27 HTTP/1.1" 200 None
2026-01-29 06:10:29 [auto1.fr] INFO: Scrape type for SP38358: 0
2026-01-29 06:10:29 [auto1.fr] INFO: Found listing with ID: ET21233
2026-01-29 06:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ET21233%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for ET21233: 0
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: ZF26912
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZF26912%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for ZF26912: 0
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: GY25596
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GY25596%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for GY25596: 0
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: JN37643
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JN37643%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for JN37643: 2
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: TG76927
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TG76927%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for TG76927: 2
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: BF74578
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BF74578%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for BF74578: 0
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: LL77834
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LL77834%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for LL77834: 2
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: EF21359
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF21359%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for EF21359: 0
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: ZB17998
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZB17998%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for ZB17998: 2
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: EE99755
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EE99755%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for EE99755: 0
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: HE95316
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HE95316%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for HE95316: 2
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: LC55781
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LC55781%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for LC55781: 0
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: VZ57179
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VZ57179%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for VZ57179: 2
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: UA96757
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UA96757%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for UA96757: 0
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: KD62033
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KD62033%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for KD62033: 0
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: NT29231
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NT29231%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for NT29231: 2
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: HW22873
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HW22873%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for HW22873: 0
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: RN56848
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RN56848%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for RN56848: 0
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: TK32898
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TK32898%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for TK32898: 2
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: XC47658
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XC47658%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for XC47658: 2
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: TX68651
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TX68651%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for TX68651: 0
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: JA78615
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA78615%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for JA78615: 2
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: MX19189
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MX19189%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for MX19189: 0
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: YF61555
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YF61555%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for YF61555: 0
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: JN90498
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JN90498%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for JN90498: 0
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: TJ12770
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TJ12770%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for TJ12770: 2
2026-01-29 06:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EZ25463> (referer: https://www.auto1.com/v1/car-details-view/EZ25463/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: SM31602
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SM31602%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for SM31602: 0
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: WJ35089
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WJ35089%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for WJ35089: 2
2026-01-29 06:10:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UK74430> (referer: https://www.auto1.com/v1/car-details-view/UK74430/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XL37074> (referer: https://www.auto1.com/v1/car-details-view/XL37074/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: RL47894
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RL47894%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for RL47894: 0
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: HN33120
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HN33120%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for HN33120: 2
2026-01-29 06:10:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc6f1e78-b570-5112-915c-55c67f04e471 with identifier: EZ25463
2026-01-29 06:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc6f1e78-b570-5112-915c-55c67f04e471 with scrape type 2
2026-01-29 06:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc6f1e78-b570-5112-915c-55c67f04e471 with scrape type 2
2026-01-29 06:10:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bc6f1e78-b570-5112-915c-55c67f04e471, identifier: EZ25463
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: AK24021
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AK24021%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for AK24021: 0
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: WM05201
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM05201%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for WM05201: 0
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: MH57622
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MH57622%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for MH57622: 0
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: LX85116
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LX85116%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for LX85116: 0
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: BD03827
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BD03827%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for BD03827: 0
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: ZF48125
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZF48125%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for ZF48125: 0
2026-01-29 06:10:30 [auto1.fr] INFO: Found listing with ID: JK60715
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JK60715%27 HTTP/1.1" 200 None
2026-01-29 06:10:30 [auto1.fr] INFO: Scrape type for JK60715: 2
2026-01-29 06:10:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bc6f1e78-b570-5112-915c-55c67f04e471 with identifier: EZ25463
2026-01-29 06:10:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bc6f1e78-b570-5112-915c-55c67f04e471 with identifier: EZ25463
2026-01-29 06:10:30 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 159711 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159711
2026-01-29 06:10:30 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: bc6f1e78-b570-5112-915c-55c67f04e471 spider: auto1.fr
2026-01-29 06:10:31 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: bc6f1e78-b570-5112-915c-55c67f04e471 due to rule: high_mileage_for_country.json, error: 159711 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159711
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:56:35Z',
 'fuel_type': 'diesel',
 'id': 'bc6f1e78-b570-5112-915c-55c67f04e471',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ25463',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 159711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Kamiq 1.6 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2020}
2026-01-29 06:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EZ25463%27 HTTP/1.1" 200 None
2026-01-29 06:10:31 [auto1.fr] INFO: Saving data for EZ25463: {'auction_closing_time': 1769705795.0, 'created_time': 1768716153.709228, 'last_price_update_time': 1769667031.119161}
2026-01-29 06:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EZ25463') HTTP/1.1" 204 0
2026-01-29 06:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WL50922> (referer: https://www.auto1.com/v1/car-details-view/WL50922/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:31 [auto1.fr] INFO: Found listing with ID: AF79701
2026-01-29 06:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AF79701%27 HTTP/1.1" 200 None
2026-01-29 06:10:31 [auto1.fr] INFO: Scrape type for AF79701: 2
2026-01-29 06:10:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AU80648> (referer: https://www.auto1.com/v1/car-details-view/AU80648/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PZ17441/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GY60794> (referer: https://www.auto1.com/v1/car-details-view/GY60794/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e34e20d3-f2f6-5297-a383-4436ffde4c94 with identifier: UK74430
2026-01-29 06:10:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e34e20d3-f2f6-5297-a383-4436ffde4c94 with scrape type 2
2026-01-29 06:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e34e20d3-f2f6-5297-a383-4436ffde4c94 with scrape type 2
2026-01-29 06:10:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e34e20d3-f2f6-5297-a383-4436ffde4c94, identifier: UK74430
2026-01-29 06:10:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96feee74-4290-5c2e-9a61-9e8b20448a37 with identifier: XL37074
2026-01-29 06:10:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96feee74-4290-5c2e-9a61-9e8b20448a37 with scrape type 2
2026-01-29 06:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96feee74-4290-5c2e-9a61-9e8b20448a37 with scrape type 2
2026-01-29 06:10:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 96feee74-4290-5c2e-9a61-9e8b20448a37, identifier: XL37074
2026-01-29 06:10:31 [auto1.fr] INFO: Found listing with ID: XF92122
2026-01-29 06:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XF92122%27 HTTP/1.1" 200 None
2026-01-29 06:10:31 [auto1.fr] INFO: Scrape type for XF92122: 2
2026-01-29 06:10:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e34e20d3-f2f6-5297-a383-4436ffde4c94 with identifier: UK74430
2026-01-29 06:10:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e34e20d3-f2f6-5297-a383-4436ffde4c94 with identifier: UK74430
2026-01-29 06:10:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'ds automobiles ds9 1.6 puretech rivoli +', 'price': 0, 'currency': 'eur', 'make': 'ds automobiles', 'model': 'ds9', 'transmission': 'automatic', 'odometer': 173561, 'odometer_reading_unit': 'km', 'registration_date': '2022-11-15', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uk74430', 'expiration_date': '2026-01-29t16:16:33z', 'origin_country_code': 'fr', 'trim': 'rivoli +', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 224, 'doors_number': 4, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.6l', 'location': 'fr, saint-quentin', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 156, 'id': 'e34e20d3-f2f6-5297-a383-4436ffde4c94', 'current_year_diff': 4, 'age_in_months': 38, 'make_model': 'ds automobiles ds9', 'sanitized_make': 'dsautomobiles', 'odometer_in_km': 173561}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 38,
     'auction_title': '',
     'c_o_2_emission_value': 156,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 4,
     'emission_standard': 'euro 6',
     'engine': '1.6l',
     'engine_horse_power': 224,
     'expiration_date': '2026-01-29t16:16:33z',
     'fuel_type': 'petrol',
     'id': 'e34e20d3-f2f6-5297-a383-4436ffde4c94',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uk74430',
     'listing': 'auction',
     'location': 'fr, saint-quentin',
     'make': 'ds automobiles',
     'make_model': 'ds automobiles ds9',
     'model': 'ds9',
     'odometer': 173561,
     'odometer_in_km': 173561,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-11-15',
     'sanitized_make': 'dsautomobiles',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ds automobiles ds9 1.6 puretech rivoli +',
     'transmission': 'automatic',
     'trim': 'rivoli +',
     'year': 2022}
2026-01-29 06:10:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: e34e20d3-f2f6-5297-a383-4436ffde4c94 spider: auto1.fr
2026-01-29 06:10:32 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: e34e20d3-f2f6-5297-a383-4436ffde4c94 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'ds automobiles ds9 1.6 puretech rivoli +', 'price': 0, 'currency': 'eur', 'make': 'ds automobiles', 'model': 'ds9', 'transmission': 'automatic', 'odometer': 173561, 'odometer_reading_unit': 'km', 'registration_date': '2022-11-15', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uk74430', 'expiration_date': '2026-01-29t16:16:33z', 'origin_country_code': 'fr', 'trim': 'rivoli +', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 224, 'doors_number': 4, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.6l', 'location': 'fr, saint-quentin', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 156, 'id': 'e34e20d3-f2f6-5297-a383-4436ffde4c94', 'current_year_diff': 4, 'age_in_months': 38, 'make_model': 'ds automobiles ds9', 'sanitized_make': 'dsautomobiles', 'odometer_in_km': 173561}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 38,
     'auction_title': '',
     'c_o_2_emission_value': 156,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 4,
     'emission_standard': 'euro 6',
     'engine': '1.6l',
     'engine_horse_power': 224,
     'expiration_date': '2026-01-29t16:16:33z',
     'fuel_type': 'petrol',
     'id': 'e34e20d3-f2f6-5297-a383-4436ffde4c94',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/uk74430',
     'listing': 'auction',
     'location': 'fr, saint-quentin',
     'make': 'ds automobiles',
     'make_model': 'ds automobiles ds9',
     'model': 'ds9',
     'odometer': 173561,
     'odometer_in_km': 173561,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-11-15',
     'sanitized_make': 'dsautomobiles',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ds automobiles ds9 1.6 puretech rivoli +',
     'transmission': 'automatic',
     'trim': 'rivoli +',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 224,
 'expiration_date': '2026-01-29T16:16:33Z',
 'fuel_type': 'petrol',
 'id': 'e34e20d3-f2f6-5297-a383-4436ffde4c94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK74430',
 'listing': 'auction',
 'location': 'FR, Saint-Quentin',
 'make': 'DS Automobiles',
 'model': 'DS9',
 'odometer': 173561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS Automobiles DS9 1.6 PureTech Rivoli +',
 'transmission': 'automatic',
 'trim': 'Rivoli +',
 'year': 2022}
2026-01-29 06:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UK74430%27 HTTP/1.1" 200 None
2026-01-29 06:10:32 [auto1.fr] INFO: Saving data for UK74430: {'auction_closing_time': 1769703393.0, 'created_time': 1769533558.862298, 'last_price_update_time': 1769667032.041596}
2026-01-29 06:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UK74430') HTTP/1.1" 204 0
2026-01-29 06:10:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 96feee74-4290-5c2e-9a61-9e8b20448a37 with identifier: XL37074
2026-01-29 06:10:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 96feee74-4290-5c2e-9a61-9e8b20448a37 with identifier: XL37074
2026-01-29 06:10:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 71003, 'odometer_reading_unit': 'km', 'registration_date': '2021-02-11', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xl37074', 'expiration_date': '2026-01-29t16:43:08z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ambarès-et-lagrave', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 125, 'id': '96feee74-4290-5c2e-9a61-9e8b20448a37', 'current_year_diff': 5, 'age_in_months': 59, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 71003}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 59,
     'auction_title': '',
     'c_o_2_emission_value': 125,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:43:08z',
     'fuel_type': 'petrol',
     'id': '96feee74-4290-5c2e-9a61-9e8b20448a37',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xl37074',
     'listing': 'auction',
     'location': 'fr, ambarès-et-lagrave',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 71003,
     'odometer_in_km': 71003,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-02-11',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2021}
2026-01-29 06:10:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 96feee74-4290-5c2e-9a61-9e8b20448a37 spider: auto1.fr
2026-01-29 06:10:32 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 96feee74-4290-5c2e-9a61-9e8b20448a37 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 71003, 'odometer_reading_unit': 'km', 'registration_date': '2021-02-11', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xl37074', 'expiration_date': '2026-01-29t16:43:08z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ambarès-et-lagrave', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 125, 'id': '96feee74-4290-5c2e-9a61-9e8b20448a37', 'current_year_diff': 5, 'age_in_months': 59, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 71003}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 59,
     'auction_title': '',
     'c_o_2_emission_value': 125,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:43:08z',
     'fuel_type': 'petrol',
     'id': '96feee74-4290-5c2e-9a61-9e8b20448a37',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xl37074',
     'listing': 'auction',
     'location': 'fr, ambarès-et-lagrave',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 71003,
     'odometer_in_km': 71003,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-02-11',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:43:08Z',
 'fuel_type': 'petrol',
 'id': '96feee74-4290-5c2e-9a61-9e8b20448a37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL37074',
 'listing': 'auction',
 'location': 'FR, Ambarès-et-Lagrave',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 71003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2021}
2026-01-29 06:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XL37074%27 HTTP/1.1" 200 None
2026-01-29 06:10:32 [auto1.fr] INFO: Saving data for XL37074: {'auction_closing_time': 1769704988.0, 'created_time': 1767805280.955991, 'last_price_update_time': 1769667032.256752}
2026-01-29 06:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XL37074') HTTP/1.1" 204 0
2026-01-29 06:10:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea5abd37-6d13-5033-a36a-8d78922c9338 with identifier: WL50922
2026-01-29 06:10:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea5abd37-6d13-5033-a36a-8d78922c9338 with scrape type 2
2026-01-29 06:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea5abd37-6d13-5033-a36a-8d78922c9338 with scrape type 2
2026-01-29 06:10:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ea5abd37-6d13-5033-a36a-8d78922c9338, identifier: WL50922
2026-01-29 06:10:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf0fc450-060a-5fe1-a5dc-b127f0be9b7a with identifier: AU80648
2026-01-29 06:10:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf0fc450-060a-5fe1-a5dc-b127f0be9b7a with scrape type 2
2026-01-29 06:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf0fc450-060a-5fe1-a5dc-b127f0be9b7a with scrape type 2
2026-01-29 06:10:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bf0fc450-060a-5fe1-a5dc-b127f0be9b7a, identifier: AU80648
2026-01-29 06:10:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f39bd434-6137-55e2-813c-f1a8574a87b4 with identifier: GY60794
2026-01-29 06:10:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f39bd434-6137-55e2-813c-f1a8574a87b4 with scrape type 2
2026-01-29 06:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f39bd434-6137-55e2-813c-f1a8574a87b4 with scrape type 2
2026-01-29 06:10:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f39bd434-6137-55e2-813c-f1a8574a87b4, identifier: GY60794
2026-01-29 06:10:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ea5abd37-6d13-5033-a36a-8d78922c9338 with identifier: WL50922
2026-01-29 06:10:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ea5abd37-6d13-5033-a36a-8d78922c9338 with identifier: WL50922
2026-01-29 06:10:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ea5abd37-6d13-5033-a36a-8d78922c9338 with identifier: WL50922 to the API
2026-01-29 06:10:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WL50922>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:59:59Z',
 'fuel_type': 'diesel',
 'id': 'ea5abd37-6d13-5033-a36a-8d78922c9338',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL50922',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 120954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-01-29 06:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WL50922%27 HTTP/1.1" 200 None
2026-01-29 06:10:32 [auto1.fr] INFO: Saving data for WL50922: {'auction_closing_time': 1769705999.0, 'created_time': 1769534102.566095, 'last_price_update_time': 1769667032.958222}
2026-01-29 06:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WL50922') HTTP/1.1" 204 0
2026-01-29 06:10:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bf0fc450-060a-5fe1-a5dc-b127f0be9b7a with identifier: AU80648
2026-01-29 06:10:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bf0fc450-060a-5fe1-a5dc-b127f0be9b7a with identifier: AU80648
2026-01-29 06:10:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 135552 is greater than the maximum of 100000

Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
    {'maximum': 100000, 'type': 'integer'}

On instance['odometer_in_km']:
    135552
2026-01-29 06:10:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: bf0fc450-060a-5fe1-a5dc-b127f0be9b7a spider: auto1.fr
2026-01-29 06:10:33 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: bf0fc450-060a-5fe1-a5dc-b127f0be9b7a due to rule: high_mileage_for_make.json, error: 135552 is greater than the maximum of 100000

Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
    {'maximum': 100000, 'type': 'integer'}

On instance['odometer_in_km']:
    135552
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 562,
 'expiration_date': '2026-01-29T16:13:31Z',
 'fuel_type': 'electro',
 'id': 'bf0fc450-060a-5fe1-a5dc-b127f0be9b7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU80648',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Tesla',
 'model': 'Model S',
 'odometer': 135552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Tesla Model S Long Range',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-01-29 06:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AU80648%27 HTTP/1.1" 200 None
2026-01-29 06:10:33 [auto1.fr] INFO: Saving data for AU80648: {'auction_closing_time': 1769703211.0, 'created_time': 1768891005.12081, 'last_price_update_time': 1769667033.185542}
2026-01-29 06:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AU80648') HTTP/1.1" 204 0
2026-01-29 06:10:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f39bd434-6137-55e2-813c-f1a8574a87b4 with identifier: GY60794
2026-01-29 06:10:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f39bd434-6137-55e2-813c-f1a8574a87b4 with identifier: GY60794
2026-01-29 06:10:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel grandland x 1.2 turbo elite', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'grandland x', 'transmission': 'manual', 'odometer': 79074, 'odometer_reading_unit': 'km', 'registration_date': '2020-10-13', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gy60794', 'expiration_date': '2026-01-29t16:10:04z', 'origin_country_code': 'fr', 'trim': 'elite', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, saint-saulve', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 147, 'id': 'f39bd434-6137-55e2-813c-f1a8574a87b4', 'current_year_diff': 6, 'age_in_months': 63, 'make_model': 'opel grandland x', 'sanitized_make': 'opel', 'odometer_in_km': 79074}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 63,
     'auction_title': '',
     'c_o_2_emission_value': 147,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:10:04z',
     'fuel_type': 'petrol',
     'id': 'f39bd434-6137-55e2-813c-f1a8574a87b4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gy60794',
     'listing': 'auction',
     'location': 'fr, saint-saulve',
     'make': 'opel',
     'make_model': 'opel grandland x',
     'model': 'grandland x',
     'odometer': 79074,
     'odometer_in_km': 79074,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-10-13',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel grandland x 1.2 turbo elite',
     'transmission': 'manual',
     'trim': 'elite',
     'year': 2020}
2026-01-29 06:10:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: f39bd434-6137-55e2-813c-f1a8574a87b4 spider: auto1.fr
2026-01-29 06:10:33 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: f39bd434-6137-55e2-813c-f1a8574a87b4 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel grandland x 1.2 turbo elite', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'grandland x', 'transmission': 'manual', 'odometer': 79074, 'odometer_reading_unit': 'km', 'registration_date': '2020-10-13', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gy60794', 'expiration_date': '2026-01-29t16:10:04z', 'origin_country_code': 'fr', 'trim': 'elite', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, saint-saulve', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 147, 'id': 'f39bd434-6137-55e2-813c-f1a8574a87b4', 'current_year_diff': 6, 'age_in_months': 63, 'make_model': 'opel grandland x', 'sanitized_make': 'opel', 'odometer_in_km': 79074}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 63,
     'auction_title': '',
     'c_o_2_emission_value': 147,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:10:04z',
     'fuel_type': 'petrol',
     'id': 'f39bd434-6137-55e2-813c-f1a8574a87b4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gy60794',
     'listing': 'auction',
     'location': 'fr, saint-saulve',
     'make': 'opel',
     'make_model': 'opel grandland x',
     'model': 'grandland x',
     'odometer': 79074,
     'odometer_in_km': 79074,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-10-13',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel grandland x 1.2 turbo elite',
     'transmission': 'manual',
     'trim': 'elite',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:10:04Z',
 'fuel_type': 'petrol',
 'id': 'f39bd434-6137-55e2-813c-f1a8574a87b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY60794',
 'listing': 'auction',
 'location': 'FR, Saint-Saulve',
 'make': 'Opel',
 'model': 'Grandland X',
 'odometer': 79074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Grandland X 1.2 Turbo Elite',
 'transmission': 'manual',
 'trim': 'Elite',
 'year': 2020}
2026-01-29 06:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GY60794%27 HTTP/1.1" 200 None
2026-01-29 06:10:33 [auto1.fr] INFO: Saving data for GY60794: {'auction_closing_time': 1769703004.0, 'created_time': 1767852182.899715, 'last_price_update_time': 1769667033.432958}
2026-01-29 06:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GY60794') HTTP/1.1" 204 0
2026-01-29 06:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PP86148/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZD99974> (referer: https://www.auto1.com/v1/car-details-view/ZD99974/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PT30703/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd2a6dcd-fb90-5882-ad77-4dd9bd18a0a7 with identifier: ZD99974
2026-01-29 06:10:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd2a6dcd-fb90-5882-ad77-4dd9bd18a0a7 with scrape type 2
2026-01-29 06:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd2a6dcd-fb90-5882-ad77-4dd9bd18a0a7 with scrape type 2
2026-01-29 06:10:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bd2a6dcd-fb90-5882-ad77-4dd9bd18a0a7, identifier: ZD99974
2026-01-29 06:10:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bd2a6dcd-fb90-5882-ad77-4dd9bd18a0a7 with identifier: ZD99974
2026-01-29 06:10:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bd2a6dcd-fb90-5882-ad77-4dd9bd18a0a7 with identifier: ZD99974
2026-01-29 06:10:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bd2a6dcd-fb90-5882-ad77-4dd9bd18a0a7 with identifier: ZD99974 to the API
2026-01-29 06:10:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZD99974>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 292,
 'expiration_date': '2026-01-29T16:38:11Z',
 'fuel_type': 'hybrid',
 'id': 'bd2a6dcd-fb90-5882-ad77-4dd9bd18a0a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD99974',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'BMW',
 'model': '3er',
 'odometer': 62755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 330e xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2023}
2026-01-29 06:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZD99974%27 HTTP/1.1" 200 None
2026-01-29 06:10:34 [auto1.fr] INFO: Saving data for ZD99974: {'auction_closing_time': 1769704691.0, 'created_time': 1764781587.942538, 'last_price_update_time': 1769667034.067062}
2026-01-29 06:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZD99974') HTTP/1.1" 204 0
2026-01-29 06:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GA07543/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YA12680> (referer: https://www.auto1.com/v1/car-details-view/YA12680/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 609e39a6-a4ee-55c8-9de4-2796be436d03 with identifier: YA12680
2026-01-29 06:10:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 609e39a6-a4ee-55c8-9de4-2796be436d03 with scrape type 2
2026-01-29 06:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 609e39a6-a4ee-55c8-9de4-2796be436d03 with scrape type 2
2026-01-29 06:10:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 609e39a6-a4ee-55c8-9de4-2796be436d03, identifier: YA12680
2026-01-29 06:10:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 609e39a6-a4ee-55c8-9de4-2796be436d03 with identifier: YA12680
2026-01-29 06:10:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 609e39a6-a4ee-55c8-9de4-2796be436d03 with identifier: YA12680
2026-01-29 06:10:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
2026-01-29 06:10:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 609e39a6-a4ee-55c8-9de4-2796be436d03 spider: auto1.fr
2026-01-29 06:10:35 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 609e39a6-a4ee-55c8-9de4-2796be436d03 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 69,
 'expiration_date': '2026-01-29T16:25:38Z',
 'fuel_type': 'petrol',
 'id': '609e39a6-a4ee-55c8-9de4-2796be436d03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA12680',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 25773,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-08-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Panda 1.0 Mild-Hybrid',
 'transmission': 'manual',
 'trim': '',
 'year': 2022}
2026-01-29 06:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YA12680%27 HTTP/1.1" 200 None
2026-01-29 06:10:35 [auto1.fr] INFO: Saving data for YA12680: {'auction_closing_time': 1769703938.0, 'created_time': 1768240385.022853, 'last_price_update_time': 1769667035.280624}
2026-01-29 06:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YA12680') HTTP/1.1" 204 0
2026-01-29 06:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MZ13992/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WJ35089/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HN21789/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TJ12770/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KS72696/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HN33120/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CA08683> (referer: https://www.auto1.com/v1/car-details-view/CA08683/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87fe807c-f51a-5007-9fed-4df39cdb1c43 with identifier: CA08683
2026-01-29 06:10:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87fe807c-f51a-5007-9fed-4df39cdb1c43 with scrape type 2
2026-01-29 06:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87fe807c-f51a-5007-9fed-4df39cdb1c43 with scrape type 2
2026-01-29 06:10:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 87fe807c-f51a-5007-9fed-4df39cdb1c43, identifier: CA08683
2026-01-29 06:10:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 87fe807c-f51a-5007-9fed-4df39cdb1c43 with identifier: CA08683
2026-01-29 06:10:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 87fe807c-f51a-5007-9fed-4df39cdb1c43 with identifier: CA08683
2026-01-29 06:10:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 87fe807c-f51a-5007-9fed-4df39cdb1c43 with identifier: CA08683 to the API
2026-01-29 06:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CA08683>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:40:07Z',
 'fuel_type': 'hybrid',
 'id': '87fe807c-f51a-5007-9fed-4df39cdb1c43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA08683',
 'listing': 'auction',
 'location': 'FR, MIRAMAS',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 66595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-01-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.6 Hybrid E-Tech Limited Edition',
 'transmission': 'automatic',
 'trim': 'Limited Edition',
 'year': 2022}
2026-01-29 06:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA08683%27 HTTP/1.1" 200 None
2026-01-29 06:10:37 [auto1.fr] INFO: Saving data for CA08683: {'auction_closing_time': 1769704807.0, 'created_time': 1769493744.863743, 'last_price_update_time': 1769667037.279389}
2026-01-29 06:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CA08683') HTTP/1.1" 204 0
2026-01-29 06:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JK60715/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PZ17441> (referer: https://www.auto1.com/v1/car-details-view/PZ17441/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa6ac6c5-db57-5863-a028-6d552685660c with identifier: PZ17441
2026-01-29 06:10:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa6ac6c5-db57-5863-a028-6d552685660c with scrape type 2
2026-01-29 06:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa6ac6c5-db57-5863-a028-6d552685660c with scrape type 2
2026-01-29 06:10:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: aa6ac6c5-db57-5863-a028-6d552685660c, identifier: PZ17441
2026-01-29 06:10:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: aa6ac6c5-db57-5863-a028-6d552685660c with identifier: PZ17441
2026-01-29 06:10:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: aa6ac6c5-db57-5863-a028-6d552685660c with identifier: PZ17441
2026-01-29 06:10:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 133144 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    133144
2026-01-29 06:10:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: aa6ac6c5-db57-5863-a028-6d552685660c spider: auto1.fr
2026-01-29 06:10:38 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: aa6ac6c5-db57-5863-a028-6d552685660c due to rule: high_mileage_for_make.json, error: 133144 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    133144
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:01:41Z',
 'fuel_type': 'diesel',
 'id': 'aa6ac6c5-db57-5863-a028-6d552685660c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ17441',
 'listing': 'auction',
 'location': 'FR, Ingrandes sur Vienne',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 133144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-30',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 1.5 Blue-HDi Allure Business',
 'transmission': 'automatic',
 'trim': 'Allure Business',
 'year': 2018}
2026-01-29 06:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PZ17441%27 HTTP/1.1" 200 None
2026-01-29 06:10:38 [auto1.fr] INFO: Saving data for PZ17441: {'auction_closing_time': 1769702501.0, 'created_time': 1769533528.565202, 'last_price_update_time': 1769667038.058538}
2026-01-29 06:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PZ17441') HTTP/1.1" 204 0
2026-01-29 06:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PT30703> (referer: https://www.auto1.com/v1/car-details-view/PT30703/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 654259c2-77d2-5d3e-9fe6-f1447eda3f48 with identifier: PT30703
2026-01-29 06:10:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 654259c2-77d2-5d3e-9fe6-f1447eda3f48 with scrape type 2
2026-01-29 06:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 654259c2-77d2-5d3e-9fe6-f1447eda3f48 with scrape type 2
2026-01-29 06:10:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 654259c2-77d2-5d3e-9fe6-f1447eda3f48, identifier: PT30703
2026-01-29 06:10:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 654259c2-77d2-5d3e-9fe6-f1447eda3f48 with identifier: PT30703
2026-01-29 06:10:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 654259c2-77d2-5d3e-9fe6-f1447eda3f48 with identifier: PT30703
2026-01-29 06:10:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 171274 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    171274
2026-01-29 06:10:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 654259c2-77d2-5d3e-9fe6-f1447eda3f48 spider: auto1.fr
2026-01-29 06:10:38 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 654259c2-77d2-5d3e-9fe6-f1447eda3f48 due to rule: high_mileage_for_country.json, error: 171274 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    171274
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:32:54Z',
 'fuel_type': 'diesel',
 'id': '654259c2-77d2-5d3e-9fe6-f1447eda3f48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT30703',
 'listing': 'auction',
 'location': 'FR, LE HAVRE',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 171274,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-13',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 1.5 Blue-HDi Active Business',
 'transmission': 'manual',
 'trim': 'Active Business',
 'year': 2019}
2026-01-29 06:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PT30703%27 HTTP/1.1" 200 None
2026-01-29 06:10:38 [auto1.fr] INFO: Saving data for PT30703: {'auction_closing_time': 1769704374.0, 'created_time': 1769448903.559646, 'last_price_update_time': 1769667038.682172}
2026-01-29 06:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PT30703') HTTP/1.1" 204 0
2026-01-29 06:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JA78615/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GA07543> (referer: https://www.auto1.com/v1/car-details-view/GA07543/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22afb614-9b9c-5619-a441-d49ae227e5cc with identifier: GA07543
2026-01-29 06:10:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22afb614-9b9c-5619-a441-d49ae227e5cc with scrape type 2
2026-01-29 06:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22afb614-9b9c-5619-a441-d49ae227e5cc with scrape type 2
2026-01-29 06:10:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 22afb614-9b9c-5619-a441-d49ae227e5cc, identifier: GA07543
2026-01-29 06:10:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 22afb614-9b9c-5619-a441-d49ae227e5cc with identifier: GA07543
2026-01-29 06:10:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 22afb614-9b9c-5619-a441-d49ae227e5cc with identifier: GA07543
2026-01-29 06:10:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 168486 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168486
2026-01-29 06:10:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 22afb614-9b9c-5619-a441-d49ae227e5cc spider: auto1.fr
2026-01-29 06:10:41 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 22afb614-9b9c-5619-a441-d49ae227e5cc due to rule: high_mileage_for_country.json, error: 168486 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168486
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-01-29T16:39:15Z',
 'fuel_type': 'diesel',
 'id': '22afb614-9b9c-5619-a441-d49ae227e5cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA07543',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 168486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 1.6 Blue-HDi Millenium Business',
 'transmission': 'manual',
 'trim': 'Millenium Business',
 'year': 2017}
2026-01-29 06:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GA07543%27 HTTP/1.1" 200 None
2026-01-29 06:10:41 [auto1.fr] INFO: Saving data for GA07543: {'auction_closing_time': 1769704755.0, 'created_time': 1769015041.858762, 'last_price_update_time': 1769667041.97046}
2026-01-29 06:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GA07543') HTTP/1.1" 204 0
2026-01-29 06:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MZ13992> (referer: https://www.auto1.com/v1/car-details-view/MZ13992/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9c70257-6f58-581e-8001-51109d6a7193 with identifier: MZ13992
2026-01-29 06:10:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9c70257-6f58-581e-8001-51109d6a7193 with scrape type 2
2026-01-29 06:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9c70257-6f58-581e-8001-51109d6a7193 with scrape type 2
2026-01-29 06:10:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d9c70257-6f58-581e-8001-51109d6a7193, identifier: MZ13992
2026-01-29 06:10:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d9c70257-6f58-581e-8001-51109d6a7193 with identifier: MZ13992
2026-01-29 06:10:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d9c70257-6f58-581e-8001-51109d6a7193 with identifier: MZ13992
2026-01-29 06:10:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d9c70257-6f58-581e-8001-51109d6a7193 with identifier: MZ13992 to the API
2026-01-29 06:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MZ13992>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 100,
 'expiration_date': '2026-01-29T16:12:58Z',
 'fuel_type': 'petrol',
 'id': 'd9c70257-6f58-581e-8001-51109d6a7193',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ13992',
 'listing': 'auction',
 'location': 'FR, LA CHAPELLE LONGUEVILLE',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 61143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost B&O Play First Edition',
 'transmission': 'manual',
 'trim': 'B&O Play First Edition',
 'year': 2017}
2026-01-29 06:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MZ13992%27 HTTP/1.1" 200 None
2026-01-29 06:10:43 [auto1.fr] INFO: Saving data for MZ13992: {'auction_closing_time': 1769703178.0, 'created_time': 1769446869.949637, 'last_price_update_time': 1769667043.043629}
2026-01-29 06:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MZ13992') HTTP/1.1" 204 0
2026-01-29 06:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AF79701/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XF92122/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NT29231/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HN21789> (referer: https://www.auto1.com/v1/car-details-view/HN21789/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6995f1d1-a52f-51d8-a003-0f2af3305753 with identifier: HN21789
2026-01-29 06:10:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6995f1d1-a52f-51d8-a003-0f2af3305753 with scrape type 2
2026-01-29 06:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6995f1d1-a52f-51d8-a003-0f2af3305753 with scrape type 2
2026-01-29 06:10:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6995f1d1-a52f-51d8-a003-0f2af3305753, identifier: HN21789
2026-01-29 06:10:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6995f1d1-a52f-51d8-a003-0f2af3305753 with identifier: HN21789
2026-01-29 06:10:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6995f1d1-a52f-51d8-a003-0f2af3305753 with identifier: HN21789
2026-01-29 06:10:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6995f1d1-a52f-51d8-a003-0f2af3305753 with identifier: HN21789 to the API
2026-01-29 06:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HN21789>
{'auction_title': '',
 'c_o_2_emission_value': 34,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 158,
 'expiration_date': '2026-01-29T16:05:51Z',
 'fuel_type': 'hybrid',
 'id': '6995f1d1-a52f-51d8-a003-0f2af3305753',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN21789',
 'listing': 'auction',
 'location': 'FR, Marly-la-ville',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 50686,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.6 E-Tech Hybrid Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2020}
2026-01-29 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HN21789%27 HTTP/1.1" 200 None
2026-01-29 06:10:46 [auto1.fr] INFO: Saving data for HN21789: {'auction_closing_time': 1769702751.0, 'created_time': 1769148040.96354, 'last_price_update_time': 1769667046.152231}
2026-01-29 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HN21789') HTTP/1.1" 204 0
2026-01-29 06:10:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HN33120> (referer: https://www.auto1.com/v1/car-details-view/HN33120/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PP86148> (referer: https://www.auto1.com/v1/car-details-view/PP86148/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a7a9ba7-20db-5de6-8101-3f5ea6bd9551 with identifier: HN33120
2026-01-29 06:10:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a7a9ba7-20db-5de6-8101-3f5ea6bd9551 with scrape type 2
2026-01-29 06:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a7a9ba7-20db-5de6-8101-3f5ea6bd9551 with scrape type 2
2026-01-29 06:10:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2a7a9ba7-20db-5de6-8101-3f5ea6bd9551, identifier: HN33120
2026-01-29 06:10:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85262bed-10e6-5d3c-8523-492b73c7a78e with identifier: PP86148
2026-01-29 06:10:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85262bed-10e6-5d3c-8523-492b73c7a78e with scrape type 2
2026-01-29 06:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85262bed-10e6-5d3c-8523-492b73c7a78e with scrape type 2
2026-01-29 06:10:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 85262bed-10e6-5d3c-8523-492b73c7a78e, identifier: PP86148
2026-01-29 06:10:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2a7a9ba7-20db-5de6-8101-3f5ea6bd9551 with identifier: HN33120
2026-01-29 06:10:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2a7a9ba7-20db-5de6-8101-3f5ea6bd9551 with identifier: HN33120
2026-01-29 06:10:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 e-thp feline', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 120152, 'odometer_reading_unit': 'km', 'registration_date': '2017-03-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hn33120', 'expiration_date': '2026-01-29t16:53:52z', 'origin_country_code': 'fr', 'trim': 'feline', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, nanteuil-le-haudouin', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 112, 'id': '2a7a9ba7-20db-5de6-8101-3f5ea6bd9551', 'current_year_diff': 9, 'age_in_months': 106, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 120152}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 106,
     'auction_title': '',
     'c_o_2_emission_value': 112,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:53:52z',
     'fuel_type': 'petrol',
     'id': '2a7a9ba7-20db-5de6-8101-3f5ea6bd9551',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hn33120',
     'listing': 'auction',
     'location': 'fr, nanteuil-le-haudouin',
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 120152,
     'odometer_in_km': 120152,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-03-26',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 1.2 e-thp feline',
     'transmission': 'automatic',
     'trim': 'feline',
     'year': 2017}
2026-01-29 06:10:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 2a7a9ba7-20db-5de6-8101-3f5ea6bd9551 spider: auto1.fr
2026-01-29 06:10:46 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 2a7a9ba7-20db-5de6-8101-3f5ea6bd9551 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 e-thp feline', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 120152, 'odometer_reading_unit': 'km', 'registration_date': '2017-03-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hn33120', 'expiration_date': '2026-01-29t16:53:52z', 'origin_country_code': 'fr', 'trim': 'feline', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, nanteuil-le-haudouin', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 112, 'id': '2a7a9ba7-20db-5de6-8101-3f5ea6bd9551', 'current_year_diff': 9, 'age_in_months': 106, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 120152}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 106,
     'auction_title': '',
     'c_o_2_emission_value': 112,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:53:52z',
     'fuel_type': 'petrol',
     'id': '2a7a9ba7-20db-5de6-8101-3f5ea6bd9551',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hn33120',
     'listing': 'auction',
     'location': 'fr, nanteuil-le-haudouin',
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 120152,
     'odometer_in_km': 120152,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-03-26',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 1.2 e-thp feline',
     'transmission': 'automatic',
     'trim': 'feline',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:53:52Z',
 'fuel_type': 'petrol',
 'id': '2a7a9ba7-20db-5de6-8101-3f5ea6bd9551',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN33120',
 'listing': 'auction',
 'location': 'FR, Nanteuil-le-Haudouin',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 120152,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Feline',
 'transmission': 'automatic',
 'trim': 'Feline',
 'year': 2017}
2026-01-29 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HN33120%27 HTTP/1.1" 200 None
2026-01-29 06:10:46 [auto1.fr] INFO: Saving data for HN33120: {'auction_closing_time': 1769705632.0, 'created_time': 1769580131.227318, 'last_price_update_time': 1769667046.653796}
2026-01-29 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HN33120') HTTP/1.1" 204 0
2026-01-29 06:10:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 85262bed-10e6-5d3c-8523-492b73c7a78e with identifier: PP86148
2026-01-29 06:10:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 85262bed-10e6-5d3c-8523-492b73c7a78e with identifier: PP86148
2026-01-29 06:10:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 85262bed-10e6-5d3c-8523-492b73c7a78e with identifier: PP86148 to the API
2026-01-29 06:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PP86148>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:05:37Z',
 'fuel_type': 'diesel',
 'id': '85262bed-10e6-5d3c-8523-492b73c7a78e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP86148',
 'listing': 'auction',
 'location': 'FR, LE HAVRE',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 117169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 HSE AWD',
 'transmission': 'manual',
 'trim': 'HSE AWD',
 'year': 2017}
2026-01-29 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PP86148%27 HTTP/1.1" 200 None
2026-01-29 06:10:46 [auto1.fr] INFO: Saving data for PP86148: {'auction_closing_time': 1769702737.0, 'created_time': 1765300370.787124, 'last_price_update_time': 1769667046.978352}
2026-01-29 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PP86148') HTTP/1.1" 204 0
2026-01-29 06:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JK60715> (referer: https://www.auto1.com/v1/car-details-view/JK60715/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d5f4420-bfd8-5698-9b99-9aaed28ddf26 with identifier: JK60715
2026-01-29 06:10:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d5f4420-bfd8-5698-9b99-9aaed28ddf26 with scrape type 2
2026-01-29 06:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d5f4420-bfd8-5698-9b99-9aaed28ddf26 with scrape type 2
2026-01-29 06:10:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8d5f4420-bfd8-5698-9b99-9aaed28ddf26, identifier: JK60715
2026-01-29 06:10:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8d5f4420-bfd8-5698-9b99-9aaed28ddf26 with identifier: JK60715
2026-01-29 06:10:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8d5f4420-bfd8-5698-9b99-9aaed28ddf26 with identifier: JK60715
2026-01-29 06:10:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8d5f4420-bfd8-5698-9b99-9aaed28ddf26 with identifier: JK60715 to the API
2026-01-29 06:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JK60715>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:51:24Z',
 'fuel_type': 'petrol',
 'id': '8d5f4420-bfd8-5698-9b99-9aaed28ddf26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK60715',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 22614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2022}
2026-01-29 06:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JK60715%27 HTTP/1.1" 200 None
2026-01-29 06:10:48 [auto1.fr] INFO: Saving data for JK60715: {'auction_closing_time': 1769705484.0, 'created_time': 1769534381.470204, 'last_price_update_time': 1769667048.23258}
2026-01-29 06:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JK60715') HTTP/1.1" 204 0
2026-01-29 06:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JA78615> (referer: https://www.auto1.com/v1/car-details-view/JA78615/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38605a8b-c2d7-59c7-b047-2fee3a80242c with identifier: JA78615
2026-01-29 06:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38605a8b-c2d7-59c7-b047-2fee3a80242c with scrape type 2
2026-01-29 06:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38605a8b-c2d7-59c7-b047-2fee3a80242c with scrape type 2
2026-01-29 06:10:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 38605a8b-c2d7-59c7-b047-2fee3a80242c, identifier: JA78615
2026-01-29 06:10:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 38605a8b-c2d7-59c7-b047-2fee3a80242c with identifier: JA78615
2026-01-29 06:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 38605a8b-c2d7-59c7-b047-2fee3a80242c with identifier: JA78615
2026-01-29 06:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 145421 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    145421
2026-01-29 06:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 38605a8b-c2d7-59c7-b047-2fee3a80242c spider: auto1.fr
2026-01-29 06:10:49 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 38605a8b-c2d7-59c7-b047-2fee3a80242c due to rule: high_mileage_for_make.json, error: 145421 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    145421
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:44:32Z',
 'fuel_type': 'diesel',
 'id': '38605a8b-c2d7-59c7-b047-2fee3a80242c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA78615',
 'listing': 'auction',
 'location': 'FR, Vezin-le-Coquet',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 145421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Active Business',
 'transmission': 'manual',
 'trim': 'Active Business',
 'year': 2018}
2026-01-29 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA78615%27 HTTP/1.1" 200 None
2026-01-29 06:10:49 [auto1.fr] INFO: Saving data for JA78615: {'auction_closing_time': 1769705072.0, 'created_time': 1767719238.021108, 'last_price_update_time': 1769667049.417716}
2026-01-29 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JA78615') HTTP/1.1" 204 0
2026-01-29 06:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TJ12770> (referer: https://www.auto1.com/v1/car-details-view/TJ12770/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bf9cc65-7fcf-50cf-89ac-7dd2dd7c3034 with identifier: TJ12770
2026-01-29 06:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bf9cc65-7fcf-50cf-89ac-7dd2dd7c3034 with scrape type 2
2026-01-29 06:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bf9cc65-7fcf-50cf-89ac-7dd2dd7c3034 with scrape type 2
2026-01-29 06:10:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2bf9cc65-7fcf-50cf-89ac-7dd2dd7c3034, identifier: TJ12770
2026-01-29 06:10:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2bf9cc65-7fcf-50cf-89ac-7dd2dd7c3034 with identifier: TJ12770
2026-01-29 06:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2bf9cc65-7fcf-50cf-89ac-7dd2dd7c3034 with identifier: TJ12770
2026-01-29 06:10:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2bf9cc65-7fcf-50cf-89ac-7dd2dd7c3034 with identifier: TJ12770 to the API
2026-01-29 06:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TJ12770>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:03:42Z',
 'fuel_type': 'diesel',
 'id': '2bf9cc65-7fcf-50cf-89ac-7dd2dd7c3034',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ12770',
 'listing': 'auction',
 'location': 'Toulouse',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 84950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-01-29 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TJ12770%27 HTTP/1.1" 200 None
2026-01-29 06:10:49 [auto1.fr] INFO: Saving data for TJ12770: {'auction_closing_time': 1769702622.0, 'created_time': 1769447279.453787, 'last_price_update_time': 1769667049.934685}
2026-01-29 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TJ12770') HTTP/1.1" 204 0
2026-01-29 06:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LL77834/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WJ35089> (referer: https://www.auto1.com/v1/car-details-view/WJ35089/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc7aa31a-6a1d-5d83-879f-08ad24a6ee0e with identifier: WJ35089
2026-01-29 06:10:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc7aa31a-6a1d-5d83-879f-08ad24a6ee0e with scrape type 2
2026-01-29 06:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc7aa31a-6a1d-5d83-879f-08ad24a6ee0e with scrape type 2
2026-01-29 06:10:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: dc7aa31a-6a1d-5d83-879f-08ad24a6ee0e, identifier: WJ35089
2026-01-29 06:10:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dc7aa31a-6a1d-5d83-879f-08ad24a6ee0e with identifier: WJ35089
2026-01-29 06:10:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dc7aa31a-6a1d-5d83-879f-08ad24a6ee0e with identifier: WJ35089
2026-01-29 06:10:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: dc7aa31a-6a1d-5d83-879f-08ad24a6ee0e with identifier: WJ35089 to the API
2026-01-29 06:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WJ35089>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-01-29T16:27:43Z',
 'fuel_type': 'diesel',
 'id': 'dc7aa31a-6a1d-5d83-879f-08ad24a6ee0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ35089',
 'listing': 'auction',
 'location': 'FR, Marly-la-ville',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 85156,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-01-29 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WJ35089%27 HTTP/1.1" 200 None
2026-01-29 06:10:52 [auto1.fr] INFO: Saving data for WJ35089: {'auction_closing_time': 1769704063.0, 'created_time': 1768669955.069252, 'last_price_update_time': 1769667052.249476}
2026-01-29 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WJ35089') HTTP/1.1" 204 0
2026-01-29 06:10:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AF79701> (referer: https://www.auto1.com/v1/car-details-view/AF79701/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc95cb07-6ee3-5923-806d-f211a03ee189 with identifier: AF79701
2026-01-29 06:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc95cb07-6ee3-5923-806d-f211a03ee189 with scrape type 2
2026-01-29 06:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc95cb07-6ee3-5923-806d-f211a03ee189 with scrape type 2
2026-01-29 06:10:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bc95cb07-6ee3-5923-806d-f211a03ee189, identifier: AF79701
2026-01-29 06:10:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bc95cb07-6ee3-5923-806d-f211a03ee189 with identifier: AF79701
2026-01-29 06:10:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bc95cb07-6ee3-5923-806d-f211a03ee189 with identifier: AF79701
2026-01-29 06:10:52 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'renault austral 1.2 hybrid e-tech techno', 'price': 0, 'currency': 'eur', 'make': 'renault', 'model': 'austral', 'transmission': 'automatic', 'odometer': 96449, 'odometer_reading_unit': 'km', 'registration_date': '2025-02-06', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/af79701', 'expiration_date': '2026-01-29t16:25:30z', 'origin_country_code': 'fr', 'trim': 'techno', 'year': 2025, 'fuel_type': 'hybrid', 'listing': 'auction', 'engine_horse_power': 200, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, ambarès-et-lagrave', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 104, 'id': 'bc95cb07-6ee3-5923-806d-f211a03ee189', 'current_year_diff': 1, 'age_in_months': 11, 'make_model': 'renault austral', 'sanitized_make': 'renault', 'odometer_in_km': 96449}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 11,
     'auction_title': '',
     'c_o_2_emission_value': 104,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 1,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 200,
     'expiration_date': '2026-01-29t16:25:30z',
     'fuel_type': 'hybrid',
     'id': 'bc95cb07-6ee3-5923-806d-f211a03ee189',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/af79701',
     'listing': 'auction',
     'location': 'fr, ambarès-et-lagrave',
     'make': 'renault',
     'make_model': 'renault austral',
     'model': 'austral',
     'odometer': 96449,
     'odometer_in_km': 96449,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2025-02-06',
     'sanitized_make': 'renault',
     'seats_number': 5,
     'seller_name': None,
     'title': 'renault austral 1.2 hybrid e-tech techno',
     'transmission': 'automatic',
     'trim': 'techno',
     'year': 2025}
2026-01-29 06:10:52 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: bc95cb07-6ee3-5923-806d-f211a03ee189 spider: auto1.fr
2026-01-29 06:10:52 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: bc95cb07-6ee3-5923-806d-f211a03ee189 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'renault austral 1.2 hybrid e-tech techno', 'price': 0, 'currency': 'eur', 'make': 'renault', 'model': 'austral', 'transmission': 'automatic', 'odometer': 96449, 'odometer_reading_unit': 'km', 'registration_date': '2025-02-06', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/af79701', 'expiration_date': '2026-01-29t16:25:30z', 'origin_country_code': 'fr', 'trim': 'techno', 'year': 2025, 'fuel_type': 'hybrid', 'listing': 'auction', 'engine_horse_power': 200, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, ambarès-et-lagrave', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 104, 'id': 'bc95cb07-6ee3-5923-806d-f211a03ee189', 'current_year_diff': 1, 'age_in_months': 11, 'make_model': 'renault austral', 'sanitized_make': 'renault', 'odometer_in_km': 96449}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 11,
     'auction_title': '',
     'c_o_2_emission_value': 104,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 1,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 200,
     'expiration_date': '2026-01-29t16:25:30z',
     'fuel_type': 'hybrid',
     'id': 'bc95cb07-6ee3-5923-806d-f211a03ee189',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/af79701',
     'listing': 'auction',
     'location': 'fr, ambarès-et-lagrave',
     'make': 'renault',
     'make_model': 'renault austral',
     'model': 'austral',
     'odometer': 96449,
     'odometer_in_km': 96449,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2025-02-06',
     'sanitized_make': 'renault',
     'seats_number': 5,
     'seller_name': None,
     'title': 'renault austral 1.2 hybrid e-tech techno',
     'transmission': 'automatic',
     'trim': 'techno',
     'year': 2025}
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 200,
 'expiration_date': '2026-01-29T16:25:30Z',
 'fuel_type': 'hybrid',
 'id': 'bc95cb07-6ee3-5923-806d-f211a03ee189',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF79701',
 'listing': 'auction',
 'location': 'FR, Ambarès-et-Lagrave',
 'make': 'Renault',
 'model': 'Austral',
 'odometer': 96449,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-02-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Austral 1.2 Hybrid E-Tech Techno',
 'transmission': 'automatic',
 'trim': 'Techno',
 'year': 2025}
2026-01-29 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AF79701%27 HTTP/1.1" 200 None
2026-01-29 06:10:52 [auto1.fr] INFO: Saving data for AF79701: {'auction_closing_time': 1769703930.0, 'created_time': 1769450154.864256, 'last_price_update_time': 1769667052.961854}
2026-01-29 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AF79701') HTTP/1.1" 204 0
2026-01-29 06:10:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VZ57179/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TG76927/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HE95316/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NT29231> (referer: https://www.auto1.com/v1/car-details-view/NT29231/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fb1979c-1e82-520f-a4a4-0672178d20cd with identifier: NT29231
2026-01-29 06:10:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fb1979c-1e82-520f-a4a4-0672178d20cd with scrape type 2
2026-01-29 06:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fb1979c-1e82-520f-a4a4-0672178d20cd with scrape type 2
2026-01-29 06:10:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6fb1979c-1e82-520f-a4a4-0672178d20cd, identifier: NT29231
2026-01-29 06:10:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6fb1979c-1e82-520f-a4a4-0672178d20cd with identifier: NT29231
2026-01-29 06:10:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6fb1979c-1e82-520f-a4a4-0672178d20cd with identifier: NT29231
2026-01-29 06:10:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'manual', 'odometer': 110395, 'odometer_reading_unit': 'km', 'registration_date': '2020-08-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nt29231', 'expiration_date': '2026-01-29t16:58:10z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, le havre', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 113, 'id': '6fb1979c-1e82-520f-a4a4-0672178d20cd', 'current_year_diff': 6, 'age_in_months': 64, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 110395}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 64,
     'auction_title': '',
     'c_o_2_emission_value': 113,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:58:10z',
     'fuel_type': 'petrol',
     'id': '6fb1979c-1e82-520f-a4a4-0672178d20cd',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nt29231',
     'listing': 'auction',
     'location': 'fr, le havre',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 110395,
     'odometer_in_km': 110395,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-08-30',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2020}
2026-01-29 06:10:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 6fb1979c-1e82-520f-a4a4-0672178d20cd spider: auto1.fr
2026-01-29 06:10:54 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 6fb1979c-1e82-520f-a4a4-0672178d20cd due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'manual', 'odometer': 110395, 'odometer_reading_unit': 'km', 'registration_date': '2020-08-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nt29231', 'expiration_date': '2026-01-29t16:58:10z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, le havre', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 113, 'id': '6fb1979c-1e82-520f-a4a4-0672178d20cd', 'current_year_diff': 6, 'age_in_months': 64, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 110395}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 64,
     'auction_title': '',
     'c_o_2_emission_value': 113,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:58:10z',
     'fuel_type': 'petrol',
     'id': '6fb1979c-1e82-520f-a4a4-0672178d20cd',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nt29231',
     'listing': 'auction',
     'location': 'fr, le havre',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 110395,
     'odometer_in_km': 110395,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-08-30',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:58:10Z',
 'fuel_type': 'petrol',
 'id': '6fb1979c-1e82-520f-a4a4-0672178d20cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT29231',
 'listing': 'auction',
 'location': 'FR, LE HAVRE',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 110395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-01-29 06:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NT29231%27 HTTP/1.1" 200 None
2026-01-29 06:10:54 [auto1.fr] INFO: Saving data for NT29231: {'auction_closing_time': 1769705890.0, 'created_time': 1769446976.64675, 'last_price_update_time': 1769667054.293069}
2026-01-29 06:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NT29231') HTTP/1.1" 204 0
2026-01-29 06:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TK32898/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JN37643/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HK44264> (referer: https://www.auto1.com/v1/car-details-view/HK44264/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:55 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:10:55 [auto1.fr] INFO: Found listing with ID: PZ21399
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PZ21399%27 HTTP/1.1" 200 None
2026-01-29 06:10:55 [auto1.fr] INFO: Scrape type for PZ21399: 0
2026-01-29 06:10:55 [auto1.fr] INFO: Found listing with ID: LN78471
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LN78471%27 HTTP/1.1" 200 None
2026-01-29 06:10:55 [auto1.fr] INFO: Scrape type for LN78471: 0
2026-01-29 06:10:55 [auto1.fr] INFO: Found listing with ID: HW60629
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HW60629%27 HTTP/1.1" 200 None
2026-01-29 06:10:55 [auto1.fr] INFO: Scrape type for HW60629: 0
2026-01-29 06:10:55 [auto1.fr] INFO: Found listing with ID: ML39767
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ML39767%27 HTTP/1.1" 200 None
2026-01-29 06:10:55 [auto1.fr] INFO: Scrape type for ML39767: 2
2026-01-29 06:10:55 [auto1.fr] INFO: Found listing with ID: WU34831
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU34831%27 HTTP/1.1" 200 None
2026-01-29 06:10:55 [auto1.fr] INFO: Scrape type for WU34831: 0
2026-01-29 06:10:55 [auto1.fr] INFO: Found listing with ID: ZS29376
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZS29376%27 HTTP/1.1" 200 None
2026-01-29 06:10:55 [auto1.fr] INFO: Scrape type for ZS29376: 2
2026-01-29 06:10:55 [auto1.fr] INFO: Found listing with ID: ZN48211
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN48211%27 HTTP/1.1" 200 None
2026-01-29 06:10:55 [auto1.fr] INFO: Scrape type for ZN48211: 0
2026-01-29 06:10:55 [auto1.fr] INFO: Found listing with ID: CX55419
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CX55419%27 HTTP/1.1" 200 None
2026-01-29 06:10:55 [auto1.fr] INFO: Scrape type for CX55419: 0
2026-01-29 06:10:55 [auto1.fr] INFO: Found listing with ID: ZK55251
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZK55251%27 HTTP/1.1" 200 None
2026-01-29 06:10:55 [auto1.fr] INFO: Scrape type for ZK55251: 0
2026-01-29 06:10:55 [auto1.fr] INFO: Found listing with ID: WT57817
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WT57817%27 HTTP/1.1" 200 None
2026-01-29 06:10:55 [auto1.fr] INFO: Scrape type for WT57817: 2
2026-01-29 06:10:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22e0eb51-4d0b-53be-bab5-3763d301a647 with identifier: HK44264
2026-01-29 06:10:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22e0eb51-4d0b-53be-bab5-3763d301a647 with scrape type 2
2026-01-29 06:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22e0eb51-4d0b-53be-bab5-3763d301a647 with scrape type 2
2026-01-29 06:10:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 22e0eb51-4d0b-53be-bab5-3763d301a647, identifier: HK44264
2026-01-29 06:10:55 [auto1.fr] INFO: Found listing with ID: PC89884
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PC89884%27 HTTP/1.1" 200 None
2026-01-29 06:10:55 [auto1.fr] INFO: Scrape type for PC89884: 2
2026-01-29 06:10:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 22e0eb51-4d0b-53be-bab5-3763d301a647 with identifier: HK44264
2026-01-29 06:10:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 22e0eb51-4d0b-53be-bab5-3763d301a647 with identifier: HK44264
2026-01-29 06:10:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 22e0eb51-4d0b-53be-bab5-3763d301a647 with identifier: HK44264 to the API
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HK44264>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:54:20Z',
 'fuel_type': 'petrol',
 'id': '22e0eb51-4d0b-53be-bab5-3763d301a647',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK44264',
 'listing': 'auction',
 'location': 'FR, Quincieux',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 97021,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Tipo 1.4 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2017}
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK44264%27 HTTP/1.1" 200 None
2026-01-29 06:10:55 [auto1.fr] INFO: Saving data for HK44264: {'auction_closing_time': 1769705660.0, 'created_time': 1769533404.710073, 'last_price_update_time': 1769667055.727423}
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HK44264') HTTP/1.1" 204 0
2026-01-29 06:10:55 [auto1.fr] INFO: Found listing with ID: XX48208
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XX48208%27 HTTP/1.1" 200 None
2026-01-29 06:10:55 [auto1.fr] INFO: Scrape type for XX48208: 0
2026-01-29 06:10:55 [auto1.fr] INFO: Found listing with ID: EY10770
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EY10770%27 HTTP/1.1" 200 None
2026-01-29 06:10:55 [auto1.fr] INFO: Scrape type for EY10770: 0
2026-01-29 06:10:55 [auto1.fr] INFO: Found listing with ID: KF69639
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KF69639%27 HTTP/1.1" 200 None
2026-01-29 06:10:55 [auto1.fr] INFO: Scrape type for KF69639: 0
2026-01-29 06:10:55 [auto1.fr] INFO: Found listing with ID: HA28273
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HA28273%27 HTTP/1.1" 200 None
2026-01-29 06:10:55 [auto1.fr] INFO: Scrape type for HA28273: 0
2026-01-29 06:10:55 [auto1.fr] INFO: Found listing with ID: GY91054
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GY91054%27 HTTP/1.1" 200 None
2026-01-29 06:10:55 [auto1.fr] INFO: Scrape type for GY91054: 0
2026-01-29 06:10:55 [auto1.fr] INFO: Found listing with ID: NU07260
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NU07260%27 HTTP/1.1" 200 None
2026-01-29 06:10:55 [auto1.fr] INFO: Scrape type for NU07260: 2
2026-01-29 06:10:55 [auto1.fr] INFO: Found listing with ID: NE79896
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NE79896%27 HTTP/1.1" 200 None
2026-01-29 06:10:55 [auto1.fr] INFO: Scrape type for NE79896: 2
2026-01-29 06:10:55 [auto1.fr] INFO: Found listing with ID: RR17667
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RR17667%27 HTTP/1.1" 200 None
2026-01-29 06:10:56 [auto1.fr] INFO: Scrape type for RR17667: 0
2026-01-29 06:10:56 [auto1.fr] INFO: Found listing with ID: JT15325
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JT15325%27 HTTP/1.1" 200 None
2026-01-29 06:10:56 [auto1.fr] INFO: Scrape type for JT15325: 0
2026-01-29 06:10:56 [auto1.fr] INFO: Found listing with ID: YK46642
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YK46642%27 HTTP/1.1" 200 None
2026-01-29 06:10:56 [auto1.fr] INFO: Scrape type for YK46642: 0
2026-01-29 06:10:56 [auto1.fr] INFO: Found listing with ID: SK82566
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SK82566%27 HTTP/1.1" 200 None
2026-01-29 06:10:56 [auto1.fr] INFO: Scrape type for SK82566: 2
2026-01-29 06:10:56 [auto1.fr] INFO: Found listing with ID: XS51607
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XS51607%27 HTTP/1.1" 200 None
2026-01-29 06:10:56 [auto1.fr] INFO: Scrape type for XS51607: 0
2026-01-29 06:10:56 [auto1.fr] INFO: Found listing with ID: UK24937
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UK24937%27 HTTP/1.1" 200 None
2026-01-29 06:10:56 [auto1.fr] INFO: Scrape type for UK24937: 0
2026-01-29 06:10:56 [auto1.fr] INFO: Found listing with ID: UK14543
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UK14543%27 HTTP/1.1" 200 None
2026-01-29 06:10:56 [auto1.fr] INFO: Scrape type for UK14543: 2
2026-01-29 06:10:56 [auto1.fr] INFO: Found listing with ID: RS76730
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RS76730%27 HTTP/1.1" 200 None
2026-01-29 06:10:56 [auto1.fr] INFO: Scrape type for RS76730: 0
2026-01-29 06:10:56 [auto1.fr] INFO: Found listing with ID: HJ27250
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HJ27250%27 HTTP/1.1" 200 None
2026-01-29 06:10:56 [auto1.fr] INFO: Scrape type for HJ27250: 2
2026-01-29 06:10:56 [auto1.fr] INFO: Found listing with ID: RL05063
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RL05063%27 HTTP/1.1" 200 None
2026-01-29 06:10:56 [auto1.fr] INFO: Scrape type for RL05063: 0
2026-01-29 06:10:56 [auto1.fr] INFO: Found listing with ID: NJ96135
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NJ96135%27 HTTP/1.1" 200 None
2026-01-29 06:10:56 [auto1.fr] INFO: Scrape type for NJ96135: 0
2026-01-29 06:10:56 [auto1.fr] INFO: Found listing with ID: LW30624
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LW30624%27 HTTP/1.1" 200 None
2026-01-29 06:10:56 [auto1.fr] INFO: Scrape type for LW30624: 0
2026-01-29 06:10:56 [auto1.fr] INFO: Found listing with ID: JM95863
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JM95863%27 HTTP/1.1" 200 None
2026-01-29 06:10:56 [auto1.fr] INFO: Scrape type for JM95863: 0
2026-01-29 06:10:56 [auto1.fr] INFO: Found listing with ID: MD20438
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MD20438%27 HTTP/1.1" 200 None
2026-01-29 06:10:56 [auto1.fr] INFO: Scrape type for MD20438: 2
2026-01-29 06:10:56 [auto1.fr] INFO: Found listing with ID: BY75423
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BY75423%27 HTTP/1.1" 200 None
2026-01-29 06:10:56 [auto1.fr] INFO: Scrape type for BY75423: 0
2026-01-29 06:10:56 [auto1.fr] INFO: Found listing with ID: GX70820
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GX70820%27 HTTP/1.1" 200 None
2026-01-29 06:10:56 [auto1.fr] INFO: Scrape type for GX70820: 2
2026-01-29 06:10:56 [auto1.fr] INFO: Found listing with ID: JL01283
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JL01283%27 HTTP/1.1" 200 None
2026-01-29 06:10:56 [auto1.fr] INFO: Scrape type for JL01283: 0
2026-01-29 06:10:56 [auto1.fr] INFO: Found listing with ID: AN91682
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AN91682%27 HTTP/1.1" 200 None
2026-01-29 06:10:56 [auto1.fr] INFO: Scrape type for AN91682: 2
2026-01-29 06:10:56 [auto1.fr] INFO: Found listing with ID: LX30818
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LX30818%27 HTTP/1.1" 200 None
2026-01-29 06:10:56 [auto1.fr] INFO: Scrape type for LX30818: 0
2026-01-29 06:10:56 [auto1.fr] INFO: Found listing with ID: JT99549
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JT99549%27 HTTP/1.1" 200 None
2026-01-29 06:10:56 [auto1.fr] INFO: Scrape type for JT99549: 0
2026-01-29 06:10:56 [auto1.fr] INFO: Found listing with ID: TN04668
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TN04668%27 HTTP/1.1" 200 None
2026-01-29 06:10:56 [auto1.fr] INFO: Scrape type for TN04668: 0
2026-01-29 06:10:56 [auto1.fr] INFO: Found listing with ID: WZ25278
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WZ25278%27 HTTP/1.1" 200 None
2026-01-29 06:10:56 [auto1.fr] INFO: Scrape type for WZ25278: 0
2026-01-29 06:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AF01916/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GK75380> (referer: https://www.auto1.com/v1/car-details-view/GK75380/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8d587b2-e609-5178-85fb-c4ddc62f0df4 with identifier: GK75380
2026-01-29 06:10:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8d587b2-e609-5178-85fb-c4ddc62f0df4 with scrape type 2
2026-01-29 06:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8d587b2-e609-5178-85fb-c4ddc62f0df4 with scrape type 2
2026-01-29 06:10:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b8d587b2-e609-5178-85fb-c4ddc62f0df4, identifier: GK75380
2026-01-29 06:10:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b8d587b2-e609-5178-85fb-c4ddc62f0df4 with identifier: GK75380
2026-01-29 06:10:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b8d587b2-e609-5178-85fb-c4ddc62f0df4 with identifier: GK75380
2026-01-29 06:10:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech active business', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 47912, 'odometer_reading_unit': 'km', 'registration_date': '2020-12-08', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gk75380', 'expiration_date': '2026-01-29t16:58:26z', 'origin_country_code': 'fr', 'trim': 'active business', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, ambérieu en bugey', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'b8d587b2-e609-5178-85fb-c4ddc62f0df4', 'current_year_diff': 6, 'age_in_months': 61, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 47912}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 61,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 75,
     'expiration_date': '2026-01-29t16:58:26z',
     'fuel_type': 'petrol',
     'id': 'b8d587b2-e609-5178-85fb-c4ddc62f0df4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gk75380',
     'listing': 'auction',
     'location': 'fr, ambérieu en bugey',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 47912,
     'odometer_in_km': 47912,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-12-08',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech active business',
     'transmission': 'manual',
     'trim': 'active business',
     'year': 2020}
2026-01-29 06:10:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: b8d587b2-e609-5178-85fb-c4ddc62f0df4 spider: auto1.fr
2026-01-29 06:10:58 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: b8d587b2-e609-5178-85fb-c4ddc62f0df4 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech active business', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 47912, 'odometer_reading_unit': 'km', 'registration_date': '2020-12-08', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gk75380', 'expiration_date': '2026-01-29t16:58:26z', 'origin_country_code': 'fr', 'trim': 'active business', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, ambérieu en bugey', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'b8d587b2-e609-5178-85fb-c4ddc62f0df4', 'current_year_diff': 6, 'age_in_months': 61, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 47912}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 61,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 75,
     'expiration_date': '2026-01-29t16:58:26z',
     'fuel_type': 'petrol',
     'id': 'b8d587b2-e609-5178-85fb-c4ddc62f0df4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gk75380',
     'listing': 'auction',
     'location': 'fr, ambérieu en bugey',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 47912,
     'odometer_in_km': 47912,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-12-08',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech active business',
     'transmission': 'manual',
     'trim': 'active business',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:58:26Z',
 'fuel_type': 'petrol',
 'id': 'b8d587b2-e609-5178-85fb-c4ddc62f0df4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK75380',
 'listing': 'auction',
 'location': 'FR, Ambérieu en Bugey',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 47912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Active Business',
 'transmission': 'manual',
 'trim': 'Active Business',
 'year': 2020}
2026-01-29 06:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GK75380%27 HTTP/1.1" 200 None
2026-01-29 06:10:58 [auto1.fr] INFO: Saving data for GK75380: {'auction_closing_time': 1769705906.0, 'created_time': 1769533807.913581, 'last_price_update_time': 1769667058.152209}
2026-01-29 06:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GK75380') HTTP/1.1" 204 0
2026-01-29 06:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XF92122> (referer: https://www.auto1.com/v1/car-details-view/XF92122/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:10:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:10:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e749829e-9c3d-540b-91cf-231c5fc2e681 with identifier: XF92122
2026-01-29 06:10:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e749829e-9c3d-540b-91cf-231c5fc2e681 with scrape type 2
2026-01-29 06:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e749829e-9c3d-540b-91cf-231c5fc2e681 with scrape type 2
2026-01-29 06:10:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e749829e-9c3d-540b-91cf-231c5fc2e681, identifier: XF92122
2026-01-29 06:10:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e749829e-9c3d-540b-91cf-231c5fc2e681 with identifier: XF92122
2026-01-29 06:10:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e749829e-9c3d-540b-91cf-231c5fc2e681 with identifier: XF92122
2026-01-29 06:10:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 136640 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    136640
2026-01-29 06:10:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: e749829e-9c3d-540b-91cf-231c5fc2e681 spider: auto1.fr
2026-01-29 06:10:58 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: e749829e-9c3d-540b-91cf-231c5fc2e681 due to rule: high_mileage_for_make.json, error: 136640 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    136640
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:31:19Z',
 'fuel_type': 'diesel',
 'id': 'e749829e-9c3d-540b-91cf-231c5fc2e681',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF92122',
 'listing': 'auction',
 'location': 'FR, Ingrandes sur Vienne',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 136640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Kadjar 1.5 dCi Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2017}
2026-01-29 06:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XF92122%27 HTTP/1.1" 200 None
2026-01-29 06:10:58 [auto1.fr] INFO: Saving data for XF92122: {'auction_closing_time': 1769704279.0, 'created_time': 1768989775.364555, 'last_price_update_time': 1769667058.777614}
2026-01-29 06:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XF92122') HTTP/1.1" 204 0
2026-01-29 06:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LL77834> (referer: https://www.auto1.com/v1/car-details-view/LL77834/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1c39bb2-a964-5645-b03e-9fd63534618c with identifier: LL77834
2026-01-29 06:11:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1c39bb2-a964-5645-b03e-9fd63534618c with scrape type 2
2026-01-29 06:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1c39bb2-a964-5645-b03e-9fd63534618c with scrape type 2
2026-01-29 06:11:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c1c39bb2-a964-5645-b03e-9fd63534618c, identifier: LL77834
2026-01-29 06:11:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c1c39bb2-a964-5645-b03e-9fd63534618c with identifier: LL77834
2026-01-29 06:11:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c1c39bb2-a964-5645-b03e-9fd63534618c with identifier: LL77834
2026-01-29 06:11:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 186908 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    186908
2026-01-29 06:11:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c1c39bb2-a964-5645-b03e-9fd63534618c spider: auto1.fr
2026-01-29 06:11:02 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: c1c39bb2-a964-5645-b03e-9fd63534618c due to rule: high_mileage_for_country.json, error: 186908 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    186908
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:01:14Z',
 'fuel_type': 'diesel',
 'id': 'c1c39bb2-a964-5645-b03e-9fd63534618c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL77834',
 'listing': 'auction',
 'location': 'FR, Marckolsheim',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 186908,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Comfortline 4Motion BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline 4Motion BlueMotion Tech',
 'year': 2020}
2026-01-29 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LL77834%27 HTTP/1.1" 200 None
2026-01-29 06:11:02 [auto1.fr] INFO: Saving data for LL77834: {'auction_closing_time': 1769702474.0, 'created_time': 1768842381.552403, 'last_price_update_time': 1769667062.434823}
2026-01-29 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LL77834') HTTP/1.1" 204 0
2026-01-29 06:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NN91069> (referer: https://www.auto1.com/v1/car-details-view/NN91069/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee80ef7c-d6ae-5606-af7a-555daff1a335 with identifier: NN91069
2026-01-29 06:11:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee80ef7c-d6ae-5606-af7a-555daff1a335 with scrape type 2
2026-01-29 06:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee80ef7c-d6ae-5606-af7a-555daff1a335 with scrape type 2
2026-01-29 06:11:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ee80ef7c-d6ae-5606-af7a-555daff1a335, identifier: NN91069
2026-01-29 06:11:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ee80ef7c-d6ae-5606-af7a-555daff1a335 with identifier: NN91069
2026-01-29 06:11:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ee80ef7c-d6ae-5606-af7a-555daff1a335 with identifier: NN91069
2026-01-29 06:11:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ee80ef7c-d6ae-5606-af7a-555daff1a335 with identifier: NN91069 to the API
2026-01-29 06:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:11:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:11:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NN91069>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:29:14Z',
 'fuel_type': 'diesel',
 'id': 'ee80ef7c-d6ae-5606-af7a-555daff1a335',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN91069',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 79276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 508 1.5 Blue-HDi Allure Business',
 'transmission': 'automatic',
 'trim': 'Allure Business',
 'year': 2019}
2026-01-29 06:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NN91069%27 HTTP/1.1" 200 None
2026-01-29 06:11:03 [auto1.fr] INFO: Saving data for NN91069: {'auction_closing_time': 1769704154.0, 'created_time': 1768497007.298113, 'last_price_update_time': 1769667063.171983}
2026-01-29 06:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NN91069') HTTP/1.1" 204 0
2026-01-29 06:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VZ57179> (referer: https://www.auto1.com/v1/car-details-view/VZ57179/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44cadd97-c2a3-5612-85d3-f3e799b5398e with identifier: VZ57179
2026-01-29 06:11:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44cadd97-c2a3-5612-85d3-f3e799b5398e with scrape type 2
2026-01-29 06:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44cadd97-c2a3-5612-85d3-f3e799b5398e with scrape type 2
2026-01-29 06:11:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 44cadd97-c2a3-5612-85d3-f3e799b5398e, identifier: VZ57179
2026-01-29 06:11:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 44cadd97-c2a3-5612-85d3-f3e799b5398e with identifier: VZ57179
2026-01-29 06:11:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 44cadd97-c2a3-5612-85d3-f3e799b5398e with identifier: VZ57179
2026-01-29 06:11:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 44cadd97-c2a3-5612-85d3-f3e799b5398e with identifier: VZ57179 to the API
2026-01-29 06:11:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:11:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:11:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VZ57179>
{'auction_title': '',
 'c_o_2_emission_value': 54,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 392,
 'expiration_date': '2026-01-29T16:51:55Z',
 'fuel_type': 'hybrid',
 'id': '44cadd97-c2a3-5612-85d3-f3e799b5398e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ57179',
 'listing': 'auction',
 'location': 'FR, MOUGINS',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 83018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T8 Plug-in Hybrid Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2020}
2026-01-29 06:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VZ57179%27 HTTP/1.1" 200 None
2026-01-29 06:11:08 [auto1.fr] INFO: Saving data for VZ57179: {'auction_closing_time': 1769705515.0, 'created_time': 1769533764.391099, 'last_price_update_time': 1769667068.081382}
2026-01-29 06:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VZ57179') HTTP/1.1" 204 0
2026-01-29 06:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PH02343/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HE95316> (referer: https://www.auto1.com/v1/car-details-view/HE95316/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b44b339-87f7-5f90-8e68-d80c127feb7c with identifier: HE95316
2026-01-29 06:11:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b44b339-87f7-5f90-8e68-d80c127feb7c with scrape type 2
2026-01-29 06:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b44b339-87f7-5f90-8e68-d80c127feb7c with scrape type 2
2026-01-29 06:11:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8b44b339-87f7-5f90-8e68-d80c127feb7c, identifier: HE95316
2026-01-29 06:11:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8b44b339-87f7-5f90-8e68-d80c127feb7c with identifier: HE95316
2026-01-29 06:11:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8b44b339-87f7-5f90-8e68-d80c127feb7c with identifier: HE95316
2026-01-29 06:11:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8b44b339-87f7-5f90-8e68-d80c127feb7c with identifier: HE95316 to the API
2026-01-29 06:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:11:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:11:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HE95316>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:47:11Z',
 'fuel_type': 'diesel',
 'id': '8b44b339-87f7-5f90-8e68-d80c127feb7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE95316',
 'listing': 'auction',
 'location': 'FR, Villenoy',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 120397,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.5 Blue-HDi Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2021}
2026-01-29 06:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HE95316%27 HTTP/1.1" 200 None
2026-01-29 06:11:08 [auto1.fr] INFO: Saving data for HE95316: {'auction_closing_time': 1769705231.0, 'created_time': 1766770753.797821, 'last_price_update_time': 1769667068.615285}
2026-01-29 06:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HE95316') HTTP/1.1" 204 0
2026-01-29 06:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SF76043/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZB17998/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XC47658/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GG26374/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GX70820/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TK32898> (referer: https://www.auto1.com/v1/car-details-view/TK32898/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e23d0e51-d60f-5287-8b68-f623e5081519 with identifier: TK32898
2026-01-29 06:11:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e23d0e51-d60f-5287-8b68-f623e5081519 with scrape type 2
2026-01-29 06:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e23d0e51-d60f-5287-8b68-f623e5081519 with scrape type 2
2026-01-29 06:11:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e23d0e51-d60f-5287-8b68-f623e5081519, identifier: TK32898
2026-01-29 06:11:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e23d0e51-d60f-5287-8b68-f623e5081519 with identifier: TK32898
2026-01-29 06:11:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e23d0e51-d60f-5287-8b68-f623e5081519 with identifier: TK32898
2026-01-29 06:11:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e23d0e51-d60f-5287-8b68-f623e5081519 with identifier: TK32898 to the API
2026-01-29 06:11:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:11:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:11:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TK32898>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'engine_horse_power': 283,
 'expiration_date': '2026-01-29T16:30:05Z',
 'fuel_type': 'electro',
 'id': 'e23d0e51-d60f-5287-8b68-f623e5081519',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK32898',
 'listing': 'auction',
 'location': 'Montigny-le-Bretonneux',
 'make': 'Tesla',
 'model': 'Model 3',
 'odometer': 53464,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Tesla Model 3 Standard Range',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-01-29 06:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TK32898%27 HTTP/1.1" 200 None
2026-01-29 06:11:11 [auto1.fr] INFO: Saving data for TK32898: {'auction_closing_time': 1769704205.0, 'created_time': 1769533791.568368, 'last_price_update_time': 1769667071.474544}
2026-01-29 06:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TK32898') HTTP/1.1" 204 0
2026-01-29 06:11:12 [scrapy.extensions.logstats] INFO: Crawled 926 pages (at 119 pages/min), scraped 203 items (at 31 items/min)
2026-01-29 06:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UK14543/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AF01916> (referer: https://www.auto1.com/v1/car-details-view/AF01916/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9112fbb-1026-5c83-a7a5-6f06f6ff556f with identifier: AF01916
2026-01-29 06:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9112fbb-1026-5c83-a7a5-6f06f6ff556f with scrape type 2
2026-01-29 06:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9112fbb-1026-5c83-a7a5-6f06f6ff556f with scrape type 2
2026-01-29 06:11:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d9112fbb-1026-5c83-a7a5-6f06f6ff556f, identifier: AF01916
2026-01-29 06:11:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d9112fbb-1026-5c83-a7a5-6f06f6ff556f with identifier: AF01916
2026-01-29 06:11:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d9112fbb-1026-5c83-a7a5-6f06f6ff556f with identifier: AF01916
2026-01-29 06:11:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2026-01-29 06:11:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: d9112fbb-1026-5c83-a7a5-6f06f6ff556f spider: auto1.fr
2026-01-29 06:11:13 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: d9112fbb-1026-5c83-a7a5-6f06f6ff556f due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:00:21Z',
 'fuel_type': 'diesel',
 'id': 'd9112fbb-1026-5c83-a7a5-6f06f6ff556f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF01916',
 'listing': 'auction',
 'location': 'FR, Carrières-sous-Poissy',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 84089,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-29',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Peugeot Partner 1.5 Blue-HDi Asphalt L1',
 'transmission': 'manual',
 'trim': 'Asphalt L1',
 'year': 2020}
2026-01-29 06:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AF01916%27 HTTP/1.1" 200 None
2026-01-29 06:11:13 [auto1.fr] INFO: Saving data for AF01916: {'auction_closing_time': 1769702421.0, 'created_time': 1768889166.62386, 'last_price_update_time': 1769667073.349281}
2026-01-29 06:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AF01916') HTTP/1.1" 204 0
2026-01-29 06:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TG76927> (referer: https://www.auto1.com/v1/car-details-view/TG76927/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff587775-a3f2-5c7a-b49c-8bfe6ae93e6a with identifier: TG76927
2026-01-29 06:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff587775-a3f2-5c7a-b49c-8bfe6ae93e6a with scrape type 2
2026-01-29 06:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff587775-a3f2-5c7a-b49c-8bfe6ae93e6a with scrape type 2
2026-01-29 06:11:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ff587775-a3f2-5c7a-b49c-8bfe6ae93e6a, identifier: TG76927
2026-01-29 06:11:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ff587775-a3f2-5c7a-b49c-8bfe6ae93e6a with identifier: TG76927
2026-01-29 06:11:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ff587775-a3f2-5c7a-b49c-8bfe6ae93e6a with identifier: TG76927
2026-01-29 06:11:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ff587775-a3f2-5c7a-b49c-8bfe6ae93e6a with identifier: TG76927 to the API
2026-01-29 06:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:11:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TG76927>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:36:08Z',
 'fuel_type': 'petrol',
 'id': 'ff587775-a3f2-5c7a-b49c-8bfe6ae93e6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG76927',
 'listing': 'auction',
 'location': 'FR, Houecourt',
 'make': 'Volkswagen',
 'model': 'Taigo',
 'odometer': 47643,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Taigo 1.0 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2022}
2026-01-29 06:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TG76927%27 HTTP/1.1" 200 None
2026-01-29 06:11:13 [auto1.fr] INFO: Saving data for TG76927: {'auction_closing_time': 1769704568.0, 'created_time': 1768669275.583758, 'last_price_update_time': 1769667073.847219}
2026-01-29 06:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TG76927') HTTP/1.1" 204 0
2026-01-29 06:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SK82566/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PH02343> (referer: https://www.auto1.com/v1/car-details-view/PH02343/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e74f603b-bb9c-5c83-bab6-eff2fadd4358 with identifier: PH02343
2026-01-29 06:11:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e74f603b-bb9c-5c83-bab6-eff2fadd4358 with scrape type 2
2026-01-29 06:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e74f603b-bb9c-5c83-bab6-eff2fadd4358 with scrape type 2
2026-01-29 06:11:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e74f603b-bb9c-5c83-bab6-eff2fadd4358, identifier: PH02343
2026-01-29 06:11:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e74f603b-bb9c-5c83-bab6-eff2fadd4358 with identifier: PH02343
2026-01-29 06:11:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e74f603b-bb9c-5c83-bab6-eff2fadd4358 with identifier: PH02343
2026-01-29 06:11:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e74f603b-bb9c-5c83-bab6-eff2fadd4358 with identifier: PH02343 to the API
2026-01-29 06:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:11:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:11:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PH02343>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:56:48Z',
 'fuel_type': 'petrol',
 'id': 'e74f603b-bb9c-5c83-bab6-eff2fadd4358',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH02343',
 'listing': 'auction',
 'location': 'Puget-sur-Argens',
 'make': 'Renault',
 'model': 'Arkana',
 'odometer': 58348,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Arkana 1.3 TCe Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2021}
2026-01-29 06:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH02343%27 HTTP/1.1" 200 None
2026-01-29 06:11:15 [auto1.fr] INFO: Saving data for PH02343: {'auction_closing_time': 1769705808.0, 'created_time': 1769534042.400131, 'last_price_update_time': 1769667075.165425}
2026-01-29 06:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PH02343') HTTP/1.1" 204 0
2026-01-29 06:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JN37643> (referer: https://www.auto1.com/v1/car-details-view/JN37643/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 317ead0f-d75d-54eb-8b02-00a2b82c7234 with identifier: JN37643
2026-01-29 06:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 317ead0f-d75d-54eb-8b02-00a2b82c7234 with scrape type 2
2026-01-29 06:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 317ead0f-d75d-54eb-8b02-00a2b82c7234 with scrape type 2
2026-01-29 06:11:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 317ead0f-d75d-54eb-8b02-00a2b82c7234, identifier: JN37643
2026-01-29 06:11:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 317ead0f-d75d-54eb-8b02-00a2b82c7234 with identifier: JN37643
2026-01-29 06:11:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 317ead0f-d75d-54eb-8b02-00a2b82c7234 with identifier: JN37643
2026-01-29 06:11:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 317ead0f-d75d-54eb-8b02-00a2b82c7234 with identifier: JN37643 to the API
2026-01-29 06:11:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:11:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:11:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JN37643>
{'auction_title': '',
 'c_o_2_emission_value': 24,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'engine_horse_power': 218,
 'expiration_date': '2026-01-29T16:23:36Z',
 'fuel_type': 'hybrid',
 'id': '317ead0f-d75d-54eb-8b02-00a2b82c7234',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN37643',
 'listing': 'auction',
 'location': 'FR, Quincieux',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 42490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 250e AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-01-29 06:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JN37643%27 HTTP/1.1" 200 None
2026-01-29 06:11:15 [auto1.fr] INFO: Saving data for JN37643: {'auction_closing_time': 1769703816.0, 'created_time': 1768844222.931031, 'last_price_update_time': 1769667075.667123}
2026-01-29 06:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JN37643') HTTP/1.1" 204 0
2026-01-29 06:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NU07260/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KS72696> (referer: https://www.auto1.com/v1/car-details-view/KS72696/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c3b5a70-6dd0-56d7-a544-0bb85e3104e3 with identifier: KS72696
2026-01-29 06:11:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c3b5a70-6dd0-56d7-a544-0bb85e3104e3 with scrape type 2
2026-01-29 06:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c3b5a70-6dd0-56d7-a544-0bb85e3104e3 with scrape type 2
2026-01-29 06:11:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1c3b5a70-6dd0-56d7-a544-0bb85e3104e3, identifier: KS72696
2026-01-29 06:11:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1c3b5a70-6dd0-56d7-a544-0bb85e3104e3 with identifier: KS72696
2026-01-29 06:11:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1c3b5a70-6dd0-56d7-a544-0bb85e3104e3 with identifier: KS72696
2026-01-29 06:11:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1c3b5a70-6dd0-56d7-a544-0bb85e3104e3 with identifier: KS72696 to the API
2026-01-29 06:11:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:11:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:11:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KS72696>
{'auction_title': '',
 'c_o_2_emission_value': 27,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 224,
 'expiration_date': '2026-01-29T16:24:08Z',
 'fuel_type': 'hybrid',
 'id': '1c3b5a70-6dd0-56d7-a544-0bb85e3104e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS72696',
 'listing': 'auction',
 'location': 'FR, Chambray-Lès-Tours',
 'make': 'Citroen',
 'model': 'C5 X',
 'odometer': 18946,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-08-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 X 1.6 Plug-in Hybrid Shine Pack',
 'transmission': 'automatic',
 'trim': 'Shine Pack',
 'year': 2023}
2026-01-29 06:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KS72696%27 HTTP/1.1" 200 None
2026-01-29 06:11:16 [auto1.fr] INFO: Saving data for KS72696: {'auction_closing_time': 1769703848.0, 'created_time': 1769533516.180422, 'last_price_update_time': 1769667076.98166}
2026-01-29 06:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KS72696') HTTP/1.1" 204 0
2026-01-29 06:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GX70820> (referer: https://www.auto1.com/v1/car-details-view/GX70820/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c0499be-2cbd-5651-9a20-4f7da8a3ede4 with identifier: GX70820
2026-01-29 06:11:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c0499be-2cbd-5651-9a20-4f7da8a3ede4 with scrape type 2
2026-01-29 06:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c0499be-2cbd-5651-9a20-4f7da8a3ede4 with scrape type 2
2026-01-29 06:11:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6c0499be-2cbd-5651-9a20-4f7da8a3ede4, identifier: GX70820
2026-01-29 06:11:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6c0499be-2cbd-5651-9a20-4f7da8a3ede4 with identifier: GX70820
2026-01-29 06:11:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6c0499be-2cbd-5651-9a20-4f7da8a3ede4 with identifier: GX70820
2026-01-29 06:11:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech graphic', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 137017, 'odometer_reading_unit': 'km', 'registration_date': '2020-06-21', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gx70820', 'expiration_date': '2026-01-29t16:46:48z', 'origin_country_code': 'fr', 'trim': 'graphic', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marly-la-ville', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 128, 'id': '6c0499be-2cbd-5651-9a20-4f7da8a3ede4', 'current_year_diff': 6, 'age_in_months': 67, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 137017}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 67,
     'auction_title': '',
     'c_o_2_emission_value': 128,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:46:48z',
     'fuel_type': 'petrol',
     'id': '6c0499be-2cbd-5651-9a20-4f7da8a3ede4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gx70820',
     'listing': 'auction',
     'location': 'fr, marly-la-ville',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 137017,
     'odometer_in_km': 137017,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-06-21',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech graphic',
     'transmission': 'manual',
     'trim': 'graphic',
     'year': 2020}
2026-01-29 06:11:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 6c0499be-2cbd-5651-9a20-4f7da8a3ede4 spider: auto1.fr
2026-01-29 06:11:18 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 6c0499be-2cbd-5651-9a20-4f7da8a3ede4 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech graphic', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 137017, 'odometer_reading_unit': 'km', 'registration_date': '2020-06-21', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gx70820', 'expiration_date': '2026-01-29t16:46:48z', 'origin_country_code': 'fr', 'trim': 'graphic', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marly-la-ville', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 128, 'id': '6c0499be-2cbd-5651-9a20-4f7da8a3ede4', 'current_year_diff': 6, 'age_in_months': 67, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 137017}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 67,
     'auction_title': '',
     'c_o_2_emission_value': 128,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:46:48z',
     'fuel_type': 'petrol',
     'id': '6c0499be-2cbd-5651-9a20-4f7da8a3ede4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gx70820',
     'listing': 'auction',
     'location': 'fr, marly-la-ville',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 137017,
     'odometer_in_km': 137017,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-06-21',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech graphic',
     'transmission': 'manual',
     'trim': 'graphic',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:46:48Z',
 'fuel_type': 'petrol',
 'id': '6c0499be-2cbd-5651-9a20-4f7da8a3ede4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX70820',
 'listing': 'auction',
 'location': 'FR, Marly-la-ville',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 137017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Graphic',
 'transmission': 'manual',
 'trim': 'Graphic',
 'year': 2020}
2026-01-29 06:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GX70820%27 HTTP/1.1" 200 None
2026-01-29 06:11:18 [auto1.fr] INFO: Saving data for GX70820: {'auction_closing_time': 1769705208.0, 'created_time': 1769534116.734078, 'last_price_update_time': 1769667078.827509}
2026-01-29 06:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GX70820') HTTP/1.1" 204 0
2026-01-29 06:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XC47658> (referer: https://www.auto1.com/v1/car-details-view/XC47658/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f945779-5443-5ee6-964c-1d48bf861b4f with identifier: XC47658
2026-01-29 06:11:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f945779-5443-5ee6-964c-1d48bf861b4f with scrape type 2
2026-01-29 06:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f945779-5443-5ee6-964c-1d48bf861b4f with scrape type 2
2026-01-29 06:11:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5f945779-5443-5ee6-964c-1d48bf861b4f, identifier: XC47658
2026-01-29 06:11:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5f945779-5443-5ee6-964c-1d48bf861b4f with identifier: XC47658
2026-01-29 06:11:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5f945779-5443-5ee6-964c-1d48bf861b4f with identifier: XC47658
2026-01-29 06:11:20 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'manual', 'odometer': 63476, 'odometer_reading_unit': 'km', 'registration_date': '2019-07-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xc47658', 'expiration_date': '2026-01-29t16:08:09z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, le havre', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 104, 'id': '5f945779-5443-5ee6-964c-1d48bf861b4f', 'current_year_diff': 7, 'age_in_months': 78, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 63476}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 78,
     'auction_title': '',
     'c_o_2_emission_value': 104,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:08:09z',
     'fuel_type': 'petrol',
     'id': '5f945779-5443-5ee6-964c-1d48bf861b4f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xc47658',
     'listing': 'auction',
     'location': 'fr, le havre',
     'make': 'citroen',
     'make_model': 'citroen c3 aircross',
     'model': 'c3 aircross',
     'odometer': 63476,
     'odometer_in_km': 63476,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-07-24',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 aircross 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2019}
2026-01-29 06:11:20 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 5f945779-5443-5ee6-964c-1d48bf861b4f spider: auto1.fr
2026-01-29 06:11:20 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 5f945779-5443-5ee6-964c-1d48bf861b4f due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'manual', 'odometer': 63476, 'odometer_reading_unit': 'km', 'registration_date': '2019-07-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xc47658', 'expiration_date': '2026-01-29t16:08:09z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, le havre', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 104, 'id': '5f945779-5443-5ee6-964c-1d48bf861b4f', 'current_year_diff': 7, 'age_in_months': 78, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 63476}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 78,
     'auction_title': '',
     'c_o_2_emission_value': 104,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:08:09z',
     'fuel_type': 'petrol',
     'id': '5f945779-5443-5ee6-964c-1d48bf861b4f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xc47658',
     'listing': 'auction',
     'location': 'fr, le havre',
     'make': 'citroen',
     'make_model': 'citroen c3 aircross',
     'model': 'c3 aircross',
     'odometer': 63476,
     'odometer_in_km': 63476,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-07-24',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 aircross 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:08:09Z',
 'fuel_type': 'petrol',
 'id': '5f945779-5443-5ee6-964c-1d48bf861b4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC47658',
 'listing': 'auction',
 'location': 'FR, LE HAVRE',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 63476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2019}
2026-01-29 06:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XC47658%27 HTTP/1.1" 200 None
2026-01-29 06:11:20 [auto1.fr] INFO: Saving data for XC47658: {'auction_closing_time': 1769702889.0, 'created_time': 1769533897.39142, 'last_price_update_time': 1769667080.827631}
2026-01-29 06:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XC47658') HTTP/1.1" 204 0
2026-01-29 06:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SF76043> (referer: https://www.auto1.com/v1/car-details-view/SF76043/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7929b7d1-979a-5af3-ad50-b71c1d00646b with identifier: SF76043
2026-01-29 06:11:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7929b7d1-979a-5af3-ad50-b71c1d00646b with scrape type 2
2026-01-29 06:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7929b7d1-979a-5af3-ad50-b71c1d00646b with scrape type 2
2026-01-29 06:11:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7929b7d1-979a-5af3-ad50-b71c1d00646b, identifier: SF76043
2026-01-29 06:11:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7929b7d1-979a-5af3-ad50-b71c1d00646b with identifier: SF76043
2026-01-29 06:11:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7929b7d1-979a-5af3-ad50-b71c1d00646b with identifier: SF76043
2026-01-29 06:11:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7929b7d1-979a-5af3-ad50-b71c1d00646b with identifier: SF76043 to the API
2026-01-29 06:11:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:11:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:11:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SF76043>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:01:11Z',
 'fuel_type': 'diesel',
 'id': '7929b7d1-979a-5af3-ad50-b71c1d00646b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF76043',
 'listing': 'auction',
 'location': 'FR, Le Boulou',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 58759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.5 TDCi EcoBlue ST-Line X',
 'transmission': 'manual',
 'trim': 'ST-Line X',
 'year': 2020}
2026-01-29 06:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF76043%27 HTTP/1.1" 200 None
2026-01-29 06:11:23 [auto1.fr] INFO: Saving data for SF76043: {'auction_closing_time': 1769702471.0, 'created_time': 1769449185.352089, 'last_price_update_time': 1769667083.845627}
2026-01-29 06:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SF76043') HTTP/1.1" 204 0
2026-01-29 06:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NE79896/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GG26374> (referer: https://www.auto1.com/v1/car-details-view/GG26374/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ead654fb-b7e7-5ae9-a917-58aa82139adb with identifier: GG26374
2026-01-29 06:11:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ead654fb-b7e7-5ae9-a917-58aa82139adb with scrape type 2
2026-01-29 06:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ead654fb-b7e7-5ae9-a917-58aa82139adb with scrape type 2
2026-01-29 06:11:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ead654fb-b7e7-5ae9-a917-58aa82139adb, identifier: GG26374
2026-01-29 06:11:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ead654fb-b7e7-5ae9-a917-58aa82139adb with identifier: GG26374
2026-01-29 06:11:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ead654fb-b7e7-5ae9-a917-58aa82139adb with identifier: GG26374
2026-01-29 06:11:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 101662, 'odometer_reading_unit': 'km', 'registration_date': '2017-01-31', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gg26374', 'expiration_date': '2026-01-29t16:57:37z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, le boulou', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': 'ead654fb-b7e7-5ae9-a917-58aa82139adb', 'current_year_diff': 9, 'age_in_months': 107, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 101662}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 107,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:57:37z',
     'fuel_type': 'petrol',
     'id': 'ead654fb-b7e7-5ae9-a917-58aa82139adb',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gg26374',
     'listing': 'auction',
     'location': 'fr, le boulou',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 101662,
     'odometer_in_km': 101662,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-01-31',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2017}
2026-01-29 06:11:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: ead654fb-b7e7-5ae9-a917-58aa82139adb spider: auto1.fr
2026-01-29 06:11:24 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: ead654fb-b7e7-5ae9-a917-58aa82139adb due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 101662, 'odometer_reading_unit': 'km', 'registration_date': '2017-01-31', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gg26374', 'expiration_date': '2026-01-29t16:57:37z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, le boulou', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': 'ead654fb-b7e7-5ae9-a917-58aa82139adb', 'current_year_diff': 9, 'age_in_months': 107, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 101662}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 107,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:57:37z',
     'fuel_type': 'petrol',
     'id': 'ead654fb-b7e7-5ae9-a917-58aa82139adb',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gg26374',
     'listing': 'auction',
     'location': 'fr, le boulou',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 101662,
     'odometer_in_km': 101662,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-01-31',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:57:37Z',
 'fuel_type': 'petrol',
 'id': 'ead654fb-b7e7-5ae9-a917-58aa82139adb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG26374',
 'listing': 'auction',
 'location': 'FR, Le Boulou',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 101662,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2017}
2026-01-29 06:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG26374%27 HTTP/1.1" 200 None
2026-01-29 06:11:24 [auto1.fr] INFO: Saving data for GG26374: {'auction_closing_time': 1769705857.0, 'created_time': 1769448993.196769, 'last_price_update_time': 1769667084.645128}
2026-01-29 06:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GG26374') HTTP/1.1" 204 0
2026-01-29 06:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PC89884/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UK14543> (referer: https://www.auto1.com/v1/car-details-view/UK14543/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f702af7-5216-5658-accd-3406bd922498 with identifier: UK14543
2026-01-29 06:11:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f702af7-5216-5658-accd-3406bd922498 with scrape type 2
2026-01-29 06:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f702af7-5216-5658-accd-3406bd922498 with scrape type 2
2026-01-29 06:11:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4f702af7-5216-5658-accd-3406bd922498, identifier: UK14543
2026-01-29 06:11:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4f702af7-5216-5658-accd-3406bd922498 with identifier: UK14543
2026-01-29 06:11:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4f702af7-5216-5658-accd-3406bd922498 with identifier: UK14543
2026-01-29 06:11:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4f702af7-5216-5658-accd-3406bd922498 with identifier: UK14543 to the API
2026-01-29 06:11:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:11:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:11:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UK14543>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 184,
 'expiration_date': '2026-01-29T16:15:57Z',
 'fuel_type': 'petrol',
 'id': '4f702af7-5216-5658-accd-3406bd922498',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK14543',
 'listing': 'auction',
 'location': 'FR, Antibes',
 'make': 'BMW',
 'model': '4er',
 'odometer': 68682,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-10',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW 4er 420i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2022}
2026-01-29 06:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UK14543%27 HTTP/1.1" 200 None
2026-01-29 06:11:27 [auto1.fr] INFO: Saving data for UK14543: {'auction_closing_time': 1769703357.0, 'created_time': 1769533609.549951, 'last_price_update_time': 1769667087.899204}
2026-01-29 06:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UK14543') HTTP/1.1" 204 0
2026-01-29 06:11:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZB17998> (referer: https://www.auto1.com/v1/car-details-view/ZB17998/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 265d56fb-8ccc-5cf7-846a-899cf3eb5fe7 with identifier: ZB17998
2026-01-29 06:11:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 265d56fb-8ccc-5cf7-846a-899cf3eb5fe7 with scrape type 2
2026-01-29 06:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 265d56fb-8ccc-5cf7-846a-899cf3eb5fe7 with scrape type 2
2026-01-29 06:11:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 265d56fb-8ccc-5cf7-846a-899cf3eb5fe7, identifier: ZB17998
2026-01-29 06:11:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 265d56fb-8ccc-5cf7-846a-899cf3eb5fe7 with identifier: ZB17998
2026-01-29 06:11:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 265d56fb-8ccc-5cf7-846a-899cf3eb5fe7 with identifier: ZB17998
2026-01-29 06:11:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech origins', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 48011, 'odometer_reading_unit': 'km', 'registration_date': '2019-07-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zb17998', 'expiration_date': '2026-01-29t16:19:53z', 'origin_country_code': 'fr', 'trim': 'origins', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marseille', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 108, 'id': '265d56fb-8ccc-5cf7-846a-899cf3eb5fe7', 'current_year_diff': 7, 'age_in_months': 78, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 48011}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 78,
     'auction_title': '',
     'c_o_2_emission_value': 108,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:19:53z',
     'fuel_type': 'petrol',
     'id': '265d56fb-8ccc-5cf7-846a-899cf3eb5fe7',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zb17998',
     'listing': 'auction',
     'location': 'fr, marseille',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 48011,
     'odometer_in_km': 48011,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-07-29',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech origins',
     'transmission': 'manual',
     'trim': 'origins',
     'year': 2019}
2026-01-29 06:11:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 265d56fb-8ccc-5cf7-846a-899cf3eb5fe7 spider: auto1.fr
2026-01-29 06:11:31 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 265d56fb-8ccc-5cf7-846a-899cf3eb5fe7 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech origins', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 48011, 'odometer_reading_unit': 'km', 'registration_date': '2019-07-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zb17998', 'expiration_date': '2026-01-29t16:19:53z', 'origin_country_code': 'fr', 'trim': 'origins', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marseille', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 108, 'id': '265d56fb-8ccc-5cf7-846a-899cf3eb5fe7', 'current_year_diff': 7, 'age_in_months': 78, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 48011}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 78,
     'auction_title': '',
     'c_o_2_emission_value': 108,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:19:53z',
     'fuel_type': 'petrol',
     'id': '265d56fb-8ccc-5cf7-846a-899cf3eb5fe7',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zb17998',
     'listing': 'auction',
     'location': 'fr, marseille',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 48011,
     'odometer_in_km': 48011,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-07-29',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech origins',
     'transmission': 'manual',
     'trim': 'origins',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:19:53Z',
 'fuel_type': 'petrol',
 'id': '265d56fb-8ccc-5cf7-846a-899cf3eb5fe7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB17998',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 48011,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Origins',
 'transmission': 'manual',
 'trim': 'Origins',
 'year': 2019}
2026-01-29 06:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZB17998%27 HTTP/1.1" 200 None
2026-01-29 06:11:31 [auto1.fr] INFO: Saving data for ZB17998: {'auction_closing_time': 1769703593.0, 'created_time': 1769533638.242211, 'last_price_update_time': 1769667091.872958}
2026-01-29 06:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZB17998') HTTP/1.1" 204 0
2026-01-29 06:11:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NU07260> (referer: https://www.auto1.com/v1/car-details-view/NU07260/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WT57817/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZS29376/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adcc09ba-cc08-577b-ac64-34bba9d8b3a5 with identifier: NU07260
2026-01-29 06:11:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adcc09ba-cc08-577b-ac64-34bba9d8b3a5 with scrape type 2
2026-01-29 06:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item adcc09ba-cc08-577b-ac64-34bba9d8b3a5 with scrape type 2
2026-01-29 06:11:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: adcc09ba-cc08-577b-ac64-34bba9d8b3a5, identifier: NU07260
2026-01-29 06:11:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: adcc09ba-cc08-577b-ac64-34bba9d8b3a5 with identifier: NU07260
2026-01-29 06:11:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-29 06:11:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-01-29 06:11:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-29 06:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-29 06:11:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: adcc09ba-cc08-577b-ac64-34bba9d8b3a5 with identifier: NU07260
2026-01-29 06:11:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gold', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 74915, 'odometer_reading_unit': 'km', 'registration_date': '2020-04-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nu07260', 'expiration_date': '2026-01-29t16:06:08z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marckolsheim', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 102, 'id': 'adcc09ba-cc08-577b-ac64-34bba9d8b3a5', 'current_year_diff': 6, 'age_in_months': 69, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 74915}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 69,
     'auction_title': '',
     'c_o_2_emission_value': 102,
     'category': None,
     'color': 'gold',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:06:08z',
     'fuel_type': 'petrol',
     'id': 'adcc09ba-cc08-577b-ac64-34bba9d8b3a5',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nu07260',
     'listing': 'auction',
     'location': 'fr, marckolsheim',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 74915,
     'odometer_in_km': 74915,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-04-23',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2020}
2026-01-29 06:11:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: adcc09ba-cc08-577b-ac64-34bba9d8b3a5 spider: auto1.fr
2026-01-29 06:11:33 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: adcc09ba-cc08-577b-ac64-34bba9d8b3a5 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gold', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 74915, 'odometer_reading_unit': 'km', 'registration_date': '2020-04-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nu07260', 'expiration_date': '2026-01-29t16:06:08z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marckolsheim', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 102, 'id': 'adcc09ba-cc08-577b-ac64-34bba9d8b3a5', 'current_year_diff': 6, 'age_in_months': 69, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 74915}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 69,
     'auction_title': '',
     'c_o_2_emission_value': 102,
     'category': None,
     'color': 'gold',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:06:08z',
     'fuel_type': 'petrol',
     'id': 'adcc09ba-cc08-577b-ac64-34bba9d8b3a5',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nu07260',
     'listing': 'auction',
     'location': 'fr, marckolsheim',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 74915,
     'odometer_in_km': 74915,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-04-23',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': None,
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:06:08Z',
 'fuel_type': 'petrol',
 'id': 'adcc09ba-cc08-577b-ac64-34bba9d8b3a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU07260',
 'listing': 'auction',
 'location': 'FR, Marckolsheim',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 74915,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-04-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-01-29 06:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NU07260%27 HTTP/1.1" 200 None
2026-01-29 06:11:33 [auto1.fr] INFO: Saving data for NU07260: {'auction_closing_time': 1769702768.0, 'created_time': 1767074675.214645, 'last_price_update_time': 1769667093.410678}
2026-01-29 06:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NU07260') HTTP/1.1" 204 0
2026-01-29 06:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SK82566> (referer: https://www.auto1.com/v1/car-details-view/SK82566/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55e44ce1-3ed7-5dc4-a9c0-619ca34af061 with identifier: SK82566
2026-01-29 06:11:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55e44ce1-3ed7-5dc4-a9c0-619ca34af061 with scrape type 2
2026-01-29 06:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55e44ce1-3ed7-5dc4-a9c0-619ca34af061 with scrape type 2
2026-01-29 06:11:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 55e44ce1-3ed7-5dc4-a9c0-619ca34af061, identifier: SK82566
2026-01-29 06:11:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 55e44ce1-3ed7-5dc4-a9c0-619ca34af061 with identifier: SK82566
2026-01-29 06:11:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 55e44ce1-3ed7-5dc4-a9c0-619ca34af061 with identifier: SK82566
2026-01-29 06:11:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech feel', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 73653, 'odometer_reading_unit': 'km', 'registration_date': '2018-02-07', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sk82566', 'expiration_date': '2026-01-29t16:45:48z', 'origin_country_code': 'fr', 'trim': 'feel', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, warluis', 'category': None, 'seats_number': 2, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': '55e44ce1-3ed7-5dc4-a9c0-619ca34af061', 'current_year_diff': 8, 'age_in_months': 95, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 73653}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 95,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:45:48z',
     'fuel_type': 'petrol',
     'id': '55e44ce1-3ed7-5dc4-a9c0-619ca34af061',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sk82566',
     'listing': 'auction',
     'location': 'fr, warluis',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 73653,
     'odometer_in_km': 73653,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-02-07',
     'sanitized_make': 'citroen',
     'seats_number': 2,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech feel',
     'transmission': 'manual',
     'trim': 'feel',
     'year': 2018}
2026-01-29 06:11:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 55e44ce1-3ed7-5dc4-a9c0-619ca34af061 spider: auto1.fr
2026-01-29 06:11:33 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 55e44ce1-3ed7-5dc4-a9c0-619ca34af061 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech feel', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 73653, 'odometer_reading_unit': 'km', 'registration_date': '2018-02-07', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sk82566', 'expiration_date': '2026-01-29t16:45:48z', 'origin_country_code': 'fr', 'trim': 'feel', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, warluis', 'category': None, 'seats_number': 2, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': '55e44ce1-3ed7-5dc4-a9c0-619ca34af061', 'current_year_diff': 8, 'age_in_months': 95, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 73653}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 95,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:45:48z',
     'fuel_type': 'petrol',
     'id': '55e44ce1-3ed7-5dc4-a9c0-619ca34af061',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sk82566',
     'listing': 'auction',
     'location': 'fr, warluis',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 73653,
     'odometer_in_km': 73653,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-02-07',
     'sanitized_make': 'citroen',
     'seats_number': 2,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech feel',
     'transmission': 'manual',
     'trim': 'feel',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:45:48Z',
 'fuel_type': 'petrol',
 'id': '55e44ce1-3ed7-5dc4-a9c0-619ca34af061',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK82566',
 'listing': 'auction',
 'location': 'FR, Warluis',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 73653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-07',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2018}
2026-01-29 06:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SK82566%27 HTTP/1.1" 200 None
2026-01-29 06:11:33 [auto1.fr] INFO: Saving data for SK82566: {'auction_closing_time': 1769705148.0, 'created_time': 1769533755.540257, 'last_price_update_time': 1769667093.879651}
2026-01-29 06:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SK82566') HTTP/1.1" 204 0
2026-01-29 06:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ML39767/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:34 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: FS43767
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FS43767%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for FS43767: 0
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: WU47710
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU47710%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for WU47710: 2
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: KA73998
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KA73998%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for KA73998: 2
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: SJ66634
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SJ66634%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for SJ66634: 0
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: UT82553
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT82553%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for UT82553: 2
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: FT68407
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FT68407%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for FT68407: 0
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: VB91580
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VB91580%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for VB91580: 0
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: FX33542
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX33542%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for FX33542: 2
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: KY64795
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KY64795%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for KY64795: 2
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: FP23517
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP23517%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for FP23517: 2
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: EP80781
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EP80781%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for EP80781: 2
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: UG42054
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG42054%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for UG42054: 0
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: PU11656
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PU11656%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for PU11656: 0
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: YD21894
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YD21894%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for YD21894: 2
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: SN52348
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SN52348%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for SN52348: 2
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: EF40268
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF40268%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for EF40268: 0
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: ZV25464
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZV25464%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for ZV25464: 2
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: CF72788
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CF72788%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for CF72788: 2
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: GF93089
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF93089%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for GF93089: 2
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: ZT34568
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZT34568%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for ZT34568: 0
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: FA72836
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FA72836%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for FA72836: 2
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: UU84619
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UU84619%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for UU84619: 0
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: XJ12291
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XJ12291%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for XJ12291: 0
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: JE16773
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JE16773%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for JE16773: 0
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: DD38700
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DD38700%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for DD38700: 2
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: UB13554
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UB13554%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for UB13554: 0
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: NG66427
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NG66427%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for NG66427: 0
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: YK05298
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YK05298%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for YK05298: 2
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: BK65220
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BK65220%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for BK65220: 2
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: RU36122
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RU36122%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for RU36122: 2
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: MP93997
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP93997%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for MP93997: 2
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: BR78884
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BR78884%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for BR78884: 0
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: CC48472
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CC48472%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for CC48472: 2
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: GB80904
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GB80904%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for GB80904: 2
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: YV46639
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YV46639%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for YV46639: 2
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: PU36864
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PU36864%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for PU36864: 0
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: FR65157
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FR65157%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for FR65157: 2
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: HN33956
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HN33956%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for HN33956: 0
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: KR65251
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KR65251%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for KR65251: 0
2026-01-29 06:11:34 [auto1.fr] INFO: Found listing with ID: MM36980
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MM36980%27 HTTP/1.1" 200 None
2026-01-29 06:11:34 [auto1.fr] INFO: Scrape type for MM36980: 0
2026-01-29 06:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PU76778/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MM14413/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DK27288> (referer: https://www.auto1.com/v1/car-details-view/DK27288/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 645a784d-56d0-5b2d-a325-0004dab73dff with identifier: DK27288
2026-01-29 06:11:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 645a784d-56d0-5b2d-a325-0004dab73dff with scrape type 2
2026-01-29 06:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 645a784d-56d0-5b2d-a325-0004dab73dff with scrape type 2
2026-01-29 06:11:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 645a784d-56d0-5b2d-a325-0004dab73dff, identifier: DK27288
2026-01-29 06:11:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 645a784d-56d0-5b2d-a325-0004dab73dff with identifier: DK27288
2026-01-29 06:11:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 645a784d-56d0-5b2d-a325-0004dab73dff with identifier: DK27288
2026-01-29 06:11:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 192662 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    192662
2026-01-29 06:11:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 645a784d-56d0-5b2d-a325-0004dab73dff spider: auto1.fr
2026-01-29 06:11:36 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 645a784d-56d0-5b2d-a325-0004dab73dff due to rule: high_mileage_for_country.json, error: 192662 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    192662
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.7L',
 'engine_horse_power': 141,
 'expiration_date': '2026-01-29T16:54:19Z',
 'fuel_type': 'diesel',
 'id': '645a784d-56d0-5b2d-a325-0004dab73dff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK27288',
 'listing': 'auction',
 'location': 'FR, Ingrandes sur Vienne',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 192662,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.7 CRDi Mondial 2WD',
 'transmission': 'automatic',
 'trim': 'Mondial 2WD',
 'year': 2018}
2026-01-29 06:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DK27288%27 HTTP/1.1" 200 None
2026-01-29 06:11:36 [auto1.fr] INFO: Saving data for DK27288: {'auction_closing_time': 1769705659.0, 'created_time': 1769101356.910479, 'last_price_update_time': 1769667096.361279}
2026-01-29 06:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DK27288') HTTP/1.1" 204 0
2026-01-29 06:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZB44249/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NE79896> (referer: https://www.auto1.com/v1/car-details-view/NE79896/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72027a9b-eba8-5327-ac4d-3394db93f513 with identifier: NE79896
2026-01-29 06:11:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72027a9b-eba8-5327-ac4d-3394db93f513 with scrape type 2
2026-01-29 06:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72027a9b-eba8-5327-ac4d-3394db93f513 with scrape type 2
2026-01-29 06:11:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 72027a9b-eba8-5327-ac4d-3394db93f513, identifier: NE79896
2026-01-29 06:11:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 72027a9b-eba8-5327-ac4d-3394db93f513 with identifier: NE79896
2026-01-29 06:11:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 72027a9b-eba8-5327-ac4d-3394db93f513 with identifier: NE79896
2026-01-29 06:11:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech like', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 109998, 'odometer_reading_unit': 'km', 'registration_date': '2019-06-11', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ne79896', 'expiration_date': '2026-01-29t16:58:54z', 'origin_country_code': 'fr', 'trim': 'like', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 68, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, saint-quentin', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 105, 'id': '72027a9b-eba8-5327-ac4d-3394db93f513', 'current_year_diff': 7, 'age_in_months': 79, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 109998}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 79,
     'auction_title': '',
     'c_o_2_emission_value': 105,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 68,
     'expiration_date': '2026-01-29t16:58:54z',
     'fuel_type': 'petrol',
     'id': '72027a9b-eba8-5327-ac4d-3394db93f513',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ne79896',
     'listing': 'auction',
     'location': 'fr, saint-quentin',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 109998,
     'odometer_in_km': 109998,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-06-11',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech like',
     'transmission': 'manual',
     'trim': 'like',
     'year': 2019}
2026-01-29 06:11:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 72027a9b-eba8-5327-ac4d-3394db93f513 spider: auto1.fr
2026-01-29 06:11:37 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 72027a9b-eba8-5327-ac4d-3394db93f513 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech like', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 109998, 'odometer_reading_unit': 'km', 'registration_date': '2019-06-11', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ne79896', 'expiration_date': '2026-01-29t16:58:54z', 'origin_country_code': 'fr', 'trim': 'like', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 68, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, saint-quentin', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 105, 'id': '72027a9b-eba8-5327-ac4d-3394db93f513', 'current_year_diff': 7, 'age_in_months': 79, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 109998}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 79,
     'auction_title': '',
     'c_o_2_emission_value': 105,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 68,
     'expiration_date': '2026-01-29t16:58:54z',
     'fuel_type': 'petrol',
     'id': '72027a9b-eba8-5327-ac4d-3394db93f513',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ne79896',
     'listing': 'auction',
     'location': 'fr, saint-quentin',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 109998,
     'odometer_in_km': 109998,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-06-11',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech like',
     'transmission': 'manual',
     'trim': 'like',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 68,
 'expiration_date': '2026-01-29T16:58:54Z',
 'fuel_type': 'petrol',
 'id': '72027a9b-eba8-5327-ac4d-3394db93f513',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE79896',
 'listing': 'auction',
 'location': 'FR, Saint-Quentin',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 109998,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Like',
 'transmission': 'manual',
 'trim': 'Like',
 'year': 2019}
2026-01-29 06:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NE79896%27 HTTP/1.1" 200 None
2026-01-29 06:11:37 [auto1.fr] INFO: Saving data for NE79896: {'auction_closing_time': 1769705934.0, 'created_time': 1768928645.115851, 'last_price_update_time': 1769667097.582242}
2026-01-29 06:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NE79896') HTTP/1.1" 204 0
2026-01-29 06:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YU72456/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YL11984/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PC89884> (referer: https://www.auto1.com/v1/car-details-view/PC89884/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5cc9684-9d58-548f-9f06-f862243e78d6 with identifier: PC89884
2026-01-29 06:11:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5cc9684-9d58-548f-9f06-f862243e78d6 with scrape type 2
2026-01-29 06:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5cc9684-9d58-548f-9f06-f862243e78d6 with scrape type 2
2026-01-29 06:11:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e5cc9684-9d58-548f-9f06-f862243e78d6, identifier: PC89884
2026-01-29 06:11:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e5cc9684-9d58-548f-9f06-f862243e78d6 with identifier: PC89884
2026-01-29 06:11:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e5cc9684-9d58-548f-9f06-f862243e78d6 with identifier: PC89884
2026-01-29 06:11:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel corsa 1.2 turbo gs line', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'corsa', 'transmission': 'manual', 'odometer': 72764, 'odometer_reading_unit': 'km', 'registration_date': '2020-01-10', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pc89884', 'expiration_date': '2026-01-29t16:23:44z', 'origin_country_code': 'fr', 'trim': 'gs line', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, saint aignan de grandlieu', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 96, 'id': 'e5cc9684-9d58-548f-9f06-f862243e78d6', 'current_year_diff': 6, 'age_in_months': 72, 'make_model': 'opel corsa', 'sanitized_make': 'opel', 'odometer_in_km': 72764}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 72,
     'auction_title': '',
     'c_o_2_emission_value': 96,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:23:44z',
     'fuel_type': 'petrol',
     'id': 'e5cc9684-9d58-548f-9f06-f862243e78d6',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pc89884',
     'listing': 'auction',
     'location': 'fr, saint aignan de grandlieu',
     'make': 'opel',
     'make_model': 'opel corsa',
     'model': 'corsa',
     'odometer': 72764,
     'odometer_in_km': 72764,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-01-10',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel corsa 1.2 turbo gs line',
     'transmission': 'manual',
     'trim': 'gs line',
     'year': 2020}
2026-01-29 06:11:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: e5cc9684-9d58-548f-9f06-f862243e78d6 spider: auto1.fr
2026-01-29 06:11:40 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: e5cc9684-9d58-548f-9f06-f862243e78d6 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel corsa 1.2 turbo gs line', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'corsa', 'transmission': 'manual', 'odometer': 72764, 'odometer_reading_unit': 'km', 'registration_date': '2020-01-10', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pc89884', 'expiration_date': '2026-01-29t16:23:44z', 'origin_country_code': 'fr', 'trim': 'gs line', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, saint aignan de grandlieu', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 96, 'id': 'e5cc9684-9d58-548f-9f06-f862243e78d6', 'current_year_diff': 6, 'age_in_months': 72, 'make_model': 'opel corsa', 'sanitized_make': 'opel', 'odometer_in_km': 72764}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 72,
     'auction_title': '',
     'c_o_2_emission_value': 96,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:23:44z',
     'fuel_type': 'petrol',
     'id': 'e5cc9684-9d58-548f-9f06-f862243e78d6',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pc89884',
     'listing': 'auction',
     'location': 'fr, saint aignan de grandlieu',
     'make': 'opel',
     'make_model': 'opel corsa',
     'model': 'corsa',
     'odometer': 72764,
     'odometer_in_km': 72764,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-01-10',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel corsa 1.2 turbo gs line',
     'transmission': 'manual',
     'trim': 'gs line',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:23:44Z',
 'fuel_type': 'petrol',
 'id': 'e5cc9684-9d58-548f-9f06-f862243e78d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC89884',
 'listing': 'auction',
 'location': 'FR, Saint Aignan de Grandlieu',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 72764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Turbo GS Line',
 'transmission': 'manual',
 'trim': 'GS Line',
 'year': 2020}
2026-01-29 06:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PC89884%27 HTTP/1.1" 200 None
2026-01-29 06:11:40 [auto1.fr] INFO: Saving data for PC89884: {'auction_closing_time': 1769703824.0, 'created_time': 1768669478.249807, 'last_price_update_time': 1769667100.162031}
2026-01-29 06:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PC89884') HTTP/1.1" 204 0
2026-01-29 06:11:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UR78175/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WT57817> (referer: https://www.auto1.com/v1/car-details-view/WT57817/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 684a6215-7e21-5f7d-8d26-0eab41726bab with identifier: WT57817
2026-01-29 06:11:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 684a6215-7e21-5f7d-8d26-0eab41726bab with scrape type 2
2026-01-29 06:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 684a6215-7e21-5f7d-8d26-0eab41726bab with scrape type 2
2026-01-29 06:11:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 684a6215-7e21-5f7d-8d26-0eab41726bab, identifier: WT57817
2026-01-29 06:11:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 684a6215-7e21-5f7d-8d26-0eab41726bab with identifier: WT57817
2026-01-29 06:11:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 684a6215-7e21-5f7d-8d26-0eab41726bab with identifier: WT57817
2026-01-29 06:11:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine pack', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 43411, 'odometer_reading_unit': 'km', 'registration_date': '2021-09-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wt57817', 'expiration_date': '2026-01-29t16:18:45z', 'origin_country_code': 'fr', 'trim': 'shine pack', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, vezin-le-coquet', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 123, 'id': '684a6215-7e21-5f7d-8d26-0eab41726bab', 'current_year_diff': 5, 'age_in_months': 52, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 43411}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 52,
     'auction_title': '',
     'c_o_2_emission_value': 123,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:18:45z',
     'fuel_type': 'petrol',
     'id': '684a6215-7e21-5f7d-8d26-0eab41726bab',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wt57817',
     'listing': 'auction',
     'location': 'fr, vezin-le-coquet',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 43411,
     'odometer_in_km': 43411,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-09-26',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech shine pack',
     'transmission': 'manual',
     'trim': 'shine pack',
     'year': 2021}
2026-01-29 06:11:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 684a6215-7e21-5f7d-8d26-0eab41726bab spider: auto1.fr
2026-01-29 06:11:40 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 684a6215-7e21-5f7d-8d26-0eab41726bab due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine pack', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 43411, 'odometer_reading_unit': 'km', 'registration_date': '2021-09-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wt57817', 'expiration_date': '2026-01-29t16:18:45z', 'origin_country_code': 'fr', 'trim': 'shine pack', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, vezin-le-coquet', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 123, 'id': '684a6215-7e21-5f7d-8d26-0eab41726bab', 'current_year_diff': 5, 'age_in_months': 52, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 43411}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 52,
     'auction_title': '',
     'c_o_2_emission_value': 123,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:18:45z',
     'fuel_type': 'petrol',
     'id': '684a6215-7e21-5f7d-8d26-0eab41726bab',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wt57817',
     'listing': 'auction',
     'location': 'fr, vezin-le-coquet',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 43411,
     'odometer_in_km': 43411,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-09-26',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech shine pack',
     'transmission': 'manual',
     'trim': 'shine pack',
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:18:45Z',
 'fuel_type': 'petrol',
 'id': '684a6215-7e21-5f7d-8d26-0eab41726bab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT57817',
 'listing': 'auction',
 'location': 'FR, Vezin-le-Coquet',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 43411,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Shine Pack',
 'transmission': 'manual',
 'trim': 'Shine Pack',
 'year': 2021}
2026-01-29 06:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WT57817%27 HTTP/1.1" 200 None
2026-01-29 06:11:40 [auto1.fr] INFO: Saving data for WT57817: {'auction_closing_time': 1769703525.0, 'created_time': 1768497016.527185, 'last_price_update_time': 1769667100.897288}
2026-01-29 06:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WT57817') HTTP/1.1" 204 0
2026-01-29 06:11:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZS29376> (referer: https://www.auto1.com/v1/car-details-view/ZS29376/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7395e7af-231d-55c6-825d-300bf77ec181 with identifier: ZS29376
2026-01-29 06:11:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7395e7af-231d-55c6-825d-300bf77ec181 with scrape type 2
2026-01-29 06:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7395e7af-231d-55c6-825d-300bf77ec181 with scrape type 2
2026-01-29 06:11:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7395e7af-231d-55c6-825d-300bf77ec181, identifier: ZS29376
2026-01-29 06:11:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7395e7af-231d-55c6-825d-300bf77ec181 with identifier: ZS29376
2026-01-29 06:11:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7395e7af-231d-55c6-825d-300bf77ec181 with identifier: ZS29376
2026-01-29 06:11:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 170643 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    170643
2026-01-29 06:11:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 7395e7af-231d-55c6-825d-300bf77ec181 spider: auto1.fr
2026-01-29 06:11:41 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 7395e7af-231d-55c6-825d-300bf77ec181 due to rule: high_mileage_for_country.json, error: 170643 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    170643
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:16:59Z',
 'fuel_type': 'diesel',
 'id': '7395e7af-231d-55c6-825d-300bf77ec181',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS29376',
 'listing': 'auction',
 'location': 'FR, Aubière',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 170643,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro S Line',
 'transmission': 'automatic',
 'trim': 'quattro S Line',
 'year': 2018}
2026-01-29 06:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZS29376%27 HTTP/1.1" 200 None
2026-01-29 06:11:41 [auto1.fr] INFO: Saving data for ZS29376: {'auction_closing_time': 1769703419.0, 'created_time': 1769533872.389983, 'last_price_update_time': 1769667101.876992}
2026-01-29 06:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZS29376') HTTP/1.1" 204 0
2026-01-29 06:11:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AN91682/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YV46639/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZH27356/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PU76778> (referer: https://www.auto1.com/v1/car-details-view/PU76778/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24f108c5-743b-5c16-991f-fa1e35064160 with identifier: PU76778
2026-01-29 06:11:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24f108c5-743b-5c16-991f-fa1e35064160 with scrape type 2
2026-01-29 06:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24f108c5-743b-5c16-991f-fa1e35064160 with scrape type 2
2026-01-29 06:11:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 24f108c5-743b-5c16-991f-fa1e35064160, identifier: PU76778
2026-01-29 06:11:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 24f108c5-743b-5c16-991f-fa1e35064160 with identifier: PU76778
2026-01-29 06:11:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 24f108c5-743b-5c16-991f-fa1e35064160 with identifier: PU76778
2026-01-29 06:11:44 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2026-01-29 06:11:44 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 24f108c5-743b-5c16-991f-fa1e35064160 spider: auto1.fr
2026-01-29 06:11:44 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 24f108c5-743b-5c16-991f-fa1e35064160 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:44:08Z',
 'fuel_type': 'diesel',
 'id': '24f108c5-743b-5c16-991f-fa1e35064160',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU76778',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 58164,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-17',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Peugeot Partner 1.5 Blue-HDi Premium L1',
 'transmission': 'manual',
 'trim': 'Premium L1',
 'year': 2021}
2026-01-29 06:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PU76778%27 HTTP/1.1" 200 None
2026-01-29 06:11:44 [auto1.fr] INFO: Saving data for PU76778: {'auction_closing_time': 1769705048.0, 'created_time': 1769580476.39866, 'last_price_update_time': 1769667104.982109}
2026-01-29 06:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PU76778') HTTP/1.1" 204 0
2026-01-29 06:11:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZB44249> (referer: https://www.auto1.com/v1/car-details-view/ZB44249/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 187b03a2-6d38-5676-81dd-1d46833dccfc with identifier: ZB44249
2026-01-29 06:11:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 187b03a2-6d38-5676-81dd-1d46833dccfc with scrape type 2
2026-01-29 06:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 187b03a2-6d38-5676-81dd-1d46833dccfc with scrape type 2
2026-01-29 06:11:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 187b03a2-6d38-5676-81dd-1d46833dccfc, identifier: ZB44249
2026-01-29 06:11:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 187b03a2-6d38-5676-81dd-1d46833dccfc with identifier: ZB44249
2026-01-29 06:11:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 187b03a2-6d38-5676-81dd-1d46833dccfc with identifier: ZB44249
2026-01-29 06:11:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 187b03a2-6d38-5676-81dd-1d46833dccfc with identifier: ZB44249 to the API
2026-01-29 06:11:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:11:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:11:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZB44249>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:30:52Z',
 'fuel_type': 'petrol',
 'id': '187b03a2-6d38-5676-81dd-1d46833dccfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB44249',
 'listing': 'auction',
 'location': 'FR, Nanteuil-le-Haudouin',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 56227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2020}
2026-01-29 06:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZB44249%27 HTTP/1.1" 200 None
2026-01-29 06:11:45 [auto1.fr] INFO: Saving data for ZB44249: {'auction_closing_time': 1769704252.0, 'created_time': 1769076367.044191, 'last_price_update_time': 1769667105.541279}
2026-01-29 06:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZB44249') HTTP/1.1" 204 0
2026-01-29 06:11:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YL11984> (referer: https://www.auto1.com/v1/car-details-view/YL11984/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bbe3e71-ae36-5c1e-ad4a-d6059712bc3a with identifier: YL11984
2026-01-29 06:11:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bbe3e71-ae36-5c1e-ad4a-d6059712bc3a with scrape type 2
2026-01-29 06:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bbe3e71-ae36-5c1e-ad4a-d6059712bc3a with scrape type 2
2026-01-29 06:11:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5bbe3e71-ae36-5c1e-ad4a-d6059712bc3a, identifier: YL11984
2026-01-29 06:11:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5bbe3e71-ae36-5c1e-ad4a-d6059712bc3a with identifier: YL11984
2026-01-29 06:11:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5bbe3e71-ae36-5c1e-ad4a-d6059712bc3a with identifier: YL11984
2026-01-29 06:11:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech gt pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 104074, 'odometer_reading_unit': 'km', 'registration_date': '2021-05-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yl11984', 'expiration_date': '2026-01-29t16:20:50z', 'origin_country_code': 'fr', 'trim': 'gt pack', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, houecourt', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 135, 'id': '5bbe3e71-ae36-5c1e-ad4a-d6059712bc3a', 'current_year_diff': 5, 'age_in_months': 56, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 104074}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 56,
     'auction_title': '',
     'c_o_2_emission_value': 135,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:20:50z',
     'fuel_type': 'petrol',
     'id': '5bbe3e71-ae36-5c1e-ad4a-d6059712bc3a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yl11984',
     'listing': 'auction',
     'location': 'fr, houecourt',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 104074,
     'odometer_in_km': 104074,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-05-24',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech gt pack',
     'transmission': 'automatic',
     'trim': 'gt pack',
     'year': 2021}
2026-01-29 06:11:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 5bbe3e71-ae36-5c1e-ad4a-d6059712bc3a spider: auto1.fr
2026-01-29 06:11:47 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 5bbe3e71-ae36-5c1e-ad4a-d6059712bc3a due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech gt pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 104074, 'odometer_reading_unit': 'km', 'registration_date': '2021-05-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yl11984', 'expiration_date': '2026-01-29t16:20:50z', 'origin_country_code': 'fr', 'trim': 'gt pack', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, houecourt', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 135, 'id': '5bbe3e71-ae36-5c1e-ad4a-d6059712bc3a', 'current_year_diff': 5, 'age_in_months': 56, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 104074}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 56,
     'auction_title': '',
     'c_o_2_emission_value': 135,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:20:50z',
     'fuel_type': 'petrol',
     'id': '5bbe3e71-ae36-5c1e-ad4a-d6059712bc3a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yl11984',
     'listing': 'auction',
     'location': 'fr, houecourt',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 104074,
     'odometer_in_km': 104074,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-05-24',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech gt pack',
     'transmission': 'automatic',
     'trim': 'gt pack',
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:20:50Z',
 'fuel_type': 'petrol',
 'id': '5bbe3e71-ae36-5c1e-ad4a-d6059712bc3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL11984',
 'listing': 'auction',
 'location': 'FR, Houecourt',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 104074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech GT Pack',
 'transmission': 'automatic',
 'trim': 'GT Pack',
 'year': 2021}
2026-01-29 06:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YL11984%27 HTTP/1.1" 200 None
2026-01-29 06:11:47 [auto1.fr] INFO: Saving data for YL11984: {'auction_closing_time': 1769703650.0, 'created_time': 1769534422.917313, 'last_price_update_time': 1769667107.463806}
2026-01-29 06:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YL11984') HTTP/1.1" 204 0
2026-01-29 06:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YU72456> (referer: https://www.auto1.com/v1/car-details-view/YU72456/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4859a4c8-b71c-57da-b319-13c4632bba8e with identifier: YU72456
2026-01-29 06:11:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4859a4c8-b71c-57da-b319-13c4632bba8e with scrape type 2
2026-01-29 06:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4859a4c8-b71c-57da-b319-13c4632bba8e with scrape type 2
2026-01-29 06:11:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4859a4c8-b71c-57da-b319-13c4632bba8e, identifier: YU72456
2026-01-29 06:11:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4859a4c8-b71c-57da-b319-13c4632bba8e with identifier: YU72456
2026-01-29 06:11:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4859a4c8-b71c-57da-b319-13c4632bba8e with identifier: YU72456
2026-01-29 06:11:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 5008 1.2 puretech style', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '5008', 'transmission': 'manual', 'odometer': 149820, 'odometer_reading_unit': 'km', 'registration_date': '2020-09-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yu72456', 'expiration_date': '2026-01-29t16:01:19z', 'origin_country_code': 'fr', 'trim': 'style', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'échirolles', 'category': None, 'seats_number': 7, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 150, 'id': '4859a4c8-b71c-57da-b319-13c4632bba8e', 'current_year_diff': 6, 'age_in_months': 64, 'make_model': 'peugeot 5008', 'sanitized_make': 'peugeot', 'odometer_in_km': 149820}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 64,
     'auction_title': '',
     'c_o_2_emission_value': 150,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:01:19z',
     'fuel_type': 'petrol',
     'id': '4859a4c8-b71c-57da-b319-13c4632bba8e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yu72456',
     'listing': 'auction',
     'location': 'échirolles',
     'make': 'peugeot',
     'make_model': 'peugeot 5008',
     'model': '5008',
     'odometer': 149820,
     'odometer_in_km': 149820,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-09-24',
     'sanitized_make': 'peugeot',
     'seats_number': 7,
     'seller_name': None,
     'title': 'peugeot 5008 1.2 puretech style',
     'transmission': 'manual',
     'trim': 'style',
     'year': 2020}
2026-01-29 06:11:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 4859a4c8-b71c-57da-b319-13c4632bba8e spider: auto1.fr
2026-01-29 06:11:53 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 4859a4c8-b71c-57da-b319-13c4632bba8e due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 5008 1.2 puretech style', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '5008', 'transmission': 'manual', 'odometer': 149820, 'odometer_reading_unit': 'km', 'registration_date': '2020-09-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yu72456', 'expiration_date': '2026-01-29t16:01:19z', 'origin_country_code': 'fr', 'trim': 'style', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'échirolles', 'category': None, 'seats_number': 7, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 150, 'id': '4859a4c8-b71c-57da-b319-13c4632bba8e', 'current_year_diff': 6, 'age_in_months': 64, 'make_model': 'peugeot 5008', 'sanitized_make': 'peugeot', 'odometer_in_km': 149820}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 64,
     'auction_title': '',
     'c_o_2_emission_value': 150,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:01:19z',
     'fuel_type': 'petrol',
     'id': '4859a4c8-b71c-57da-b319-13c4632bba8e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yu72456',
     'listing': 'auction',
     'location': 'échirolles',
     'make': 'peugeot',
     'make_model': 'peugeot 5008',
     'model': '5008',
     'odometer': 149820,
     'odometer_in_km': 149820,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-09-24',
     'sanitized_make': 'peugeot',
     'seats_number': 7,
     'seller_name': None,
     'title': 'peugeot 5008 1.2 puretech style',
     'transmission': 'manual',
     'trim': 'style',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:01:19Z',
 'fuel_type': 'petrol',
 'id': '4859a4c8-b71c-57da-b319-13c4632bba8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU72456',
 'listing': 'auction',
 'location': 'Échirolles',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 149820,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-24',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 1.2 PureTech Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2020}
2026-01-29 06:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YU72456%27 HTTP/1.1" 200 None
2026-01-29 06:11:53 [auto1.fr] INFO: Saving data for YU72456: {'auction_closing_time': 1769702479.0, 'created_time': 1769447639.126487, 'last_price_update_time': 1769667113.185057}
2026-01-29 06:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YU72456') HTTP/1.1" 204 0
2026-01-29 06:11:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DX73001> (referer: https://www.auto1.com/v1/car-details-view/DX73001/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15184e95-0980-543c-bc54-12280e6013b2 with identifier: DX73001
2026-01-29 06:11:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15184e95-0980-543c-bc54-12280e6013b2 with scrape type 2
2026-01-29 06:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15184e95-0980-543c-bc54-12280e6013b2 with scrape type 2
2026-01-29 06:11:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 15184e95-0980-543c-bc54-12280e6013b2, identifier: DX73001
2026-01-29 06:11:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 15184e95-0980-543c-bc54-12280e6013b2 with identifier: DX73001
2026-01-29 06:11:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 15184e95-0980-543c-bc54-12280e6013b2 with identifier: DX73001
2026-01-29 06:11:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
2026-01-29 06:11:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 15184e95-0980-543c-bc54-12280e6013b2 spider: auto1.fr
2026-01-29 06:11:53 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 15184e95-0980-543c-bc54-12280e6013b2 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:32:57Z',
 'fuel_type': 'diesel',
 'id': '15184e95-0980-543c-bc54-12280e6013b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX73001',
 'listing': 'auction',
 'location': 'FR, TARNOS',
 'make': 'Opel',
 'model': 'Combo',
 'odometer': 77505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-27',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Opel Combo 1.5 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2021}
2026-01-29 06:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DX73001%27 HTTP/1.1" 200 None
2026-01-29 06:11:53 [auto1.fr] INFO: Saving data for DX73001: {'auction_closing_time': 1769704377.0, 'created_time': 1769534077.543202, 'last_price_update_time': 1769667113.596601}
2026-01-29 06:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DX73001') HTTP/1.1" 204 0
2026-01-29 06:11:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CC48472/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RU36122/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MP93997/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BK65220/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AN91682> (referer: https://www.auto1.com/v1/car-details-view/AN91682/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:11:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:11:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4755ed62-5150-5afa-b330-0d9e56023d29 with identifier: AN91682
2026-01-29 06:11:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4755ed62-5150-5afa-b330-0d9e56023d29 with scrape type 2
2026-01-29 06:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4755ed62-5150-5afa-b330-0d9e56023d29 with scrape type 2
2026-01-29 06:11:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4755ed62-5150-5afa-b330-0d9e56023d29, identifier: AN91682
2026-01-29 06:11:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4755ed62-5150-5afa-b330-0d9e56023d29 with identifier: AN91682
2026-01-29 06:11:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4755ed62-5150-5afa-b330-0d9e56023d29 with identifier: AN91682
2026-01-29 06:11:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 150735 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150735
2026-01-29 06:11:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 4755ed62-5150-5afa-b330-0d9e56023d29 spider: auto1.fr
2026-01-29 06:11:59 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 4755ed62-5150-5afa-b330-0d9e56023d29 due to rule: high_mileage_for_country.json, error: 150735 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150735
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:54:42Z',
 'fuel_type': 'diesel',
 'id': '4755ed62-5150-5afa-b330-0d9e56023d29',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN91682',
 'listing': 'auction',
 'location': 'FR, \u200bCHEVIGNY-SAINT-SAUVEUR',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 150735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q2 1.6 TDI Design',
 'transmission': 'automatic',
 'trim': 'Design',
 'year': 2020}
2026-01-29 06:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AN91682%27 HTTP/1.1" 200 None
2026-01-29 06:11:59 [auto1.fr] INFO: Saving data for AN91682: {'auction_closing_time': 1769705682.0, 'created_time': 1769580178.46227, 'last_price_update_time': 1769667119.965923}
2026-01-29 06:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AN91682') HTTP/1.1" 204 0
2026-01-29 06:12:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UR78175> (referer: https://www.auto1.com/v1/car-details-view/UR78175/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:12:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:12:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eaf18c2b-1c88-5a78-8ea4-eeac57f7cd03 with identifier: UR78175
2026-01-29 06:12:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eaf18c2b-1c88-5a78-8ea4-eeac57f7cd03 with scrape type 2
2026-01-29 06:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eaf18c2b-1c88-5a78-8ea4-eeac57f7cd03 with scrape type 2
2026-01-29 06:12:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: eaf18c2b-1c88-5a78-8ea4-eeac57f7cd03, identifier: UR78175
2026-01-29 06:12:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: eaf18c2b-1c88-5a78-8ea4-eeac57f7cd03 with identifier: UR78175
2026-01-29 06:12:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: eaf18c2b-1c88-5a78-8ea4-eeac57f7cd03 with identifier: UR78175
2026-01-29 06:12:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 144311 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    144311
2026-01-29 06:12:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: eaf18c2b-1c88-5a78-8ea4-eeac57f7cd03 spider: auto1.fr
2026-01-29 06:12:01 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: eaf18c2b-1c88-5a78-8ea4-eeac57f7cd03 due to rule: high_mileage_for_make.json, error: 144311 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    144311
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 205,
 'expiration_date': '2026-01-29T16:29:50Z',
 'fuel_type': 'petrol',
 'id': 'eaf18c2b-1c88-5a78-8ea4-eeac57f7cd03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR78175',
 'listing': 'auction',
 'location': 'FR, Nanteuil-le-Haudouin',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 144311,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.6 TCe Energy GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2017}
2026-01-29 06:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UR78175%27 HTTP/1.1" 200 None
2026-01-29 06:12:01 [auto1.fr] INFO: Saving data for UR78175: {'auction_closing_time': 1769704190.0, 'created_time': 1767116555.773399, 'last_price_update_time': 1769667121.399348}
2026-01-29 06:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UR78175') HTTP/1.1" 204 0
2026-01-29 06:12:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YV46639> (referer: https://www.auto1.com/v1/car-details-view/YV46639/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:12:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:12:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a05a9db0-cc99-5051-a04c-d2fc6410e733 with identifier: YV46639
2026-01-29 06:12:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a05a9db0-cc99-5051-a04c-d2fc6410e733 with scrape type 2
2026-01-29 06:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a05a9db0-cc99-5051-a04c-d2fc6410e733 with scrape type 2
2026-01-29 06:12:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a05a9db0-cc99-5051-a04c-d2fc6410e733, identifier: YV46639
2026-01-29 06:12:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a05a9db0-cc99-5051-a04c-d2fc6410e733 with identifier: YV46639
2026-01-29 06:12:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a05a9db0-cc99-5051-a04c-d2fc6410e733 with identifier: YV46639
2026-01-29 06:12:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c5 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c5 aircross', 'transmission': 'automatic', 'odometer': 18617, 'odometer_reading_unit': 'km', 'registration_date': '2023-07-17', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yv46639', 'expiration_date': '2026-01-29t16:12:40z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'tradein', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'a05a9db0-cc99-5051-a04c-d2fc6410e733', 'current_year_diff': 3, 'age_in_months': 30, 'make_model': 'citroen c5 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 18617}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 30,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:12:40z',
     'fuel_type': 'petrol',
     'id': 'a05a9db0-cc99-5051-a04c-d2fc6410e733',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yv46639',
     'listing': 'auction',
     'location': 'tradein',
     'make': 'citroen',
     'make_model': 'citroen c5 aircross',
     'model': 'c5 aircross',
     'odometer': 18617,
     'odometer_in_km': 18617,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-07-17',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c5 aircross 1.2 puretech shine',
     'transmission': 'automatic',
     'trim': 'shine',
     'year': 2023}
2026-01-29 06:12:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: a05a9db0-cc99-5051-a04c-d2fc6410e733 spider: auto1.fr
2026-01-29 06:12:01 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: a05a9db0-cc99-5051-a04c-d2fc6410e733 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c5 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c5 aircross', 'transmission': 'automatic', 'odometer': 18617, 'odometer_reading_unit': 'km', 'registration_date': '2023-07-17', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yv46639', 'expiration_date': '2026-01-29t16:12:40z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'tradein', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'a05a9db0-cc99-5051-a04c-d2fc6410e733', 'current_year_diff': 3, 'age_in_months': 30, 'make_model': 'citroen c5 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 18617}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 30,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:12:40z',
     'fuel_type': 'petrol',
     'id': 'a05a9db0-cc99-5051-a04c-d2fc6410e733',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yv46639',
     'listing': 'auction',
     'location': 'tradein',
     'make': 'citroen',
     'make_model': 'citroen c5 aircross',
     'model': 'c5 aircross',
     'odometer': 18617,
     'odometer_in_km': 18617,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-07-17',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c5 aircross 1.2 puretech shine',
     'transmission': 'automatic',
     'trim': 'shine',
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:12:40Z',
 'fuel_type': 'petrol',
 'id': 'a05a9db0-cc99-5051-a04c-d2fc6410e733',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV46639',
 'listing': 'auction',
 'location': 'Tradein',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 18617,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.2 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2023}
2026-01-29 06:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YV46639%27 HTTP/1.1" 200 None
2026-01-29 06:12:01 [auto1.fr] INFO: Saving data for YV46639: {'auction_closing_time': 1769703160.0, 'created_time': 1769533572.274856, 'last_price_update_time': 1769667121.943689}
2026-01-29 06:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YV46639') HTTP/1.1" 204 0
2026-01-29 06:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZH27356> (referer: https://www.auto1.com/v1/car-details-view/ZH27356/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:12:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:12:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2883c683-67d2-5c47-b5d2-e23c50da70c6 with identifier: ZH27356
2026-01-29 06:12:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2883c683-67d2-5c47-b5d2-e23c50da70c6 with scrape type 2
2026-01-29 06:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2883c683-67d2-5c47-b5d2-e23c50da70c6 with scrape type 2
2026-01-29 06:12:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2883c683-67d2-5c47-b5d2-e23c50da70c6, identifier: ZH27356
2026-01-29 06:12:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2883c683-67d2-5c47-b5d2-e23c50da70c6 with identifier: ZH27356
2026-01-29 06:12:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2883c683-67d2-5c47-b5d2-e23c50da70c6 with identifier: ZH27356
2026-01-29 06:12:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2883c683-67d2-5c47-b5d2-e23c50da70c6 with identifier: ZH27356 to the API
2026-01-29 06:12:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:12:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:12:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZH27356>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 158,
 'expiration_date': '2026-01-29T16:28:07Z',
 'fuel_type': 'petrol',
 'id': '2883c683-67d2-5c47-b5d2-e23c50da70c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH27356',
 'listing': 'auction',
 'location': 'FR, Vezin-le-Coquet',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 104743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T Mild-Hybrid Acenta',
 'transmission': 'automatic',
 'trim': 'Acenta',
 'year': 2022}
2026-01-29 06:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZH27356%27 HTTP/1.1" 200 None
2026-01-29 06:12:02 [auto1.fr] INFO: Saving data for ZH27356: {'auction_closing_time': 1769704087.0, 'created_time': 1769447312.995134, 'last_price_update_time': 1769667122.996658}
2026-01-29 06:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZH27356') HTTP/1.1" 204 0
2026-01-29 06:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GB80904/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:12:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GF93089/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:12:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:12:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CC48472> (referer: https://www.auto1.com/v1/car-details-view/CC48472/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:12:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:12:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23330a61-35a2-53fd-9a48-c7a490b3c835 with identifier: CC48472
2026-01-29 06:12:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23330a61-35a2-53fd-9a48-c7a490b3c835 with scrape type 2
2026-01-29 06:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23330a61-35a2-53fd-9a48-c7a490b3c835 with scrape type 2
2026-01-29 06:12:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 23330a61-35a2-53fd-9a48-c7a490b3c835, identifier: CC48472
2026-01-29 06:12:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 23330a61-35a2-53fd-9a48-c7a490b3c835 with identifier: CC48472
2026-01-29 06:12:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 23330a61-35a2-53fd-9a48-c7a490b3c835 with identifier: CC48472
2026-01-29 06:12:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 23330a61-35a2-53fd-9a48-c7a490b3c835 with identifier: CC48472 to the API
2026-01-29 06:12:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:12:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:12:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CC48472>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:45:17Z',
 'fuel_type': 'diesel',
 'id': '23330a61-35a2-53fd-9a48-c7a490b3c835',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC48472',
 'listing': 'auction',
 'location': 'FR, Saint Aignan de Grandlieu',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 102796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi Active Pack',
 'transmission': 'manual',
 'trim': 'Active Pack',
 'year': 2022}
2026-01-29 06:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CC48472%27 HTTP/1.1" 200 None
2026-01-29 06:12:06 [auto1.fr] INFO: Saving data for CC48472: {'auction_closing_time': 1769705117.0, 'created_time': 1768412772.312328, 'last_price_update_time': 1769667126.502567}
2026-01-29 06:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CC48472') HTTP/1.1" 204 0
2026-01-29 06:12:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FA72836/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:12:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:12:12 [scrapy.extensions.logstats] INFO: Crawled 979 pages (at 53 pages/min), scraped 212 items (at 9 items/min)
2026-01-29 06:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FR65157/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:12:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YK05298/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:12:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BK65220> (referer: https://www.auto1.com/v1/car-details-view/BK65220/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:12:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:12:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f6cfa14-6646-50cf-b019-be5b5813ffd3 with identifier: BK65220
2026-01-29 06:12:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f6cfa14-6646-50cf-b019-be5b5813ffd3 with scrape type 2
2026-01-29 06:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f6cfa14-6646-50cf-b019-be5b5813ffd3 with scrape type 2
2026-01-29 06:12:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6f6cfa14-6646-50cf-b019-be5b5813ffd3, identifier: BK65220
2026-01-29 06:12:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6f6cfa14-6646-50cf-b019-be5b5813ffd3 with identifier: BK65220
2026-01-29 06:12:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6f6cfa14-6646-50cf-b019-be5b5813ffd3 with identifier: BK65220
2026-01-29 06:12:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'beige', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'manual', 'odometer': 31598, 'odometer_reading_unit': 'km', 'registration_date': '2020-11-17', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/bk65220', 'expiration_date': '2026-01-29t16:07:11z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 142, 'id': '6f6cfa14-6646-50cf-b019-be5b5813ffd3', 'current_year_diff': 6, 'age_in_months': 62, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 31598}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 62,
     'auction_title': '',
     'c_o_2_emission_value': 142,
     'category': None,
     'color': 'beige',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:07:11z',
     'fuel_type': 'petrol',
     'id': '6f6cfa14-6646-50cf-b019-be5b5813ffd3',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/bk65220',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'citroen',
     'make_model': 'citroen c3 aircross',
     'model': 'c3 aircross',
     'odometer': 31598,
     'odometer_in_km': 31598,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-11-17',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 aircross 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2020}
2026-01-29 06:12:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 6f6cfa14-6646-50cf-b019-be5b5813ffd3 spider: auto1.fr
2026-01-29 06:12:14 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 6f6cfa14-6646-50cf-b019-be5b5813ffd3 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'beige', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'manual', 'odometer': 31598, 'odometer_reading_unit': 'km', 'registration_date': '2020-11-17', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/bk65220', 'expiration_date': '2026-01-29t16:07:11z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 142, 'id': '6f6cfa14-6646-50cf-b019-be5b5813ffd3', 'current_year_diff': 6, 'age_in_months': 62, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 31598}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 62,
     'auction_title': '',
     'c_o_2_emission_value': 142,
     'category': None,
     'color': 'beige',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:07:11z',
     'fuel_type': 'petrol',
     'id': '6f6cfa14-6646-50cf-b019-be5b5813ffd3',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/bk65220',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'citroen',
     'make_model': 'citroen c3 aircross',
     'model': 'c3 aircross',
     'odometer': 31598,
     'odometer_in_km': 31598,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-11-17',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 aircross 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:07:11Z',
 'fuel_type': 'petrol',
 'id': '6f6cfa14-6646-50cf-b019-be5b5813ffd3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK65220',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 31598,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2020}
2026-01-29 06:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BK65220%27 HTTP/1.1" 200 None
2026-01-29 06:12:14 [auto1.fr] INFO: Saving data for BK65220: {'auction_closing_time': 1769702831.0, 'created_time': 1768890998.991383, 'last_price_update_time': 1769667134.062756}
2026-01-29 06:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BK65220') HTTP/1.1" 204 0
2026-01-29 06:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MM14413> (referer: https://www.auto1.com/v1/car-details-view/MM14413/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CF72788/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:12:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:12:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:12:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f42e267c-94f1-5d6f-8597-db037120f900 with identifier: MM14413
2026-01-29 06:12:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f42e267c-94f1-5d6f-8597-db037120f900 with scrape type 2
2026-01-29 06:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f42e267c-94f1-5d6f-8597-db037120f900 with scrape type 2
2026-01-29 06:12:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f42e267c-94f1-5d6f-8597-db037120f900, identifier: MM14413
2026-01-29 06:12:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f42e267c-94f1-5d6f-8597-db037120f900 with identifier: MM14413
2026-01-29 06:12:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f42e267c-94f1-5d6f-8597-db037120f900 with identifier: MM14413
2026-01-29 06:12:14 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'fiat 500 1.2 lounge', 'price': 0, 'currency': 'eur', 'make': 'fiat', 'model': '500', 'transmission': 'manual', 'odometer': 83274, 'odometer_reading_unit': 'km', 'registration_date': '2018-05-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mm14413', 'expiration_date': '2026-01-29t16:34:12z', 'origin_country_code': 'fr', 'trim': 'lounge', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 70, 'doors_number': 3, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, beaucaire', 'category': None, 'seats_number': 4, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 115, 'id': 'f42e267c-94f1-5d6f-8597-db037120f900', 'current_year_diff': 8, 'age_in_months': 92, 'make_model': 'fiat 500', 'sanitized_make': 'fiat', 'odometer_in_km': 83274}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 92,
     'auction_title': '',
     'c_o_2_emission_value': 115,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 3,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 70,
     'expiration_date': '2026-01-29t16:34:12z',
     'fuel_type': 'petrol',
     'id': 'f42e267c-94f1-5d6f-8597-db037120f900',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mm14413',
     'listing': 'auction',
     'location': 'fr, beaucaire',
     'make': 'fiat',
     'make_model': 'fiat 500',
     'model': '500',
     'odometer': 83274,
     'odometer_in_km': 83274,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-05-29',
     'sanitized_make': 'fiat',
     'seats_number': 4,
     'seller_name': None,
     'title': 'fiat 500 1.2 lounge',
     'transmission': 'manual',
     'trim': 'lounge',
     'year': 2018}
2026-01-29 06:12:14 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: f42e267c-94f1-5d6f-8597-db037120f900 spider: auto1.fr
2026-01-29 06:12:14 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: f42e267c-94f1-5d6f-8597-db037120f900 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'fiat 500 1.2 lounge', 'price': 0, 'currency': 'eur', 'make': 'fiat', 'model': '500', 'transmission': 'manual', 'odometer': 83274, 'odometer_reading_unit': 'km', 'registration_date': '2018-05-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mm14413', 'expiration_date': '2026-01-29t16:34:12z', 'origin_country_code': 'fr', 'trim': 'lounge', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 70, 'doors_number': 3, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, beaucaire', 'category': None, 'seats_number': 4, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 115, 'id': 'f42e267c-94f1-5d6f-8597-db037120f900', 'current_year_diff': 8, 'age_in_months': 92, 'make_model': 'fiat 500', 'sanitized_make': 'fiat', 'odometer_in_km': 83274}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 92,
     'auction_title': '',
     'c_o_2_emission_value': 115,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 3,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 70,
     'expiration_date': '2026-01-29t16:34:12z',
     'fuel_type': 'petrol',
     'id': 'f42e267c-94f1-5d6f-8597-db037120f900',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mm14413',
     'listing': 'auction',
     'location': 'fr, beaucaire',
     'make': 'fiat',
     'make_model': 'fiat 500',
     'model': '500',
     'odometer': 83274,
     'odometer_in_km': 83274,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-05-29',
     'sanitized_make': 'fiat',
     'seats_number': 4,
     'seller_name': None,
     'title': 'fiat 500 1.2 lounge',
     'transmission': 'manual',
     'trim': 'lounge',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-01-29T16:34:12Z',
 'fuel_type': 'petrol',
 'id': 'f42e267c-94f1-5d6f-8597-db037120f900',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM14413',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Fiat',
 'model': '500',
 'odometer': 83274,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2018}
2026-01-29 06:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MM14413%27 HTTP/1.1" 200 None
2026-01-29 06:12:14 [auto1.fr] INFO: Saving data for MM14413: {'auction_closing_time': 1769704452.0, 'created_time': 1768240281.649121, 'last_price_update_time': 1769667134.483204}
2026-01-29 06:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MM14413') HTTP/1.1" 204 0
2026-01-29 06:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YD21894/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:12:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZV25464/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:12:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GF93089> (referer: https://www.auto1.com/v1/car-details-view/GF93089/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:12:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:12:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0863bcd7-cf32-5218-8115-0d7e04c40720 with identifier: GF93089
2026-01-29 06:12:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0863bcd7-cf32-5218-8115-0d7e04c40720 with scrape type 2
2026-01-29 06:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0863bcd7-cf32-5218-8115-0d7e04c40720 with scrape type 2
2026-01-29 06:12:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0863bcd7-cf32-5218-8115-0d7e04c40720, identifier: GF93089
2026-01-29 06:12:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0863bcd7-cf32-5218-8115-0d7e04c40720 with identifier: GF93089
2026-01-29 06:12:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0863bcd7-cf32-5218-8115-0d7e04c40720 with identifier: GF93089
2026-01-29 06:12:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo ultimate', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'automatic', 'odometer': 82626, 'odometer_reading_unit': 'km', 'registration_date': '2019-02-03', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gf93089', 'expiration_date': '2026-01-29t16:38:39z', 'origin_country_code': 'fr', 'trim': 'ultimate', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ambarès-et-lagrave', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 114, 'id': '0863bcd7-cf32-5218-8115-0d7e04c40720', 'current_year_diff': 7, 'age_in_months': 83, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 82626}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 83,
     'auction_title': '',
     'c_o_2_emission_value': 114,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:38:39z',
     'fuel_type': 'petrol',
     'id': '0863bcd7-cf32-5218-8115-0d7e04c40720',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gf93089',
     'listing': 'auction',
     'location': 'fr, ambarès-et-lagrave',
     'make': 'opel',
     'make_model': 'opel crossland x',
     'model': 'crossland x',
     'odometer': 82626,
     'odometer_in_km': 82626,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-02-03',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel crossland x 1.2 turbo ultimate',
     'transmission': 'automatic',
     'trim': 'ultimate',
     'year': 2019}
2026-01-29 06:12:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 0863bcd7-cf32-5218-8115-0d7e04c40720 spider: auto1.fr
2026-01-29 06:12:22 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 0863bcd7-cf32-5218-8115-0d7e04c40720 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo ultimate', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'automatic', 'odometer': 82626, 'odometer_reading_unit': 'km', 'registration_date': '2019-02-03', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gf93089', 'expiration_date': '2026-01-29t16:38:39z', 'origin_country_code': 'fr', 'trim': 'ultimate', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ambarès-et-lagrave', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 114, 'id': '0863bcd7-cf32-5218-8115-0d7e04c40720', 'current_year_diff': 7, 'age_in_months': 83, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 82626}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 83,
     'auction_title': '',
     'c_o_2_emission_value': 114,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:38:39z',
     'fuel_type': 'petrol',
     'id': '0863bcd7-cf32-5218-8115-0d7e04c40720',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gf93089',
     'listing': 'auction',
     'location': 'fr, ambarès-et-lagrave',
     'make': 'opel',
     'make_model': 'opel crossland x',
     'model': 'crossland x',
     'odometer': 82626,
     'odometer_in_km': 82626,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-02-03',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel crossland x 1.2 turbo ultimate',
     'transmission': 'automatic',
     'trim': 'ultimate',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:38:39Z',
 'fuel_type': 'petrol',
 'id': '0863bcd7-cf32-5218-8115-0d7e04c40720',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF93089',
 'listing': 'auction',
 'location': 'FR, Ambarès-et-Lagrave',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 82626,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo Ultimate',
 'transmission': 'automatic',
 'trim': 'Ultimate',
 'year': 2019}
2026-01-29 06:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF93089%27 HTTP/1.1" 200 None
2026-01-29 06:12:22 [auto1.fr] INFO: Saving data for GF93089: {'auction_closing_time': 1769704719.0, 'created_time': 1767633725.575014, 'last_price_update_time': 1769667142.583529}
2026-01-29 06:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GF93089') HTTP/1.1" 204 0
2026-01-29 06:12:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RU36122> (referer: https://www.auto1.com/v1/car-details-view/RU36122/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:12:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:12:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb3a33b9-820a-5171-aeeb-1ca3cfda3e11 with identifier: RU36122
2026-01-29 06:12:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb3a33b9-820a-5171-aeeb-1ca3cfda3e11 with scrape type 2
2026-01-29 06:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb3a33b9-820a-5171-aeeb-1ca3cfda3e11 with scrape type 2
2026-01-29 06:12:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: eb3a33b9-820a-5171-aeeb-1ca3cfda3e11, identifier: RU36122
2026-01-29 06:12:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: eb3a33b9-820a-5171-aeeb-1ca3cfda3e11 with identifier: RU36122
2026-01-29 06:12:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: eb3a33b9-820a-5171-aeeb-1ca3cfda3e11 with identifier: RU36122
2026-01-29 06:12:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: eb3a33b9-820a-5171-aeeb-1ca3cfda3e11 with identifier: RU36122 to the API
2026-01-29 06:12:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:12:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:12:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RU36122>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 135,
 'expiration_date': '2026-01-29T16:20:10Z',
 'fuel_type': 'petrol',
 'id': 'eb3a33b9-820a-5171-aeeb-1ca3cfda3e11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU36122',
 'listing': 'auction',
 'location': 'FR, Montataire',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 111554,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman Cooper Chili',
 'transmission': 'automatic',
 'trim': 'Chili',
 'year': 2018}
2026-01-29 06:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RU36122%27 HTTP/1.1" 200 None
2026-01-29 06:12:26 [auto1.fr] INFO: Saving data for RU36122: {'auction_closing_time': 1769703610.0, 'created_time': 1769534160.886317, 'last_price_update_time': 1769667146.607505}
2026-01-29 06:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RU36122') HTTP/1.1" 204 0
2026-01-29 06:12:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DD38700/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:12:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FA72836> (referer: https://www.auto1.com/v1/car-details-view/FA72836/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:12:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:12:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51f9eb81-5871-5653-8347-8b731afed12f with identifier: FA72836
2026-01-29 06:12:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51f9eb81-5871-5653-8347-8b731afed12f with scrape type 2
2026-01-29 06:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51f9eb81-5871-5653-8347-8b731afed12f with scrape type 2
2026-01-29 06:12:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 51f9eb81-5871-5653-8347-8b731afed12f, identifier: FA72836
2026-01-29 06:12:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 51f9eb81-5871-5653-8347-8b731afed12f with identifier: FA72836
2026-01-29 06:12:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 51f9eb81-5871-5653-8347-8b731afed12f with identifier: FA72836
2026-01-29 06:12:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'manual', 'odometer': 44472, 'odometer_reading_unit': 'km', 'registration_date': '2022-11-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fa72836', 'expiration_date': '2026-01-29t16:34:54z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 134, 'id': '51f9eb81-5871-5653-8347-8b731afed12f', 'current_year_diff': 4, 'age_in_months': 38, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 44472}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 38,
     'auction_title': '',
     'c_o_2_emission_value': 134,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:34:54z',
     'fuel_type': 'petrol',
     'id': '51f9eb81-5871-5653-8347-8b731afed12f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fa72836',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'citroen',
     'make_model': 'citroen c3 aircross',
     'model': 'c3 aircross',
     'odometer': 44472,
     'odometer_in_km': 44472,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-11-29',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 aircross 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2022}
2026-01-29 06:12:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 51f9eb81-5871-5653-8347-8b731afed12f spider: auto1.fr
2026-01-29 06:12:36 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 51f9eb81-5871-5653-8347-8b731afed12f due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'manual', 'odometer': 44472, 'odometer_reading_unit': 'km', 'registration_date': '2022-11-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fa72836', 'expiration_date': '2026-01-29t16:34:54z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 134, 'id': '51f9eb81-5871-5653-8347-8b731afed12f', 'current_year_diff': 4, 'age_in_months': 38, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 44472}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 38,
     'auction_title': '',
     'c_o_2_emission_value': 134,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:34:54z',
     'fuel_type': 'petrol',
     'id': '51f9eb81-5871-5653-8347-8b731afed12f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fa72836',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'citroen',
     'make_model': 'citroen c3 aircross',
     'model': 'c3 aircross',
     'odometer': 44472,
     'odometer_in_km': 44472,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-11-29',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 aircross 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:34:54Z',
 'fuel_type': 'petrol',
 'id': '51f9eb81-5871-5653-8347-8b731afed12f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA72836',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 44472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2022}
2026-01-29 06:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FA72836%27 HTTP/1.1" 200 None
2026-01-29 06:12:36 [auto1.fr] INFO: Saving data for FA72836: {'auction_closing_time': 1769704494.0, 'created_time': 1769448289.750373, 'last_price_update_time': 1769667156.701621}
2026-01-29 06:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FA72836') HTTP/1.1" 204 0
2026-01-29 06:12:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MP93997> (referer: https://www.auto1.com/v1/car-details-view/MP93997/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:12:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:12:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf4cbd2c-c8d2-5bc7-928a-512612d44719 with identifier: MP93997
2026-01-29 06:12:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf4cbd2c-c8d2-5bc7-928a-512612d44719 with scrape type 2
2026-01-29 06:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf4cbd2c-c8d2-5bc7-928a-512612d44719 with scrape type 2
2026-01-29 06:12:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cf4cbd2c-c8d2-5bc7-928a-512612d44719, identifier: MP93997
2026-01-29 06:12:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cf4cbd2c-c8d2-5bc7-928a-512612d44719 with identifier: MP93997
2026-01-29 06:12:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cf4cbd2c-c8d2-5bc7-928a-512612d44719 with identifier: MP93997
2026-01-29 06:12:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cf4cbd2c-c8d2-5bc7-928a-512612d44719 with identifier: MP93997 to the API
2026-01-29 06:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:12:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:12:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MP93997>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:14:43Z',
 'fuel_type': 'diesel',
 'id': 'cf4cbd2c-c8d2-5bc7-928a-512612d44719',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP93997',
 'listing': 'auction',
 'location': 'FR, Ambarès-et-Lagrave',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 132408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Carat BlueMotion',
 'transmission': 'automatic',
 'trim': 'Carat BlueMotion',
 'year': 2017}
2026-01-29 06:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP93997%27 HTTP/1.1" 200 None
2026-01-29 06:12:41 [auto1.fr] INFO: Saving data for MP93997: {'auction_closing_time': 1769703283.0, 'created_time': 1769534139.793095, 'last_price_update_time': 1769667161.298538}
2026-01-29 06:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MP93997') HTTP/1.1" 204 0
2026-01-29 06:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EP80781/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:12:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FP23517/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:12:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KY64795/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:12:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:12:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YK05298> (referer: https://www.auto1.com/v1/car-details-view/YK05298/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:12:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:12:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FR65157> (referer: https://www.auto1.com/v1/car-details-view/FR65157/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:12:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:12:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b21b498e-4fce-51d9-aeb1-cdba84585d38 with identifier: YK05298
2026-01-29 06:12:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b21b498e-4fce-51d9-aeb1-cdba84585d38 with scrape type 2
2026-01-29 06:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b21b498e-4fce-51d9-aeb1-cdba84585d38 with scrape type 2
2026-01-29 06:12:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b21b498e-4fce-51d9-aeb1-cdba84585d38, identifier: YK05298
2026-01-29 06:12:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b21b498e-4fce-51d9-aeb1-cdba84585d38 with identifier: YK05298
2026-01-29 06:12:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b21b498e-4fce-51d9-aeb1-cdba84585d38 with identifier: YK05298
2026-01-29 06:12:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 170019 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    170019
2026-01-29 06:12:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b21b498e-4fce-51d9-aeb1-cdba84585d38 spider: auto1.fr
2026-01-29 06:12:54 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: b21b498e-4fce-51d9-aeb1-cdba84585d38 due to rule: high_mileage_for_country.json, error: 170019 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    170019
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:16:39Z',
 'fuel_type': 'diesel',
 'id': 'b21b498e-4fce-51d9-aeb1-cdba84585d38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK05298',
 'listing': 'auction',
 'location': 'FR, Quincieux',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 170019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-24',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2017}
2026-01-29 06:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YK05298%27 HTTP/1.1" 200 None
2026-01-29 06:12:54 [auto1.fr] INFO: Saving data for YK05298: {'auction_closing_time': 1769703399.0, 'created_time': 1768992580.207362, 'last_price_update_time': 1769667174.981436}
2026-01-29 06:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YK05298') HTTP/1.1" 204 0
2026-01-29 06:12:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89221045-202f-5e03-a481-cba28d4643df with identifier: FR65157
2026-01-29 06:12:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89221045-202f-5e03-a481-cba28d4643df with scrape type 2
2026-01-29 06:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89221045-202f-5e03-a481-cba28d4643df with scrape type 2
2026-01-29 06:12:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 89221045-202f-5e03-a481-cba28d4643df, identifier: FR65157
2026-01-29 06:12:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 89221045-202f-5e03-a481-cba28d4643df with identifier: FR65157
2026-01-29 06:12:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 89221045-202f-5e03-a481-cba28d4643df with identifier: FR65157
2026-01-29 06:12:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 89221045-202f-5e03-a481-cba28d4643df with identifier: FR65157 to the API
2026-01-29 06:12:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:12:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:12:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FR65157>
{'auction_title': '',
 'c_o_2_emission_value': 89,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:03:59Z',
 'fuel_type': 'diesel',
 'id': '89221045-202f-5e03-a481-cba28d4643df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR65157',
 'listing': 'auction',
 'location': 'FR, TARNOS',
 'make': 'BMW',
 'model': '1er',
 'odometer': 118069,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116d EfficientDynamics Lounge',
 'transmission': 'manual',
 'trim': 'EfficientDynamics Lounge',
 'year': 2017}
2026-01-29 06:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FR65157%27 HTTP/1.1" 200 None
2026-01-29 06:12:56 [auto1.fr] INFO: Saving data for FR65157: {'auction_closing_time': 1769702639.0, 'created_time': 1768889191.733277, 'last_price_update_time': 1769667176.361766}
2026-01-29 06:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FR65157') HTTP/1.1" 204 0
2026-01-29 06:12:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CF72788> (referer: https://www.auto1.com/v1/car-details-view/CF72788/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:12:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:12:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e568a11c-c866-548b-8c66-b664b720d45b with identifier: CF72788
2026-01-29 06:12:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e568a11c-c866-548b-8c66-b664b720d45b with scrape type 2
2026-01-29 06:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e568a11c-c866-548b-8c66-b664b720d45b with scrape type 2
2026-01-29 06:12:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e568a11c-c866-548b-8c66-b664b720d45b, identifier: CF72788
2026-01-29 06:12:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e568a11c-c866-548b-8c66-b664b720d45b with identifier: CF72788
2026-01-29 06:12:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e568a11c-c866-548b-8c66-b664b720d45b with identifier: CF72788
2026-01-29 06:12:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 154537 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    154537
2026-01-29 06:12:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: e568a11c-c866-548b-8c66-b664b720d45b spider: auto1.fr
2026-01-29 06:12:58 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: e568a11c-c866-548b-8c66-b664b720d45b due to rule: high_mileage_for_country.json, error: 154537 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    154537
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:55:44Z',
 'fuel_type': 'diesel',
 'id': 'e568a11c-c866-548b-8c66-b664b720d45b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF72788',
 'listing': 'auction',
 'location': 'FR, LE HAVRE',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 154537,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-01',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TDI Carat',
 'transmission': 'automatic',
 'trim': 'Carat',
 'year': 2019}
2026-01-29 06:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CF72788%27 HTTP/1.1" 200 None
2026-01-29 06:12:58 [auto1.fr] INFO: Saving data for CF72788: {'auction_closing_time': 1769705744.0, 'created_time': 1769533538.690087, 'last_price_update_time': 1769667178.993382}
2026-01-29 06:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CF72788') HTTP/1.1" 204 0
2026-01-29 06:12:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YD21894> (referer: https://www.auto1.com/v1/car-details-view/YD21894/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:12:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:12:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 966d1349-d329-5838-a863-9acbac0e6878 with identifier: YD21894
2026-01-29 06:12:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 966d1349-d329-5838-a863-9acbac0e6878 with scrape type 2
2026-01-29 06:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 966d1349-d329-5838-a863-9acbac0e6878 with scrape type 2
2026-01-29 06:12:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 966d1349-d329-5838-a863-9acbac0e6878, identifier: YD21894
2026-01-29 06:12:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 966d1349-d329-5838-a863-9acbac0e6878 with identifier: YD21894
2026-01-29 06:12:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 966d1349-d329-5838-a863-9acbac0e6878 with identifier: YD21894
2026-01-29 06:12:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 74211, 'odometer_reading_unit': 'km', 'registration_date': '2018-07-25', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yd21894', 'expiration_date': '2026-01-29t16:14:21z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, saint aignan de grandlieu', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 129, 'id': '966d1349-d329-5838-a863-9acbac0e6878', 'current_year_diff': 8, 'age_in_months': 90, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 74211}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 90,
     'auction_title': '',
     'c_o_2_emission_value': 129,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:14:21z',
     'fuel_type': 'petrol',
     'id': '966d1349-d329-5838-a863-9acbac0e6878',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yd21894',
     'listing': 'auction',
     'location': 'fr, saint aignan de grandlieu',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 74211,
     'odometer_in_km': 74211,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-07-25',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 puretech allure',
     'transmission': 'automatic',
     'trim': 'allure',
     'year': 2018}
2026-01-29 06:12:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 966d1349-d329-5838-a863-9acbac0e6878 spider: auto1.fr
2026-01-29 06:12:59 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 966d1349-d329-5838-a863-9acbac0e6878 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 74211, 'odometer_reading_unit': 'km', 'registration_date': '2018-07-25', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yd21894', 'expiration_date': '2026-01-29t16:14:21z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, saint aignan de grandlieu', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 129, 'id': '966d1349-d329-5838-a863-9acbac0e6878', 'current_year_diff': 8, 'age_in_months': 90, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 74211}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 90,
     'auction_title': '',
     'c_o_2_emission_value': 129,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:14:21z',
     'fuel_type': 'petrol',
     'id': '966d1349-d329-5838-a863-9acbac0e6878',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yd21894',
     'listing': 'auction',
     'location': 'fr, saint aignan de grandlieu',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 74211,
     'odometer_in_km': 74211,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-07-25',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 puretech allure',
     'transmission': 'automatic',
     'trim': 'allure',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:14:21Z',
 'fuel_type': 'petrol',
 'id': '966d1349-d329-5838-a863-9acbac0e6878',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD21894',
 'listing': 'auction',
 'location': 'FR, Saint Aignan de Grandlieu',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 74211,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2018}
2026-01-29 06:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YD21894%27 HTTP/1.1" 200 None
2026-01-29 06:12:59 [auto1.fr] INFO: Saving data for YD21894: {'auction_closing_time': 1769703261.0, 'created_time': 1769016931.003303, 'last_price_update_time': 1769667179.436141}
2026-01-29 06:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YD21894') HTTP/1.1" 204 0
2026-01-29 06:13:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZV25464> (referer: https://www.auto1.com/v1/car-details-view/ZV25464/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:13:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:13:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7653a9b5-62ec-510a-b935-4bdb92098e2f with identifier: ZV25464
2026-01-29 06:13:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7653a9b5-62ec-510a-b935-4bdb92098e2f with scrape type 2
2026-01-29 06:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7653a9b5-62ec-510a-b935-4bdb92098e2f with scrape type 2
2026-01-29 06:13:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7653a9b5-62ec-510a-b935-4bdb92098e2f, identifier: ZV25464
2026-01-29 06:13:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7653a9b5-62ec-510a-b935-4bdb92098e2f with identifier: ZV25464
2026-01-29 06:13:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7653a9b5-62ec-510a-b935-4bdb92098e2f with identifier: ZV25464
2026-01-29 06:13:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 e-thp gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 92757, 'odometer_reading_unit': 'km', 'registration_date': '2017-07-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zv25464', 'expiration_date': '2026-01-29t16:21:27z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, mougins', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 120, 'id': '7653a9b5-62ec-510a-b935-4bdb92098e2f', 'current_year_diff': 9, 'age_in_months': 101, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 92757}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 101,
     'auction_title': '',
     'c_o_2_emission_value': 120,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:21:27z',
     'fuel_type': 'petrol',
     'id': '7653a9b5-62ec-510a-b935-4bdb92098e2f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zv25464',
     'listing': 'auction',
     'location': 'fr, mougins',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 92757,
     'odometer_in_km': 92757,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-07-30',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 e-thp gt line',
     'transmission': 'automatic',
     'trim': 'gt line',
     'year': 2017}
2026-01-29 06:13:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 7653a9b5-62ec-510a-b935-4bdb92098e2f spider: auto1.fr
2026-01-29 06:13:02 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 7653a9b5-62ec-510a-b935-4bdb92098e2f due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 e-thp gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 92757, 'odometer_reading_unit': 'km', 'registration_date': '2017-07-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zv25464', 'expiration_date': '2026-01-29t16:21:27z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, mougins', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 120, 'id': '7653a9b5-62ec-510a-b935-4bdb92098e2f', 'current_year_diff': 9, 'age_in_months': 101, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 92757}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 101,
     'auction_title': '',
     'c_o_2_emission_value': 120,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:21:27z',
     'fuel_type': 'petrol',
     'id': '7653a9b5-62ec-510a-b935-4bdb92098e2f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zv25464',
     'listing': 'auction',
     'location': 'fr, mougins',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 92757,
     'odometer_in_km': 92757,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-07-30',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 e-thp gt line',
     'transmission': 'automatic',
     'trim': 'gt line',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:21:27Z',
 'fuel_type': 'petrol',
 'id': '7653a9b5-62ec-510a-b935-4bdb92098e2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV25464',
 'listing': 'auction',
 'location': 'FR, MOUGINS',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 92757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 e-THP GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2017}
2026-01-29 06:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZV25464%27 HTTP/1.1" 200 None
2026-01-29 06:13:02 [auto1.fr] INFO: Saving data for ZV25464: {'auction_closing_time': 1769703687.0, 'created_time': 1767373675.237035, 'last_price_update_time': 1769667182.203797}
2026-01-29 06:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZV25464') HTTP/1.1" 204 0
2026-01-29 06:13:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DD38700> (referer: https://www.auto1.com/v1/car-details-view/DD38700/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:13:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:13:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d3569a5-8b7f-5418-b617-5f28dcf6686a with identifier: DD38700
2026-01-29 06:13:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d3569a5-8b7f-5418-b617-5f28dcf6686a with scrape type 2
2026-01-29 06:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d3569a5-8b7f-5418-b617-5f28dcf6686a with scrape type 2
2026-01-29 06:13:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5d3569a5-8b7f-5418-b617-5f28dcf6686a, identifier: DD38700
2026-01-29 06:13:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5d3569a5-8b7f-5418-b617-5f28dcf6686a with identifier: DD38700
2026-01-29 06:13:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5d3569a5-8b7f-5418-b617-5f28dcf6686a with identifier: DD38700
2026-01-29 06:13:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5d3569a5-8b7f-5418-b617-5f28dcf6686a with identifier: DD38700 to the API
2026-01-29 06:13:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:13:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:13:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DD38700>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 179,
 'expiration_date': '2026-01-29T16:17:13Z',
 'fuel_type': 'diesel',
 'id': '5d3569a5-8b7f-5418-b617-5f28dcf6686a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD38700',
 'listing': 'auction',
 'location': 'FR, Quincieux',
 'make': 'DS Automobiles',
 'model': 'DS7 Crossback',
 'odometer': 96654,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS Automobiles DS7 Crossback 2.0 Blue-HDi Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2020}
2026-01-29 06:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DD38700%27 HTTP/1.1" 200 None
2026-01-29 06:13:03 [auto1.fr] INFO: Saving data for DD38700: {'auction_closing_time': 1769703433.0, 'created_time': 1769449811.315885, 'last_price_update_time': 1769667183.161208}
2026-01-29 06:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DD38700') HTTP/1.1" 204 0
2026-01-29 06:13:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FX33542/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:13:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:13:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EP80781> (referer: https://www.auto1.com/v1/car-details-view/EP80781/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:13:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:13:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a4d13ee-db65-5566-bfc2-6298e412ff7d with identifier: EP80781
2026-01-29 06:13:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a4d13ee-db65-5566-bfc2-6298e412ff7d with scrape type 2
2026-01-29 06:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a4d13ee-db65-5566-bfc2-6298e412ff7d with scrape type 2
2026-01-29 06:13:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0a4d13ee-db65-5566-bfc2-6298e412ff7d, identifier: EP80781
2026-01-29 06:13:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0a4d13ee-db65-5566-bfc2-6298e412ff7d with identifier: EP80781
2026-01-29 06:13:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0a4d13ee-db65-5566-bfc2-6298e412ff7d with identifier: EP80781
2026-01-29 06:13:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 139627 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    139627
2026-01-29 06:13:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 0a4d13ee-db65-5566-bfc2-6298e412ff7d spider: auto1.fr
2026-01-29 06:13:08 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 0a4d13ee-db65-5566-bfc2-6298e412ff7d due to rule: high_mileage_for_make.json, error: 139627 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    139627
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:40:32Z',
 'fuel_type': 'diesel',
 'id': '0a4d13ee-db65-5566-bfc2-6298e412ff7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP80781',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'make': 'Renault',
 'model': 'Talisman',
 'odometer': 139627,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Talisman 1.6 dCi Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2017}
2026-01-29 06:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EP80781%27 HTTP/1.1" 200 None
2026-01-29 06:13:08 [auto1.fr] INFO: Saving data for EP80781: {'auction_closing_time': 1769704832.0, 'created_time': 1765386546.128644, 'last_price_update_time': 1769667188.271208}
2026-01-29 06:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EP80781') HTTP/1.1" 204 0
2026-01-29 06:13:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KA73998/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:13:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:13:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UT82553/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:13:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:13:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WU47710/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:13:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:13:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FP23517> (referer: https://www.auto1.com/v1/car-details-view/FP23517/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:13:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:13:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a969f855-a0b5-5d13-b423-5802ddd7ef5a with identifier: FP23517
2026-01-29 06:13:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a969f855-a0b5-5d13-b423-5802ddd7ef5a with scrape type 2
2026-01-29 06:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a969f855-a0b5-5d13-b423-5802ddd7ef5a with scrape type 2
2026-01-29 06:13:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a969f855-a0b5-5d13-b423-5802ddd7ef5a, identifier: FP23517
2026-01-29 06:13:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a969f855-a0b5-5d13-b423-5802ddd7ef5a with identifier: FP23517
2026-01-29 06:13:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a969f855-a0b5-5d13-b423-5802ddd7ef5a with identifier: FP23517
2026-01-29 06:13:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a969f855-a0b5-5d13-b423-5802ddd7ef5a with identifier: FP23517 to the API
2026-01-29 06:13:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:13:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:13:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FP23517>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-01-29T16:43:49Z',
 'fuel_type': 'petrol',
 'id': 'a969f855-a0b5-5d13-b423-5802ddd7ef5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP23517',
 'listing': 'auction',
 'location': 'FR, Ambarès-et-Lagrave',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 127143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost Titanium Business',
 'transmission': 'manual',
 'trim': 'Titanium Business',
 'year': 2018}
2026-01-29 06:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP23517%27 HTTP/1.1" 200 None
2026-01-29 06:13:10 [auto1.fr] INFO: Saving data for FP23517: {'auction_closing_time': 1769705029.0, 'created_time': 1768669469.421763, 'last_price_update_time': 1769667190.207058}
2026-01-29 06:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FP23517') HTTP/1.1" 204 0
2026-01-29 06:13:12 [scrapy.extensions.logstats] INFO: Crawled 1006 pages (at 27 pages/min), scraped 217 items (at 5 items/min)
2026-01-29 06:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KY64795> (referer: https://www.auto1.com/v1/car-details-view/KY64795/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:13:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:13:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 427309d1-ed4c-57de-a8f0-0109baa08fff with identifier: KY64795
2026-01-29 06:13:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 427309d1-ed4c-57de-a8f0-0109baa08fff with scrape type 2
2026-01-29 06:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 427309d1-ed4c-57de-a8f0-0109baa08fff with scrape type 2
2026-01-29 06:13:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 427309d1-ed4c-57de-a8f0-0109baa08fff, identifier: KY64795
2026-01-29 06:13:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 427309d1-ed4c-57de-a8f0-0109baa08fff with identifier: KY64795
2026-01-29 06:13:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 427309d1-ed4c-57de-a8f0-0109baa08fff with identifier: KY64795
2026-01-29 06:13:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 427309d1-ed4c-57de-a8f0-0109baa08fff with identifier: KY64795 to the API
2026-01-29 06:13:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:13:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KY64795>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'engine_horse_power': 197,
 'expiration_date': '2026-01-29T16:13:44Z',
 'fuel_type': 'hybrid',
 'id': '427309d1-ed4c-57de-a8f0-0109baa08fff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY64795',
 'listing': 'auction',
 'location': 'FR, Warluis',
 'make': 'Lexus',
 'model': 'NX-Serie',
 'odometer': 135193,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-08-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lexus NX-Serie NX 300h Pack Business',
 'transmission': 'automatic',
 'trim': 'Pack Business',
 'year': 2017}
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KY64795%27 HTTP/1.1" 200 None
2026-01-29 06:13:14 [auto1.fr] INFO: Saving data for KY64795: {'auction_closing_time': 1769703224.0, 'created_time': 1769101716.553402, 'last_price_update_time': 1769667194.357986}
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KY64795') HTTP/1.1" 204 0
2026-01-29 06:13:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:13:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:13:14 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:13:14 [auto1.fr] INFO: Found listing with ID: HK44152
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK44152%27 HTTP/1.1" 200 None
2026-01-29 06:13:14 [auto1.fr] INFO: Scrape type for HK44152: 0
2026-01-29 06:13:14 [auto1.fr] INFO: Found listing with ID: SM44179
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SM44179%27 HTTP/1.1" 200 None
2026-01-29 06:13:14 [auto1.fr] INFO: Scrape type for SM44179: 2
2026-01-29 06:13:14 [auto1.fr] INFO: Found listing with ID: UN04099
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN04099%27 HTTP/1.1" 200 None
2026-01-29 06:13:14 [auto1.fr] INFO: Scrape type for UN04099: 0
2026-01-29 06:13:14 [auto1.fr] INFO: Found listing with ID: TJ94698
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TJ94698%27 HTTP/1.1" 200 None
2026-01-29 06:13:14 [auto1.fr] INFO: Scrape type for TJ94698: 0
2026-01-29 06:13:14 [auto1.fr] INFO: Found listing with ID: UG53189
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG53189%27 HTTP/1.1" 200 None
2026-01-29 06:13:14 [auto1.fr] INFO: Scrape type for UG53189: 2
2026-01-29 06:13:14 [auto1.fr] INFO: Found listing with ID: DL63015
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DL63015%27 HTTP/1.1" 200 None
2026-01-29 06:13:14 [auto1.fr] INFO: Scrape type for DL63015: 2
2026-01-29 06:13:14 [auto1.fr] INFO: Found listing with ID: VW37702
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VW37702%27 HTTP/1.1" 200 None
2026-01-29 06:13:14 [auto1.fr] INFO: Scrape type for VW37702: 0
2026-01-29 06:13:14 [auto1.fr] INFO: Found listing with ID: RX11087
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RX11087%27 HTTP/1.1" 200 None
2026-01-29 06:13:14 [auto1.fr] INFO: Scrape type for RX11087: 0
2026-01-29 06:13:14 [auto1.fr] INFO: Found listing with ID: GS16359
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GS16359%27 HTTP/1.1" 200 None
2026-01-29 06:13:14 [auto1.fr] INFO: Scrape type for GS16359: 0
2026-01-29 06:13:14 [auto1.fr] INFO: Found listing with ID: EF72506
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF72506%27 HTTP/1.1" 200 None
2026-01-29 06:13:14 [auto1.fr] INFO: Scrape type for EF72506: 0
2026-01-29 06:13:14 [auto1.fr] INFO: Found listing with ID: JM95663
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JM95663%27 HTTP/1.1" 200 None
2026-01-29 06:13:14 [auto1.fr] INFO: Scrape type for JM95663: 0
2026-01-29 06:13:14 [auto1.fr] INFO: Found listing with ID: HN29767
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HN29767%27 HTTP/1.1" 200 None
2026-01-29 06:13:14 [auto1.fr] INFO: Scrape type for HN29767: 2
2026-01-29 06:13:14 [auto1.fr] INFO: Found listing with ID: CX03233
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CX03233%27 HTTP/1.1" 200 None
2026-01-29 06:13:14 [auto1.fr] INFO: Scrape type for CX03233: 2
2026-01-29 06:13:14 [auto1.fr] INFO: Found listing with ID: YY70759
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YY70759%27 HTTP/1.1" 200 None
2026-01-29 06:13:14 [auto1.fr] INFO: Scrape type for YY70759: 0
2026-01-29 06:13:14 [auto1.fr] INFO: Found listing with ID: YU57007
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YU57007%27 HTTP/1.1" 200 None
2026-01-29 06:13:14 [auto1.fr] INFO: Scrape type for YU57007: 2
2026-01-29 06:13:14 [auto1.fr] INFO: Found listing with ID: HY98668
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HY98668%27 HTTP/1.1" 200 None
2026-01-29 06:13:14 [auto1.fr] INFO: Scrape type for HY98668: 2
2026-01-29 06:13:14 [auto1.fr] INFO: Found listing with ID: HC30752
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC30752%27 HTTP/1.1" 200 None
2026-01-29 06:13:14 [auto1.fr] INFO: Scrape type for HC30752: 2
2026-01-29 06:13:14 [auto1.fr] INFO: Found listing with ID: EK54744
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EK54744%27 HTTP/1.1" 200 None
2026-01-29 06:13:14 [auto1.fr] INFO: Scrape type for EK54744: 0
2026-01-29 06:13:14 [auto1.fr] INFO: Found listing with ID: ZF17408
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZF17408%27 HTTP/1.1" 200 None
2026-01-29 06:13:14 [auto1.fr] INFO: Scrape type for ZF17408: 2
2026-01-29 06:13:14 [auto1.fr] INFO: Found listing with ID: UB67784
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UB67784%27 HTTP/1.1" 200 None
2026-01-29 06:13:14 [auto1.fr] INFO: Scrape type for UB67784: 2
2026-01-29 06:13:14 [auto1.fr] INFO: Found listing with ID: YN34701
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YN34701%27 HTTP/1.1" 200 None
2026-01-29 06:13:14 [auto1.fr] INFO: Scrape type for YN34701: 2
2026-01-29 06:13:14 [auto1.fr] INFO: Found listing with ID: PJ86495
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PJ86495%27 HTTP/1.1" 200 None
2026-01-29 06:13:14 [auto1.fr] INFO: Scrape type for PJ86495: 2
2026-01-29 06:13:14 [auto1.fr] INFO: Found listing with ID: VF13466
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VF13466%27 HTTP/1.1" 200 None
2026-01-29 06:13:14 [auto1.fr] INFO: Scrape type for VF13466: 2
2026-01-29 06:13:14 [auto1.fr] INFO: Found listing with ID: VW26097
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VW26097%27 HTTP/1.1" 200 None
2026-01-29 06:13:14 [auto1.fr] INFO: Scrape type for VW26097: 0
2026-01-29 06:13:14 [auto1.fr] INFO: Found listing with ID: VL36371
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL36371%27 HTTP/1.1" 200 None
2026-01-29 06:13:14 [auto1.fr] INFO: Scrape type for VL36371: 0
2026-01-29 06:13:14 [auto1.fr] INFO: Found listing with ID: WC54697
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WC54697%27 HTTP/1.1" 200 None
2026-01-29 06:13:14 [auto1.fr] INFO: Scrape type for WC54697: 2
2026-01-29 06:13:14 [auto1.fr] INFO: Found listing with ID: FS56323
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FS56323%27 HTTP/1.1" 200 None
2026-01-29 06:13:14 [auto1.fr] INFO: Scrape type for FS56323: 0
2026-01-29 06:13:14 [auto1.fr] INFO: Found listing with ID: DK54934
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DK54934%27 HTTP/1.1" 200 None
2026-01-29 06:13:14 [auto1.fr] INFO: Scrape type for DK54934: 0
2026-01-29 06:13:14 [auto1.fr] INFO: Found listing with ID: DM89058
2026-01-29 06:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DM89058%27 HTTP/1.1" 200 None
2026-01-29 06:13:15 [auto1.fr] INFO: Scrape type for DM89058: 2
2026-01-29 06:13:15 [auto1.fr] INFO: Found listing with ID: TK48837
2026-01-29 06:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TK48837%27 HTTP/1.1" 200 None
2026-01-29 06:13:15 [auto1.fr] INFO: Scrape type for TK48837: 0
2026-01-29 06:13:15 [auto1.fr] INFO: Found listing with ID: RW12493
2026-01-29 06:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RW12493%27 HTTP/1.1" 200 None
2026-01-29 06:13:15 [auto1.fr] INFO: Scrape type for RW12493: 0
2026-01-29 06:13:15 [auto1.fr] INFO: Found listing with ID: MK94315
2026-01-29 06:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MK94315%27 HTTP/1.1" 200 None
2026-01-29 06:13:15 [auto1.fr] INFO: Scrape type for MK94315: 2
2026-01-29 06:13:15 [auto1.fr] INFO: Found listing with ID: XM39362
2026-01-29 06:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XM39362%27 HTTP/1.1" 200 None
2026-01-29 06:13:15 [auto1.fr] INFO: Scrape type for XM39362: 2
2026-01-29 06:13:15 [auto1.fr] INFO: Found listing with ID: EP11372
2026-01-29 06:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EP11372%27 HTTP/1.1" 200 None
2026-01-29 06:13:15 [auto1.fr] INFO: Scrape type for EP11372: 0
2026-01-29 06:13:15 [auto1.fr] INFO: Found listing with ID: HM90919
2026-01-29 06:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HM90919%27 HTTP/1.1" 200 None
2026-01-29 06:13:15 [auto1.fr] INFO: Scrape type for HM90919: 2
2026-01-29 06:13:15 [auto1.fr] INFO: Found listing with ID: LK94761
2026-01-29 06:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LK94761%27 HTTP/1.1" 200 None
2026-01-29 06:13:15 [auto1.fr] INFO: Scrape type for LK94761: 2
2026-01-29 06:13:15 [auto1.fr] INFO: Found listing with ID: UF86479
2026-01-29 06:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UF86479%27 HTTP/1.1" 200 None
2026-01-29 06:13:15 [auto1.fr] INFO: Scrape type for UF86479: 0
2026-01-29 06:13:15 [auto1.fr] INFO: Found listing with ID: KJ19551
2026-01-29 06:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KJ19551%27 HTTP/1.1" 200 None
2026-01-29 06:13:15 [auto1.fr] INFO: Scrape type for KJ19551: 0
2026-01-29 06:13:15 [auto1.fr] INFO: Found listing with ID: SX46176
2026-01-29 06:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SX46176%27 HTTP/1.1" 200 None
2026-01-29 06:13:15 [auto1.fr] INFO: Scrape type for SX46176: 0
2026-01-29 06:13:15 [auto1.fr] INFO: Found listing with ID: GD51850
2026-01-29 06:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GD51850%27 HTTP/1.1" 200 None
2026-01-29 06:13:15 [auto1.fr] INFO: Scrape type for GD51850: 2
2026-01-29 06:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KA73998> (referer: https://www.auto1.com/v1/car-details-view/KA73998/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:13:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:13:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20e4cd11-686e-50a7-a163-05074c752a9f with identifier: KA73998
2026-01-29 06:13:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20e4cd11-686e-50a7-a163-05074c752a9f with scrape type 2
2026-01-29 06:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20e4cd11-686e-50a7-a163-05074c752a9f with scrape type 2
2026-01-29 06:13:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 20e4cd11-686e-50a7-a163-05074c752a9f, identifier: KA73998
2026-01-29 06:13:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 20e4cd11-686e-50a7-a163-05074c752a9f with identifier: KA73998
2026-01-29 06:13:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 20e4cd11-686e-50a7-a163-05074c752a9f with identifier: KA73998
2026-01-29 06:13:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 20e4cd11-686e-50a7-a163-05074c752a9f with identifier: KA73998 to the API
2026-01-29 06:13:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:13:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:13:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KA73998>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:50:34Z',
 'fuel_type': 'diesel',
 'id': '20e4cd11-686e-50a7-a163-05074c752a9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA73998',
 'listing': 'auction',
 'location': 'Nice',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 129419,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Carat Edition BlueMotion',
 'transmission': 'automatic',
 'trim': 'Carat Edition BlueMotion',
 'year': 2017}
2026-01-29 06:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KA73998%27 HTTP/1.1" 200 None
2026-01-29 06:13:15 [auto1.fr] INFO: Saving data for KA73998: {'auction_closing_time': 1769705434.0, 'created_time': 1769580139.534159, 'last_price_update_time': 1769667195.824233}
2026-01-29 06:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KA73998') HTTP/1.1" 204 0
2026-01-29 06:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FX33542> (referer: https://www.auto1.com/v1/car-details-view/FX33542/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:13:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:13:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6232999b-aecf-5fd8-a4f9-4bea9a906bc2 with identifier: FX33542
2026-01-29 06:13:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6232999b-aecf-5fd8-a4f9-4bea9a906bc2 with scrape type 2
2026-01-29 06:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6232999b-aecf-5fd8-a4f9-4bea9a906bc2 with scrape type 2
2026-01-29 06:13:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6232999b-aecf-5fd8-a4f9-4bea9a906bc2, identifier: FX33542
2026-01-29 06:13:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6232999b-aecf-5fd8-a4f9-4bea9a906bc2 with identifier: FX33542
2026-01-29 06:13:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6232999b-aecf-5fd8-a4f9-4bea9a906bc2 with identifier: FX33542
2026-01-29 06:13:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6232999b-aecf-5fd8-a4f9-4bea9a906bc2 with identifier: FX33542 to the API
2026-01-29 06:13:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:13:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:13:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FX33542>
{'auction_title': '',
 'c_o_2_emission_value': 35,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 158,
 'expiration_date': '2026-01-29T16:13:45Z',
 'fuel_type': 'hybrid',
 'id': '6232999b-aecf-5fd8-a4f9-4bea9a906bc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX33542',
 'listing': 'auction',
 'location': 'FR, Ludres',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 52161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.6 Hybrid E-Tech Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2020}
2026-01-29 06:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX33542%27 HTTP/1.1" 200 None
2026-01-29 06:13:18 [auto1.fr] INFO: Saving data for FX33542: {'auction_closing_time': 1769703225.0, 'created_time': 1769534690.108118, 'last_price_update_time': 1769667198.760154}
2026-01-29 06:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FX33542') HTTP/1.1" 204 0
2026-01-29 06:13:19 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.202(s), this was the 1st time calling it.
2026-01-29 06:13:19 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.522211517299488 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:13:19 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.448(s), this was the 1st time calling it.
2026-01-29 06:13:19 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.14585999897889 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:13:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:13:20 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:13:20 [auto1.fr] INFO: Found listing with ID: ZM68348
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZM68348%27 HTTP/1.1" 200 None
2026-01-29 06:13:20 [auto1.fr] INFO: Scrape type for ZM68348: 2
2026-01-29 06:13:20 [auto1.fr] INFO: Found listing with ID: JH09763
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JH09763%27 HTTP/1.1" 200 None
2026-01-29 06:13:20 [auto1.fr] INFO: Scrape type for JH09763: 2
2026-01-29 06:13:20 [auto1.fr] INFO: Found listing with ID: JH29899
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JH29899%27 HTTP/1.1" 200 None
2026-01-29 06:13:20 [auto1.fr] INFO: Scrape type for JH29899: 2
2026-01-29 06:13:20 [auto1.fr] INFO: Found listing with ID: LN59589
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LN59589%27 HTTP/1.1" 200 None
2026-01-29 06:13:20 [auto1.fr] INFO: Scrape type for LN59589: 0
2026-01-29 06:13:20 [auto1.fr] INFO: Found listing with ID: UM50969
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UM50969%27 HTTP/1.1" 200 None
2026-01-29 06:13:20 [auto1.fr] INFO: Scrape type for UM50969: 2
2026-01-29 06:13:20 [auto1.fr] INFO: Found listing with ID: XV49134
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XV49134%27 HTTP/1.1" 200 None
2026-01-29 06:13:20 [auto1.fr] INFO: Scrape type for XV49134: 0
2026-01-29 06:13:20 [auto1.fr] INFO: Found listing with ID: SH34132
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SH34132%27 HTTP/1.1" 200 None
2026-01-29 06:13:20 [auto1.fr] INFO: Scrape type for SH34132: 0
2026-01-29 06:13:20 [auto1.fr] INFO: Found listing with ID: HD08570
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HD08570%27 HTTP/1.1" 200 None
2026-01-29 06:13:20 [auto1.fr] INFO: Scrape type for HD08570: 0
2026-01-29 06:13:20 [auto1.fr] INFO: Found listing with ID: UN39248
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN39248%27 HTTP/1.1" 200 None
2026-01-29 06:13:20 [auto1.fr] INFO: Scrape type for UN39248: 0
2026-01-29 06:13:20 [auto1.fr] INFO: Found listing with ID: VY95359
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VY95359%27 HTTP/1.1" 200 None
2026-01-29 06:13:20 [auto1.fr] INFO: Scrape type for VY95359: 0
2026-01-29 06:13:20 [auto1.fr] INFO: Found listing with ID: VR57003
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VR57003%27 HTTP/1.1" 200 None
2026-01-29 06:13:20 [auto1.fr] INFO: Scrape type for VR57003: 2
2026-01-29 06:13:20 [auto1.fr] INFO: Found listing with ID: PE45154
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PE45154%27 HTTP/1.1" 200 None
2026-01-29 06:13:20 [auto1.fr] INFO: Scrape type for PE45154: 0
2026-01-29 06:13:20 [auto1.fr] INFO: Found listing with ID: RL45917
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RL45917%27 HTTP/1.1" 200 None
2026-01-29 06:13:20 [auto1.fr] INFO: Scrape type for RL45917: 0
2026-01-29 06:13:20 [auto1.fr] INFO: Found listing with ID: HX59090
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HX59090%27 HTTP/1.1" 200 None
2026-01-29 06:13:20 [auto1.fr] INFO: Scrape type for HX59090: 0
2026-01-29 06:13:20 [auto1.fr] INFO: Found listing with ID: CW50427
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CW50427%27 HTTP/1.1" 200 None
2026-01-29 06:13:20 [auto1.fr] INFO: Scrape type for CW50427: 0
2026-01-29 06:13:20 [auto1.fr] INFO: Found listing with ID: EB98592
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EB98592%27 HTTP/1.1" 200 None
2026-01-29 06:13:20 [auto1.fr] INFO: Scrape type for EB98592: 0
2026-01-29 06:13:20 [auto1.fr] INFO: Found listing with ID: EH00909
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EH00909%27 HTTP/1.1" 200 None
2026-01-29 06:13:20 [auto1.fr] INFO: Scrape type for EH00909: 0
2026-01-29 06:13:20 [auto1.fr] INFO: Found listing with ID: ZY80199
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZY80199%27 HTTP/1.1" 200 None
2026-01-29 06:13:20 [auto1.fr] INFO: Scrape type for ZY80199: 2
2026-01-29 06:13:20 [auto1.fr] INFO: Found listing with ID: PY84552
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY84552%27 HTTP/1.1" 200 None
2026-01-29 06:13:20 [auto1.fr] INFO: Scrape type for PY84552: 0
2026-01-29 06:13:20 [auto1.fr] INFO: Found listing with ID: KR61277
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KR61277%27 HTTP/1.1" 200 None
2026-01-29 06:13:20 [auto1.fr] INFO: Scrape type for KR61277: 2
2026-01-29 06:13:20 [auto1.fr] INFO: Found listing with ID: ZB11586
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZB11586%27 HTTP/1.1" 200 None
2026-01-29 06:13:20 [auto1.fr] INFO: Scrape type for ZB11586: 0
2026-01-29 06:13:20 [auto1.fr] INFO: Found listing with ID: SL61236
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL61236%27 HTTP/1.1" 200 None
2026-01-29 06:13:20 [auto1.fr] INFO: Scrape type for SL61236: 0
2026-01-29 06:13:20 [auto1.fr] INFO: Found listing with ID: NB27644
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NB27644%27 HTTP/1.1" 200 None
2026-01-29 06:13:20 [auto1.fr] INFO: Scrape type for NB27644: 0
2026-01-29 06:13:20 [auto1.fr] INFO: Found listing with ID: AR50282
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AR50282%27 HTTP/1.1" 200 None
2026-01-29 06:13:20 [auto1.fr] INFO: Scrape type for AR50282: 0
2026-01-29 06:13:20 [auto1.fr] INFO: Found listing with ID: ZH82888
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZH82888%27 HTTP/1.1" 200 None
2026-01-29 06:13:20 [auto1.fr] INFO: Scrape type for ZH82888: 2
2026-01-29 06:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UT82553> (referer: https://www.auto1.com/v1/car-details-view/UT82553/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:13:20 [auto1.fr] INFO: Found listing with ID: KG31618
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KG31618%27 HTTP/1.1" 200 None
2026-01-29 06:13:20 [auto1.fr] INFO: Scrape type for KG31618: 0
2026-01-29 06:13:20 [auto1.fr] INFO: Found listing with ID: WB03792
2026-01-29 06:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB03792%27 HTTP/1.1" 200 None
2026-01-29 06:13:21 [auto1.fr] INFO: Scrape type for WB03792: 2
2026-01-29 06:13:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:13:21 [auto1.fr] INFO: Found listing with ID: DA73241
2026-01-29 06:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DA73241%27 HTTP/1.1" 200 None
2026-01-29 06:13:21 [auto1.fr] INFO: Scrape type for DA73241: 2
2026-01-29 06:13:21 [auto1.fr] INFO: Found listing with ID: AF33449
2026-01-29 06:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AF33449%27 HTTP/1.1" 200 None
2026-01-29 06:13:21 [auto1.fr] INFO: Scrape type for AF33449: 0
2026-01-29 06:13:21 [auto1.fr] INFO: Found listing with ID: GW21712
2026-01-29 06:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GW21712%27 HTTP/1.1" 200 None
2026-01-29 06:13:21 [auto1.fr] INFO: Scrape type for GW21712: 2
2026-01-29 06:13:21 [auto1.fr] INFO: Found listing with ID: ZR68910
2026-01-29 06:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZR68910%27 HTTP/1.1" 200 None
2026-01-29 06:13:21 [auto1.fr] INFO: Scrape type for ZR68910: 2
2026-01-29 06:13:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30ab3d60-20c4-5682-ac12-c0f007cf1676 with identifier: UT82553
2026-01-29 06:13:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30ab3d60-20c4-5682-ac12-c0f007cf1676 with scrape type 2
2026-01-29 06:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30ab3d60-20c4-5682-ac12-c0f007cf1676 with scrape type 2
2026-01-29 06:13:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 30ab3d60-20c4-5682-ac12-c0f007cf1676, identifier: UT82553
2026-01-29 06:13:21 [auto1.fr] INFO: Found listing with ID: GY39228
2026-01-29 06:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GY39228%27 HTTP/1.1" 200 None
2026-01-29 06:13:21 [auto1.fr] INFO: Scrape type for GY39228: 0
2026-01-29 06:13:21 [auto1.fr] INFO: Found listing with ID: AD00547
2026-01-29 06:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AD00547%27 HTTP/1.1" 200 None
2026-01-29 06:13:21 [auto1.fr] INFO: Scrape type for AD00547: 0
2026-01-29 06:13:21 [auto1.fr] INFO: Found listing with ID: RL81844
2026-01-29 06:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RL81844%27 HTTP/1.1" 200 None
2026-01-29 06:13:21 [auto1.fr] INFO: Scrape type for RL81844: 2
2026-01-29 06:13:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 30ab3d60-20c4-5682-ac12-c0f007cf1676 with identifier: UT82553
2026-01-29 06:13:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 30ab3d60-20c4-5682-ac12-c0f007cf1676 with identifier: UT82553
2026-01-29 06:13:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 140415, 'odometer_reading_unit': 'km', 'registration_date': '2017-10-10', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ut82553', 'expiration_date': '2026-01-29t16:12:27z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 110, 'id': '30ab3d60-20c4-5682-ac12-c0f007cf1676', 'current_year_diff': 9, 'age_in_months': 99, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 140415}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 99,
     'auction_title': '',
     'c_o_2_emission_value': 110,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:12:27z',
     'fuel_type': 'petrol',
     'id': '30ab3d60-20c4-5682-ac12-c0f007cf1676',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ut82553',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 140415,
     'odometer_in_km': 140415,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-10-10',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'automatic',
     'trim': 'allure',
     'year': 2017}
2026-01-29 06:13:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 30ab3d60-20c4-5682-ac12-c0f007cf1676 spider: auto1.fr
2026-01-29 06:13:21 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 30ab3d60-20c4-5682-ac12-c0f007cf1676 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 140415, 'odometer_reading_unit': 'km', 'registration_date': '2017-10-10', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ut82553', 'expiration_date': '2026-01-29t16:12:27z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 110, 'id': '30ab3d60-20c4-5682-ac12-c0f007cf1676', 'current_year_diff': 9, 'age_in_months': 99, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 140415}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 99,
     'auction_title': '',
     'c_o_2_emission_value': 110,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:12:27z',
     'fuel_type': 'petrol',
     'id': '30ab3d60-20c4-5682-ac12-c0f007cf1676',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ut82553',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 140415,
     'odometer_in_km': 140415,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-10-10',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'automatic',
     'trim': 'allure',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:12:27Z',
 'fuel_type': 'petrol',
 'id': '30ab3d60-20c4-5682-ac12-c0f007cf1676',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT82553',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 140415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2017}
2026-01-29 06:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT82553%27 HTTP/1.1" 200 None
2026-01-29 06:13:21 [auto1.fr] INFO: Saving data for UT82553: {'auction_closing_time': 1769703147.0, 'created_time': 1768844550.80319, 'last_price_update_time': 1769667201.586295}
2026-01-29 06:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UT82553') HTTP/1.1" 204 0
2026-01-29 06:13:21 [auto1.fr] INFO: Found listing with ID: XB99079
2026-01-29 06:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB99079%27 HTTP/1.1" 200 None
2026-01-29 06:13:21 [auto1.fr] INFO: Scrape type for XB99079: 2
2026-01-29 06:13:21 [auto1.fr] INFO: Found listing with ID: TS69315
2026-01-29 06:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TS69315%27 HTTP/1.1" 200 None
2026-01-29 06:13:21 [auto1.fr] INFO: Scrape type for TS69315: 2
2026-01-29 06:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SM44179/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:13:21 [auto1.fr] INFO: Found listing with ID: XZ26589
2026-01-29 06:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XZ26589%27 HTTP/1.1" 200 None
2026-01-29 06:13:21 [auto1.fr] INFO: Scrape type for XZ26589: 0
2026-01-29 06:13:21 [auto1.fr] INFO: Found listing with ID: GA57851
2026-01-29 06:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GA57851%27 HTTP/1.1" 200 None
2026-01-29 06:13:21 [auto1.fr] INFO: Scrape type for GA57851: 0
2026-01-29 06:13:21 [auto1.fr] INFO: Found listing with ID: TZ83632
2026-01-29 06:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TZ83632%27 HTTP/1.1" 200 None
2026-01-29 06:13:21 [auto1.fr] INFO: Scrape type for TZ83632: 2
2026-01-29 06:13:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:13:21 [auto1.fr] INFO: Found listing with ID: PX39317
2026-01-29 06:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX39317%27 HTTP/1.1" 200 None
2026-01-29 06:13:21 [auto1.fr] INFO: Scrape type for PX39317: 2
2026-01-29 06:13:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:13:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:13:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UG53189/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:13:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:13:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DL63015/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:13:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:12 [scrapy.extensions.logstats] INFO: Crawled 1015 pages (at 9 pages/min), scraped 220 items (at 3 items/min)
2026-01-29 06:14:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CX03233/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YU57007/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GD51850/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LK94761/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HM90919/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZH82888/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TS69315/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SM44179> (referer: https://www.auto1.com/v1/car-details-view/SM44179/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03d370a8-8cc2-56d3-9574-552680f2605b with identifier: SM44179
2026-01-29 06:14:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03d370a8-8cc2-56d3-9574-552680f2605b with scrape type 2
2026-01-29 06:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03d370a8-8cc2-56d3-9574-552680f2605b with scrape type 2
2026-01-29 06:14:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 03d370a8-8cc2-56d3-9574-552680f2605b, identifier: SM44179
2026-01-29 06:14:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 03d370a8-8cc2-56d3-9574-552680f2605b with identifier: SM44179
2026-01-29 06:14:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 03d370a8-8cc2-56d3-9574-552680f2605b with identifier: SM44179
2026-01-29 06:14:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 03d370a8-8cc2-56d3-9574-552680f2605b with identifier: SM44179 to the API
2026-01-29 06:14:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:14:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:14:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SM44179>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:34:28Z',
 'fuel_type': 'diesel',
 'id': '03d370a8-8cc2-56d3-9574-552680f2605b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM44179',
 'listing': 'auction',
 'location': 'Camon',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 100897,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure Business',
 'transmission': 'automatic',
 'trim': 'Allure Business',
 'year': 2019}
2026-01-29 06:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SM44179%27 HTTP/1.1" 200 None
2026-01-29 06:14:19 [auto1.fr] INFO: Saving data for SM44179: {'auction_closing_time': 1769704468.0, 'created_time': 1769449289.468414, 'last_price_update_time': 1769667259.838797}
2026-01-29 06:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SM44179') HTTP/1.1" 204 0
2026-01-29 06:14:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WU47710> (referer: https://www.auto1.com/v1/car-details-view/WU47710/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de23fb3e-1d7a-5b8b-ae28-fe3e5e377f25 with identifier: WU47710
2026-01-29 06:14:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de23fb3e-1d7a-5b8b-ae28-fe3e5e377f25 with scrape type 2
2026-01-29 06:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de23fb3e-1d7a-5b8b-ae28-fe3e5e377f25 with scrape type 2
2026-01-29 06:14:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: de23fb3e-1d7a-5b8b-ae28-fe3e5e377f25, identifier: WU47710
2026-01-29 06:14:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: de23fb3e-1d7a-5b8b-ae28-fe3e5e377f25 with identifier: WU47710
2026-01-29 06:14:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: de23fb3e-1d7a-5b8b-ae28-fe3e5e377f25 with identifier: WU47710
2026-01-29 06:14:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: de23fb3e-1d7a-5b8b-ae28-fe3e5e377f25 with identifier: WU47710 to the API
2026-01-29 06:14:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:14:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:14:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WU47710>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:48:45Z',
 'fuel_type': 'petrol',
 'id': 'de23fb3e-1d7a-5b8b-ae28-fe3e5e377f25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU47710',
 'listing': 'auction',
 'location': 'FR, Le Boulou',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 83178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500X 1.0 Turbo Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2021}
2026-01-29 06:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU47710%27 HTTP/1.1" 200 None
2026-01-29 06:14:21 [auto1.fr] INFO: Saving data for WU47710: {'auction_closing_time': 1769705325.0, 'created_time': 1767027665.671934, 'last_price_update_time': 1769667261.481223}
2026-01-29 06:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WU47710') HTTP/1.1" 204 0
2026-01-29 06:14:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UG53189> (referer: https://www.auto1.com/v1/car-details-view/UG53189/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bb59a9e-4a16-55a9-be29-2380d4579afe with identifier: UG53189
2026-01-29 06:14:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bb59a9e-4a16-55a9-be29-2380d4579afe with scrape type 2
2026-01-29 06:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6bb59a9e-4a16-55a9-be29-2380d4579afe with scrape type 2
2026-01-29 06:14:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6bb59a9e-4a16-55a9-be29-2380d4579afe, identifier: UG53189
2026-01-29 06:14:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6bb59a9e-4a16-55a9-be29-2380d4579afe with identifier: UG53189
2026-01-29 06:14:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6bb59a9e-4a16-55a9-be29-2380d4579afe with identifier: UG53189
2026-01-29 06:14:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 86353, 'odometer_reading_unit': 'km', 'registration_date': '2017-04-20', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ug53189', 'expiration_date': '2026-01-29t16:13:01z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'biarritz', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 120, 'id': '6bb59a9e-4a16-55a9-be29-2380d4579afe', 'current_year_diff': 9, 'age_in_months': 105, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 86353}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 105,
     'auction_title': '',
     'c_o_2_emission_value': 120,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:13:01z',
     'fuel_type': 'petrol',
     'id': '6bb59a9e-4a16-55a9-be29-2380d4579afe',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ug53189',
     'listing': 'auction',
     'location': 'biarritz',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 86353,
     'odometer_in_km': 86353,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-04-20',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 puretech allure',
     'transmission': 'automatic',
     'trim': 'allure',
     'year': 2017}
2026-01-29 06:14:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 6bb59a9e-4a16-55a9-be29-2380d4579afe spider: auto1.fr
2026-01-29 06:14:21 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 6bb59a9e-4a16-55a9-be29-2380d4579afe due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 86353, 'odometer_reading_unit': 'km', 'registration_date': '2017-04-20', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ug53189', 'expiration_date': '2026-01-29t16:13:01z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'biarritz', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 120, 'id': '6bb59a9e-4a16-55a9-be29-2380d4579afe', 'current_year_diff': 9, 'age_in_months': 105, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 86353}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 105,
     'auction_title': '',
     'c_o_2_emission_value': 120,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:13:01z',
     'fuel_type': 'petrol',
     'id': '6bb59a9e-4a16-55a9-be29-2380d4579afe',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ug53189',
     'listing': 'auction',
     'location': 'biarritz',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 86353,
     'odometer_in_km': 86353,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-04-20',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 puretech allure',
     'transmission': 'automatic',
     'trim': 'allure',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:13:01Z',
 'fuel_type': 'petrol',
 'id': '6bb59a9e-4a16-55a9-be29-2380d4579afe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG53189',
 'listing': 'auction',
 'location': 'Biarritz',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 86353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2017}
2026-01-29 06:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG53189%27 HTTP/1.1" 200 None
2026-01-29 06:14:21 [auto1.fr] INFO: Saving data for UG53189: {'auction_closing_time': 1769703181.0, 'created_time': 1768844559.431349, 'last_price_update_time': 1769667261.92358}
2026-01-29 06:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UG53189') HTTP/1.1" 204 0
2026-01-29 06:14:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DL63015> (referer: https://www.auto1.com/v1/car-details-view/DL63015/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fc2f41f-842e-5eaa-a0bc-9d6f4bcc88bf with identifier: DL63015
2026-01-29 06:14:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fc2f41f-842e-5eaa-a0bc-9d6f4bcc88bf with scrape type 2
2026-01-29 06:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fc2f41f-842e-5eaa-a0bc-9d6f4bcc88bf with scrape type 2
2026-01-29 06:14:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4fc2f41f-842e-5eaa-a0bc-9d6f4bcc88bf, identifier: DL63015
2026-01-29 06:14:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4fc2f41f-842e-5eaa-a0bc-9d6f4bcc88bf with identifier: DL63015
2026-01-29 06:14:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4fc2f41f-842e-5eaa-a0bc-9d6f4bcc88bf with identifier: DL63015
2026-01-29 06:14:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 136604 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    136604
2026-01-29 06:14:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 4fc2f41f-842e-5eaa-a0bc-9d6f4bcc88bf spider: auto1.fr
2026-01-29 06:14:23 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 4fc2f41f-842e-5eaa-a0bc-9d6f4bcc88bf due to rule: high_mileage_for_make.json, error: 136604 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    136604
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:03:03Z',
 'fuel_type': 'diesel',
 'id': '4fc2f41f-842e-5eaa-a0bc-9d6f4bcc88bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL63015',
 'listing': 'auction',
 'location': 'FR, VEZIN-LE-COQUET',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 136604,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Active Business',
 'transmission': 'automatic',
 'trim': 'Active Business',
 'year': 2019}
2026-01-29 06:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DL63015%27 HTTP/1.1" 200 None
2026-01-29 06:14:23 [auto1.fr] INFO: Saving data for DL63015: {'auction_closing_time': 1769702583.0, 'created_time': 1769580162.327192, 'last_price_update_time': 1769667263.167567}
2026-01-29 06:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DL63015') HTTP/1.1" 204 0
2026-01-29 06:14:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CX03233> (referer: https://www.auto1.com/v1/car-details-view/CX03233/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23ea49d2-b916-5766-8481-aaf9c723077a with identifier: CX03233
2026-01-29 06:14:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23ea49d2-b916-5766-8481-aaf9c723077a with scrape type 2
2026-01-29 06:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23ea49d2-b916-5766-8481-aaf9c723077a with scrape type 2
2026-01-29 06:14:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 23ea49d2-b916-5766-8481-aaf9c723077a, identifier: CX03233
2026-01-29 06:14:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 23ea49d2-b916-5766-8481-aaf9c723077a with identifier: CX03233
2026-01-29 06:14:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 23ea49d2-b916-5766-8481-aaf9c723077a with identifier: CX03233
2026-01-29 06:14:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2026-01-29 06:14:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 23ea49d2-b916-5766-8481-aaf9c723077a spider: auto1.fr
2026-01-29 06:14:23 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 23ea49d2-b916-5766-8481-aaf9c723077a due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:48:05Z',
 'fuel_type': 'diesel',
 'id': '23ea49d2-b916-5766-8481-aaf9c723077a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX03233',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 80488,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Peugeot Partner 1.5 Blue-HDi Premium L2',
 'transmission': 'manual',
 'trim': 'Premium L2',
 'year': 2020}
2026-01-29 06:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CX03233%27 HTTP/1.1" 200 None
2026-01-29 06:14:23 [auto1.fr] INFO: Saving data for CX03233: {'auction_closing_time': 1769705285.0, 'created_time': 1769580054.639837, 'last_price_update_time': 1769667263.582368}
2026-01-29 06:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CX03233') HTTP/1.1" 204 0
2026-01-29 06:14:23 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.516(s), this was the 1st time calling it.
2026-01-29 06:14:23 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.14114746567163 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:14:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GD51850> (referer: https://www.auto1.com/v1/car-details-view/GD51850/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YU57007> (referer: https://www.auto1.com/v1/car-details-view/YU57007/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 226ff1a7-c268-5237-9efc-a7dbe3692347 with identifier: GD51850
2026-01-29 06:14:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 226ff1a7-c268-5237-9efc-a7dbe3692347 with scrape type 2
2026-01-29 06:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 226ff1a7-c268-5237-9efc-a7dbe3692347 with scrape type 2
2026-01-29 06:14:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 226ff1a7-c268-5237-9efc-a7dbe3692347, identifier: GD51850
2026-01-29 06:14:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 226ff1a7-c268-5237-9efc-a7dbe3692347 with identifier: GD51850
2026-01-29 06:14:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 226ff1a7-c268-5237-9efc-a7dbe3692347 with identifier: GD51850
2026-01-29 06:14:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 226ff1a7-c268-5237-9efc-a7dbe3692347 with identifier: GD51850 to the API
2026-01-29 06:14:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:14:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:14:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GD51850>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:53:54Z',
 'fuel_type': 'diesel',
 'id': '226ff1a7-c268-5237-9efc-a7dbe3692347',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD51850',
 'listing': 'auction',
 'location': 'FR, Nanteuil-le-Haudouin',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 113312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Carat Exclusive BlueMotion',
 'transmission': 'automatic',
 'trim': 'Carat Exclusive BlueMotion',
 'year': 2019}
2026-01-29 06:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GD51850%27 HTTP/1.1" 200 None
2026-01-29 06:14:24 [auto1.fr] INFO: Saving data for GD51850: {'auction_closing_time': 1769705634.0, 'created_time': 1769493695.951481, 'last_price_update_time': 1769667264.921185}
2026-01-29 06:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GD51850') HTTP/1.1" 204 0
2026-01-29 06:14:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82b925a2-1c56-526d-be85-d7330adb7266 with identifier: YU57007
2026-01-29 06:14:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82b925a2-1c56-526d-be85-d7330adb7266 with scrape type 2
2026-01-29 06:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82b925a2-1c56-526d-be85-d7330adb7266 with scrape type 2
2026-01-29 06:14:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 82b925a2-1c56-526d-be85-d7330adb7266, identifier: YU57007
2026-01-29 06:14:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 82b925a2-1c56-526d-be85-d7330adb7266 with identifier: YU57007
2026-01-29 06:14:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 82b925a2-1c56-526d-be85-d7330adb7266 with identifier: YU57007
2026-01-29 06:14:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 82b925a2-1c56-526d-be85-d7330adb7266 with identifier: YU57007 to the API
2026-01-29 06:14:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:14:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:14:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YU57007>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:36:57Z',
 'fuel_type': 'petrol',
 'id': '82b925a2-1c56-526d-be85-d7330adb7266',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU57007',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 9748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.0 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2024}
2026-01-29 06:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YU57007%27 HTTP/1.1" 200 None
2026-01-29 06:14:25 [auto1.fr] INFO: Saving data for YU57007: {'auction_closing_time': 1769704617.0, 'created_time': 1767978574.538254, 'last_price_update_time': 1769667265.367468}
2026-01-29 06:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YU57007') HTTP/1.1" 204 0
2026-01-29 06:14:25 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.232(s), this was the 1st time calling it.
2026-01-29 06:14:25 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.406623032498354 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LK94761> (referer: https://www.auto1.com/v1/car-details-view/LK94761/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bacee24-677e-5d0b-a551-a54b1fb1f79b with identifier: LK94761
2026-01-29 06:14:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bacee24-677e-5d0b-a551-a54b1fb1f79b with scrape type 2
2026-01-29 06:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bacee24-677e-5d0b-a551-a54b1fb1f79b with scrape type 2
2026-01-29 06:14:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2bacee24-677e-5d0b-a551-a54b1fb1f79b, identifier: LK94761
2026-01-29 06:14:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2bacee24-677e-5d0b-a551-a54b1fb1f79b with identifier: LK94761
2026-01-29 06:14:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2bacee24-677e-5d0b-a551-a54b1fb1f79b with identifier: LK94761
2026-01-29 06:14:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2bacee24-677e-5d0b-a551-a54b1fb1f79b with identifier: LK94761 to the API
2026-01-29 06:14:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:14:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:14:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LK94761>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:49:42Z',
 'fuel_type': 'diesel',
 'id': '2bacee24-677e-5d0b-a551-a54b1fb1f79b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK94761',
 'listing': 'auction',
 'location': 'FR, LE HAVRE',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 108357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2021}
2026-01-29 06:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LK94761%27 HTTP/1.1" 200 None
2026-01-29 06:14:26 [auto1.fr] INFO: Saving data for LK94761: {'auction_closing_time': 1769705382.0, 'created_time': 1767027765.530775, 'last_price_update_time': 1769667266.855592}
2026-01-29 06:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LK94761') HTTP/1.1" 204 0
2026-01-29 06:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HM90919> (referer: https://www.auto1.com/v1/car-details-view/HM90919/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0355b74c-0fb3-58f9-8759-083ebeb378e8 with identifier: HM90919
2026-01-29 06:14:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0355b74c-0fb3-58f9-8759-083ebeb378e8 with scrape type 2
2026-01-29 06:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0355b74c-0fb3-58f9-8759-083ebeb378e8 with scrape type 2
2026-01-29 06:14:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0355b74c-0fb3-58f9-8759-083ebeb378e8, identifier: HM90919
2026-01-29 06:14:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0355b74c-0fb3-58f9-8759-083ebeb378e8 with identifier: HM90919
2026-01-29 06:14:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0355b74c-0fb3-58f9-8759-083ebeb378e8 with identifier: HM90919
2026-01-29 06:14:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 148056 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    148056
2026-01-29 06:14:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 0355b74c-0fb3-58f9-8759-083ebeb378e8 spider: auto1.fr
2026-01-29 06:14:27 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 0355b74c-0fb3-58f9-8759-083ebeb378e8 due to rule: high_mileage_for_make.json, error: 148056 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    148056
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:51:36Z',
 'fuel_type': 'diesel',
 'id': '0355b74c-0fb3-58f9-8759-083ebeb378e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM90919',
 'listing': 'auction',
 'location': 'FR, Vezin-le-Coquet',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 148056,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-06',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 1.5 Blue-HDi Active Business',
 'transmission': 'manual',
 'trim': 'Active Business',
 'year': 2019}
2026-01-29 06:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HM90919%27 HTTP/1.1" 200 None
2026-01-29 06:14:27 [auto1.fr] INFO: Saving data for HM90919: {'auction_closing_time': 1769705496.0, 'created_time': 1768459217.443677, 'last_price_update_time': 1769667267.328143}
2026-01-29 06:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HM90919') HTTP/1.1" 204 0
2026-01-29 06:14:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZH82888> (referer: https://www.auto1.com/v1/car-details-view/ZH82888/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99692a73-6109-5e98-801f-2545e40fdb3d with identifier: ZH82888
2026-01-29 06:14:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99692a73-6109-5e98-801f-2545e40fdb3d with scrape type 2
2026-01-29 06:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99692a73-6109-5e98-801f-2545e40fdb3d with scrape type 2
2026-01-29 06:14:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 99692a73-6109-5e98-801f-2545e40fdb3d, identifier: ZH82888
2026-01-29 06:14:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 99692a73-6109-5e98-801f-2545e40fdb3d with identifier: ZH82888
2026-01-29 06:14:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 99692a73-6109-5e98-801f-2545e40fdb3d with identifier: ZH82888
2026-01-29 06:14:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 99692a73-6109-5e98-801f-2545e40fdb3d with identifier: ZH82888 to the API
2026-01-29 06:14:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:14:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:14:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZH82888>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:39:18Z',
 'fuel_type': 'petrol',
 'id': '99692a73-6109-5e98-801f-2545e40fdb3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH82888',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 50544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.3 TCe Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2021}
2026-01-29 06:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZH82888%27 HTTP/1.1" 200 None
2026-01-29 06:14:28 [auto1.fr] INFO: Saving data for ZH82888: {'auction_closing_time': 1769704758.0, 'created_time': 1768844467.436273, 'last_price_update_time': 1769667268.628443}
2026-01-29 06:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZH82888') HTTP/1.1" 204 0
2026-01-29 06:14:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TS69315> (referer: https://www.auto1.com/v1/car-details-view/TS69315/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:14:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 553a5af9-d346-5c40-84b5-5c4fe3420879 with identifier: TS69315
2026-01-29 06:14:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 553a5af9-d346-5c40-84b5-5c4fe3420879 with scrape type 2
2026-01-29 06:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 553a5af9-d346-5c40-84b5-5c4fe3420879 with scrape type 2
2026-01-29 06:14:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 553a5af9-d346-5c40-84b5-5c4fe3420879, identifier: TS69315
2026-01-29 06:14:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 553a5af9-d346-5c40-84b5-5c4fe3420879 with identifier: TS69315
2026-01-29 06:14:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 553a5af9-d346-5c40-84b5-5c4fe3420879 with identifier: TS69315
2026-01-29 06:14:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'jumpy' containing 'jumpy'
2026-01-29 06:14:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 553a5af9-d346-5c40-84b5-5c4fe3420879 spider: auto1.fr
2026-01-29 06:14:29 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 553a5af9-d346-5c40-84b5-5c4fe3420879 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'jumpy' containing 'jumpy'
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:47:08Z',
 'fuel_type': 'diesel',
 'id': '553a5af9-d346-5c40-84b5-5c4fe3420879',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS69315',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 133434,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-26',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Citroen Jumpy 1.6 Blue-HDi Business M',
 'transmission': 'manual',
 'trim': 'Business M',
 'year': 2018}
2026-01-29 06:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TS69315%27 HTTP/1.1" 200 None
2026-01-29 06:14:29 [auto1.fr] INFO: Saving data for TS69315: {'auction_closing_time': 1769705228.0, 'created_time': 1767978083.007558, 'last_price_update_time': 1769667269.049596}
2026-01-29 06:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TS69315') HTTP/1.1" 204 0
2026-01-29 06:14:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PX39317/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TZ83632/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SN52348/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RL81844/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HJ27250/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XB99079/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZR68910/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DA73241/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GW21712/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WB03792/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:14:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KR61277/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VR57003/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZY80199/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MD20438/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UM50969/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GB80904> (referer: https://www.auto1.com/v1/car-details-view/GB80904/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3274528a-f5dd-500f-982a-3ddacd82e7b9 with identifier: GB80904
2026-01-29 06:14:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3274528a-f5dd-500f-982a-3ddacd82e7b9 with scrape type 2
2026-01-29 06:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3274528a-f5dd-500f-982a-3ddacd82e7b9 with scrape type 2
2026-01-29 06:14:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3274528a-f5dd-500f-982a-3ddacd82e7b9, identifier: GB80904
2026-01-29 06:14:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3274528a-f5dd-500f-982a-3ddacd82e7b9 with identifier: GB80904
2026-01-29 06:14:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3274528a-f5dd-500f-982a-3ddacd82e7b9 with identifier: GB80904
2026-01-29 06:14:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit custom' containing 'transit'
2026-01-29 06:14:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 3274528a-f5dd-500f-982a-3ddacd82e7b9 spider: auto1.fr
2026-01-29 06:14:33 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 3274528a-f5dd-500f-982a-3ddacd82e7b9 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit custom' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:09:37Z',
 'fuel_type': 'diesel',
 'id': '3274528a-f5dd-500f-982a-3ddacd82e7b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB80904',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 85338,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-26',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 270 L1 Limited',
 'transmission': 'manual',
 'trim': '270 L1 Limited',
 'year': 2017}
2026-01-29 06:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GB80904%27 HTTP/1.1" 200 None
2026-01-29 06:14:33 [auto1.fr] INFO: Saving data for GB80904: {'auction_closing_time': 1769702977.0, 'created_time': 1769533559.136612, 'last_price_update_time': 1769667273.367012}
2026-01-29 06:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GB80904') HTTP/1.1" 204 0
2026-01-29 06:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SN52348> (referer: https://www.auto1.com/v1/car-details-view/SN52348/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62466dbc-643d-5d97-abe8-6217b2ac9dd6 with identifier: SN52348
2026-01-29 06:14:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62466dbc-643d-5d97-abe8-6217b2ac9dd6 with scrape type 2
2026-01-29 06:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62466dbc-643d-5d97-abe8-6217b2ac9dd6 with scrape type 2
2026-01-29 06:14:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 62466dbc-643d-5d97-abe8-6217b2ac9dd6, identifier: SN52348
2026-01-29 06:14:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 62466dbc-643d-5d97-abe8-6217b2ac9dd6 with identifier: SN52348
2026-01-29 06:14:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 62466dbc-643d-5d97-abe8-6217b2ac9dd6 with identifier: SN52348
2026-01-29 06:14:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 62466dbc-643d-5d97-abe8-6217b2ac9dd6 with identifier: SN52348 to the API
2026-01-29 06:14:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:14:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:14:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SN52348>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 60,
 'expiration_date': '2026-01-29T16:57:36Z',
 'fuel_type': 'petrol',
 'id': '62466dbc-643d-5d97-abe8-6217b2ac9dd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN52348',
 'listing': 'auction',
 'location': 'FR, Creutzwald',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 47076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 MPI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2019}
2026-01-29 06:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SN52348%27 HTTP/1.1" 200 None
2026-01-29 06:14:34 [auto1.fr] INFO: Saving data for SN52348: {'auction_closing_time': 1769705856.0, 'created_time': 1769580099.698628, 'last_price_update_time': 1769667274.199052}
2026-01-29 06:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SN52348') HTTP/1.1" 204 0
2026-01-29 06:14:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XB99079> (referer: https://www.auto1.com/v1/car-details-view/XB99079/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cc327b9-f2e3-590b-b989-7e0ba2f2d9c9 with identifier: XB99079
2026-01-29 06:14:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cc327b9-f2e3-590b-b989-7e0ba2f2d9c9 with scrape type 2
2026-01-29 06:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cc327b9-f2e3-590b-b989-7e0ba2f2d9c9 with scrape type 2
2026-01-29 06:14:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6cc327b9-f2e3-590b-b989-7e0ba2f2d9c9, identifier: XB99079
2026-01-29 06:14:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6cc327b9-f2e3-590b-b989-7e0ba2f2d9c9 with identifier: XB99079
2026-01-29 06:14:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6cc327b9-f2e3-590b-b989-7e0ba2f2d9c9 with identifier: XB99079
2026-01-29 06:14:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6cc327b9-f2e3-590b-b989-7e0ba2f2d9c9 with identifier: XB99079 to the API
2026-01-29 06:14:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:14:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:14:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XB99079>
{'auction_title': '',
 'c_o_2_emission_value': 53,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 292,
 'expiration_date': '2026-01-29T16:16:48Z',
 'fuel_type': 'hybrid',
 'id': '6cc327b9-f2e3-590b-b989-7e0ba2f2d9c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB99079',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 145743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive 30e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-01-29 06:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB99079%27 HTTP/1.1" 200 None
2026-01-29 06:14:34 [auto1.fr] INFO: Saving data for XB99079: {'auction_closing_time': 1769703408.0, 'created_time': 1768239914.575681, 'last_price_update_time': 1769667274.694112}
2026-01-29 06:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XB99079') HTTP/1.1" 204 0
2026-01-29 06:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TZ83632> (referer: https://www.auto1.com/v1/car-details-view/TZ83632/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RL81844> (referer: https://www.auto1.com/v1/car-details-view/RL81844/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 702d56e0-1258-55df-bf30-a05ecee53ce5 with identifier: TZ83632
2026-01-29 06:14:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 702d56e0-1258-55df-bf30-a05ecee53ce5 with scrape type 2
2026-01-29 06:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 702d56e0-1258-55df-bf30-a05ecee53ce5 with scrape type 2
2026-01-29 06:14:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 702d56e0-1258-55df-bf30-a05ecee53ce5, identifier: TZ83632
2026-01-29 06:14:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 702d56e0-1258-55df-bf30-a05ecee53ce5 with identifier: TZ83632
2026-01-29 06:14:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 702d56e0-1258-55df-bf30-a05ecee53ce5 with identifier: TZ83632
2026-01-29 06:14:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 702d56e0-1258-55df-bf30-a05ecee53ce5 with identifier: TZ83632 to the API
2026-01-29 06:14:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:14:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:14:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TZ83632>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:36:02Z',
 'fuel_type': 'diesel',
 'id': '702d56e0-1258-55df-bf30-a05ecee53ce5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ83632',
 'listing': 'auction',
 'location': 'FR, Ambarès-et-Lagrave',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 55767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.6 CRDi Mild-Hybrid Black Edition Business 2WD',
 'transmission': 'automatic',
 'trim': 'Black Edition Business 2WD',
 'year': 2021}
2026-01-29 06:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TZ83632%27 HTTP/1.1" 200 None
2026-01-29 06:14:36 [auto1.fr] INFO: Saving data for TZ83632: {'auction_closing_time': 1769704562.0, 'created_time': 1769580109.78268, 'last_price_update_time': 1769667276.233504}
2026-01-29 06:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TZ83632') HTTP/1.1" 204 0
2026-01-29 06:14:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JH29899/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff014f2b-432c-5b9b-b535-dbfa45d55b16 with identifier: RL81844
2026-01-29 06:14:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff014f2b-432c-5b9b-b535-dbfa45d55b16 with scrape type 2
2026-01-29 06:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff014f2b-432c-5b9b-b535-dbfa45d55b16 with scrape type 2
2026-01-29 06:14:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ff014f2b-432c-5b9b-b535-dbfa45d55b16, identifier: RL81844
2026-01-29 06:14:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ff014f2b-432c-5b9b-b535-dbfa45d55b16 with identifier: RL81844
2026-01-29 06:14:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ff014f2b-432c-5b9b-b535-dbfa45d55b16 with identifier: RL81844
2026-01-29 06:14:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 156068 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    156068
2026-01-29 06:14:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ff014f2b-432c-5b9b-b535-dbfa45d55b16 spider: auto1.fr
2026-01-29 06:14:36 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: ff014f2b-432c-5b9b-b535-dbfa45d55b16 due to rule: high_mileage_for_country.json, error: 156068 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    156068
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 135,
 'expiration_date': '2026-01-29T16:15:17Z',
 'fuel_type': 'diesel',
 'id': 'ff014f2b-432c-5b9b-b535-dbfa45d55b16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL81844',
 'listing': 'auction',
 'location': 'FR, Ambarès-et-Lagrave',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 156068,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 CDI Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2018}
2026-01-29 06:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RL81844%27 HTTP/1.1" 200 None
2026-01-29 06:14:36 [auto1.fr] INFO: Saving data for RL81844: {'auction_closing_time': 1769703317.0, 'created_time': 1769533812.090372, 'last_price_update_time': 1769667276.561097}
2026-01-29 06:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RL81844') HTTP/1.1" 204 0
2026-01-29 06:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HJ27250> (referer: https://www.auto1.com/v1/car-details-view/HJ27250/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZR68910> (referer: https://www.auto1.com/v1/car-details-view/ZR68910/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GW21712> (referer: https://www.auto1.com/v1/car-details-view/GW21712/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38576aad-45bc-5138-b912-35f7750a30e7 with identifier: HJ27250
2026-01-29 06:14:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38576aad-45bc-5138-b912-35f7750a30e7 with scrape type 2
2026-01-29 06:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38576aad-45bc-5138-b912-35f7750a30e7 with scrape type 2
2026-01-29 06:14:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 38576aad-45bc-5138-b912-35f7750a30e7, identifier: HJ27250
2026-01-29 06:14:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 38576aad-45bc-5138-b912-35f7750a30e7 with identifier: HJ27250
2026-01-29 06:14:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 38576aad-45bc-5138-b912-35f7750a30e7 with identifier: HJ27250
2026-01-29 06:14:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 38576aad-45bc-5138-b912-35f7750a30e7 with identifier: HJ27250 to the API
2026-01-29 06:14:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:14:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:14:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HJ27250>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:41:26Z',
 'fuel_type': 'diesel',
 'id': '38576aad-45bc-5138-b912-35f7750a30e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ27250',
 'listing': 'auction',
 'location': 'FR, Le Boulou',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 52923,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.5 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2019}
2026-01-29 06:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HJ27250%27 HTTP/1.1" 200 None
2026-01-29 06:14:37 [auto1.fr] INFO: Saving data for HJ27250: {'auction_closing_time': 1769704886.0, 'created_time': 1769580168.952978, 'last_price_update_time': 1769667277.92333}
2026-01-29 06:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HJ27250') HTTP/1.1" 204 0
2026-01-29 06:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HN29767/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a4fbd53-2c26-5d5a-bd45-0d63fa4c1305 with identifier: ZR68910
2026-01-29 06:14:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a4fbd53-2c26-5d5a-bd45-0d63fa4c1305 with scrape type 2
2026-01-29 06:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a4fbd53-2c26-5d5a-bd45-0d63fa4c1305 with scrape type 2
2026-01-29 06:14:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9a4fbd53-2c26-5d5a-bd45-0d63fa4c1305, identifier: ZR68910
2026-01-29 06:14:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a196d544-07aa-557f-97ff-069812ba0780 with identifier: GW21712
2026-01-29 06:14:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a196d544-07aa-557f-97ff-069812ba0780 with scrape type 2
2026-01-29 06:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a196d544-07aa-557f-97ff-069812ba0780 with scrape type 2
2026-01-29 06:14:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a196d544-07aa-557f-97ff-069812ba0780, identifier: GW21712
2026-01-29 06:14:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9a4fbd53-2c26-5d5a-bd45-0d63fa4c1305 with identifier: ZR68910
2026-01-29 06:14:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9a4fbd53-2c26-5d5a-bd45-0d63fa4c1305 with identifier: ZR68910
2026-01-29 06:14:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9a4fbd53-2c26-5d5a-bd45-0d63fa4c1305 with identifier: ZR68910 to the API
2026-01-29 06:14:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:14:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:14:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZR68910>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:57:47Z',
 'fuel_type': 'diesel',
 'id': '9a4fbd53-2c26-5d5a-bd45-0d63fa4c1305',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR68910',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 54580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TDI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2020}
2026-01-29 06:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZR68910%27 HTTP/1.1" 200 None
2026-01-29 06:14:38 [auto1.fr] INFO: Saving data for ZR68910: {'auction_closing_time': 1769705867.0, 'created_time': 1769450193.086498, 'last_price_update_time': 1769667278.442939}
2026-01-29 06:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZR68910') HTTP/1.1" 204 0
2026-01-29 06:14:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a196d544-07aa-557f-97ff-069812ba0780 with identifier: GW21712
2026-01-29 06:14:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a196d544-07aa-557f-97ff-069812ba0780 with identifier: GW21712
2026-01-29 06:14:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a196d544-07aa-557f-97ff-069812ba0780 with identifier: GW21712 to the API
2026-01-29 06:14:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:14:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:14:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GW21712>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 125,
 'expiration_date': '2026-01-29T16:57:10Z',
 'fuel_type': 'petrol',
 'id': 'a196d544-07aa-557f-97ff-069812ba0780',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW21712',
 'listing': 'auction',
 'location': 'FR, Le Boulou',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 73127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2018}
2026-01-29 06:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GW21712%27 HTTP/1.1" 200 None
2026-01-29 06:14:38 [auto1.fr] INFO: Saving data for GW21712: {'auction_closing_time': 1769705830.0, 'created_time': 1769449439.242292, 'last_price_update_time': 1769667278.744284}
2026-01-29 06:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GW21712') HTTP/1.1" 204 0
2026-01-29 06:14:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UM50969> (referer: https://www.auto1.com/v1/car-details-view/UM50969/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a6c9f6e-c383-5a01-acf3-49c7cf51d56a with identifier: UM50969
2026-01-29 06:14:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a6c9f6e-c383-5a01-acf3-49c7cf51d56a with scrape type 2
2026-01-29 06:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a6c9f6e-c383-5a01-acf3-49c7cf51d56a with scrape type 2
2026-01-29 06:14:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3a6c9f6e-c383-5a01-acf3-49c7cf51d56a, identifier: UM50969
2026-01-29 06:14:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3a6c9f6e-c383-5a01-acf3-49c7cf51d56a with identifier: UM50969
2026-01-29 06:14:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3a6c9f6e-c383-5a01-acf3-49c7cf51d56a with identifier: UM50969
2026-01-29 06:14:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3a6c9f6e-c383-5a01-acf3-49c7cf51d56a with identifier: UM50969 to the API
2026-01-29 06:14:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:14:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:14:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UM50969>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 163,
 'expiration_date': '2026-01-29T16:48:59Z',
 'fuel_type': 'petrol',
 'id': '3a6c9f6e-c383-5a01-acf3-49c7cf51d56a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM50969',
 'listing': 'auction',
 'location': 'FR, Ambarès-et-Lagrave',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 91904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-01-29 06:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UM50969%27 HTTP/1.1" 200 None
2026-01-29 06:14:40 [auto1.fr] INFO: Saving data for UM50969: {'auction_closing_time': 1769705339.0, 'created_time': 1765951379.295501, 'last_price_update_time': 1769667280.212041}
2026-01-29 06:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UM50969') HTTP/1.1" 204 0
2026-01-29 06:14:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WB03792> (referer: https://www.auto1.com/v1/car-details-view/WB03792/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VR57003> (referer: https://www.auto1.com/v1/car-details-view/VR57003/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PX39317> (referer: https://www.auto1.com/v1/car-details-view/PX39317/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KR61277> (referer: https://www.auto1.com/v1/car-details-view/KR61277/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36286ec0-dab7-551b-ac79-d4c7415c9c5c with identifier: WB03792
2026-01-29 06:14:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36286ec0-dab7-551b-ac79-d4c7415c9c5c with scrape type 2
2026-01-29 06:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36286ec0-dab7-551b-ac79-d4c7415c9c5c with scrape type 2
2026-01-29 06:14:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 36286ec0-dab7-551b-ac79-d4c7415c9c5c, identifier: WB03792
2026-01-29 06:14:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 36286ec0-dab7-551b-ac79-d4c7415c9c5c with identifier: WB03792
2026-01-29 06:14:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 36286ec0-dab7-551b-ac79-d4c7415c9c5c with identifier: WB03792
2026-01-29 06:14:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'dacia' containing 'dacia' and model 'dokker' containing 'dokker'
2026-01-29 06:14:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 36286ec0-dab7-551b-ac79-d4c7415c9c5c spider: auto1.fr
2026-01-29 06:14:40 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 36286ec0-dab7-551b-ac79-d4c7415c9c5c due to rule: makes_models_not_allowed.json, error: Rejected due to make 'dacia' containing 'dacia' and model 'dokker' containing 'dokker'
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:10:00Z',
 'fuel_type': 'petrol',
 'id': '36286ec0-dab7-551b-ac79-d4c7415c9c5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB03792',
 'listing': 'auction',
 'location': 'FR, Ingrandes sur Vienne',
 'make': 'Dacia',
 'model': 'Dokker',
 'odometer': 160634,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Dokker 1.3 TCe Essentiel',
 'transmission': 'manual',
 'trim': 'Essentiel',
 'year': 2019}
2026-01-29 06:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB03792%27 HTTP/1.1" 200 None
2026-01-29 06:14:40 [auto1.fr] INFO: Saving data for WB03792: {'auction_closing_time': 1769703000.0, 'created_time': 1767632584.291441, 'last_price_update_time': 1769667280.626333}
2026-01-29 06:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WB03792') HTTP/1.1" 204 0
2026-01-29 06:14:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a425e012-657b-5ffd-a55c-e1c78d6d5019 with identifier: VR57003
2026-01-29 06:14:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a425e012-657b-5ffd-a55c-e1c78d6d5019 with scrape type 2
2026-01-29 06:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a425e012-657b-5ffd-a55c-e1c78d6d5019 with scrape type 2
2026-01-29 06:14:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a425e012-657b-5ffd-a55c-e1c78d6d5019, identifier: VR57003
2026-01-29 06:14:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a425e012-657b-5ffd-a55c-e1c78d6d5019 with identifier: VR57003
2026-01-29 06:14:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a425e012-657b-5ffd-a55c-e1c78d6d5019 with identifier: VR57003
2026-01-29 06:14:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 70382, 'odometer_reading_unit': 'km', 'registration_date': '2020-05-25', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vr57003', 'expiration_date': '2026-01-29t16:01:41z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, tarnos', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 126, 'id': 'a425e012-657b-5ffd-a55c-e1c78d6d5019', 'current_year_diff': 6, 'age_in_months': 68, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 70382}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 68,
     'auction_title': '',
     'c_o_2_emission_value': 126,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:01:41z',
     'fuel_type': 'petrol',
     'id': 'a425e012-657b-5ffd-a55c-e1c78d6d5019',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vr57003',
     'listing': 'auction',
     'location': 'fr, tarnos',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 70382,
     'odometer_in_km': 70382,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-05-25',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech gt line',
     'transmission': 'manual',
     'trim': 'gt line',
     'year': 2020}
2026-01-29 06:14:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: a425e012-657b-5ffd-a55c-e1c78d6d5019 spider: auto1.fr
2026-01-29 06:14:40 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: a425e012-657b-5ffd-a55c-e1c78d6d5019 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 70382, 'odometer_reading_unit': 'km', 'registration_date': '2020-05-25', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vr57003', 'expiration_date': '2026-01-29t16:01:41z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, tarnos', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 126, 'id': 'a425e012-657b-5ffd-a55c-e1c78d6d5019', 'current_year_diff': 6, 'age_in_months': 68, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 70382}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 68,
     'auction_title': '',
     'c_o_2_emission_value': 126,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:01:41z',
     'fuel_type': 'petrol',
     'id': 'a425e012-657b-5ffd-a55c-e1c78d6d5019',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vr57003',
     'listing': 'auction',
     'location': 'fr, tarnos',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 70382,
     'odometer_in_km': 70382,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-05-25',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech gt line',
     'transmission': 'manual',
     'trim': 'gt line',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:01:41Z',
 'fuel_type': 'petrol',
 'id': 'a425e012-657b-5ffd-a55c-e1c78d6d5019',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR57003',
 'listing': 'auction',
 'location': 'FR, TARNOS',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 70382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-05-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2020}
2026-01-29 06:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VR57003%27 HTTP/1.1" 200 None
2026-01-29 06:14:40 [auto1.fr] INFO: Saving data for VR57003: {'auction_closing_time': 1769702501.0, 'created_time': 1765386584.930474, 'last_price_update_time': 1769667280.96871}
2026-01-29 06:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VR57003') HTTP/1.1" 204 0
2026-01-29 06:14:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b38faf9c-09ed-5170-b0f3-1831229d031e with identifier: PX39317
2026-01-29 06:14:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b38faf9c-09ed-5170-b0f3-1831229d031e with scrape type 2
2026-01-29 06:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b38faf9c-09ed-5170-b0f3-1831229d031e with scrape type 2
2026-01-29 06:14:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b38faf9c-09ed-5170-b0f3-1831229d031e, identifier: PX39317
2026-01-29 06:14:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26c6ddb3-0545-5652-a412-5b79afe140e7 with identifier: KR61277
2026-01-29 06:14:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26c6ddb3-0545-5652-a412-5b79afe140e7 with scrape type 2
2026-01-29 06:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26c6ddb3-0545-5652-a412-5b79afe140e7 with scrape type 2
2026-01-29 06:14:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 26c6ddb3-0545-5652-a412-5b79afe140e7, identifier: KR61277
2026-01-29 06:14:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b38faf9c-09ed-5170-b0f3-1831229d031e with identifier: PX39317
2026-01-29 06:14:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b38faf9c-09ed-5170-b0f3-1831229d031e with identifier: PX39317
2026-01-29 06:14:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.6 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 130083, 'odometer_reading_unit': 'km', 'registration_date': '2018-12-05', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/px39317', 'expiration_date': '2026-01-29t16:33:41z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 181, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.6l', 'location': 'saint-germain-du-puy', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 128, 'id': 'b38faf9c-09ed-5170-b0f3-1831229d031e', 'current_year_diff': 8, 'age_in_months': 85, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 130083}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 85,
     'auction_title': '',
     'c_o_2_emission_value': 128,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.6l',
     'engine_horse_power': 181,
     'expiration_date': '2026-01-29t16:33:41z',
     'fuel_type': 'petrol',
     'id': 'b38faf9c-09ed-5170-b0f3-1831229d031e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/px39317',
     'listing': 'auction',
     'location': 'saint-germain-du-puy',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 130083,
     'odometer_in_km': 130083,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-12-05',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.6 puretech allure',
     'transmission': 'automatic',
     'trim': 'allure',
     'year': 2018}
2026-01-29 06:14:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: b38faf9c-09ed-5170-b0f3-1831229d031e spider: auto1.fr
2026-01-29 06:14:41 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: b38faf9c-09ed-5170-b0f3-1831229d031e due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.6 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 130083, 'odometer_reading_unit': 'km', 'registration_date': '2018-12-05', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/px39317', 'expiration_date': '2026-01-29t16:33:41z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 181, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.6l', 'location': 'saint-germain-du-puy', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 128, 'id': 'b38faf9c-09ed-5170-b0f3-1831229d031e', 'current_year_diff': 8, 'age_in_months': 85, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 130083}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 85,
     'auction_title': '',
     'c_o_2_emission_value': 128,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.6l',
     'engine_horse_power': 181,
     'expiration_date': '2026-01-29t16:33:41z',
     'fuel_type': 'petrol',
     'id': 'b38faf9c-09ed-5170-b0f3-1831229d031e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/px39317',
     'listing': 'auction',
     'location': 'saint-germain-du-puy',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 130083,
     'odometer_in_km': 130083,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-12-05',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.6 puretech allure',
     'transmission': 'automatic',
     'trim': 'allure',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 181,
 'expiration_date': '2026-01-29T16:33:41Z',
 'fuel_type': 'petrol',
 'id': 'b38faf9c-09ed-5170-b0f3-1831229d031e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX39317',
 'listing': 'auction',
 'location': 'Saint-Germain-du-Puy',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 130083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2018}
2026-01-29 06:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX39317%27 HTTP/1.1" 200 None
2026-01-29 06:14:41 [auto1.fr] INFO: Saving data for PX39317: {'auction_closing_time': 1769704421.0, 'created_time': 1769447504.872168, 'last_price_update_time': 1769667281.387276}
2026-01-29 06:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PX39317') HTTP/1.1" 204 0
2026-01-29 06:14:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 26c6ddb3-0545-5652-a412-5b79afe140e7 with identifier: KR61277
2026-01-29 06:14:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 26c6ddb3-0545-5652-a412-5b79afe140e7 with identifier: KR61277
2026-01-29 06:14:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 26c6ddb3-0545-5652-a412-5b79afe140e7 with identifier: KR61277 to the API
2026-01-29 06:14:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:14:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:14:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KR61277>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:36:36Z',
 'fuel_type': 'petrol',
 'id': '26c6ddb3-0545-5652-a412-5b79afe140e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR61277',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 46175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2020}
2026-01-29 06:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KR61277%27 HTTP/1.1" 200 None
2026-01-29 06:14:41 [auto1.fr] INFO: Saving data for KR61277: {'auction_closing_time': 1769704596.0, 'created_time': 1769533565.138624, 'last_price_update_time': 1769667281.688197}
2026-01-29 06:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KR61277') HTTP/1.1" 204 0
2026-01-29 06:14:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MD20438> (referer: https://www.auto1.com/v1/car-details-view/MD20438/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a53b92e7-7cd0-5922-8f2e-87a2cddd2c41 with identifier: MD20438
2026-01-29 06:14:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a53b92e7-7cd0-5922-8f2e-87a2cddd2c41 with scrape type 2
2026-01-29 06:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a53b92e7-7cd0-5922-8f2e-87a2cddd2c41 with scrape type 2
2026-01-29 06:14:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a53b92e7-7cd0-5922-8f2e-87a2cddd2c41, identifier: MD20438
2026-01-29 06:14:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a53b92e7-7cd0-5922-8f2e-87a2cddd2c41 with identifier: MD20438
2026-01-29 06:14:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a53b92e7-7cd0-5922-8f2e-87a2cddd2c41 with identifier: MD20438
2026-01-29 06:14:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 114051, 'odometer_reading_unit': 'km', 'registration_date': '2017-09-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/md20438', 'expiration_date': '2026-01-29t16:15:22z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, beaucaire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 103, 'id': 'a53b92e7-7cd0-5922-8f2e-87a2cddd2c41', 'current_year_diff': 9, 'age_in_months': 100, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 114051}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 100,
     'auction_title': '',
     'c_o_2_emission_value': 103,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:15:22z',
     'fuel_type': 'petrol',
     'id': 'a53b92e7-7cd0-5922-8f2e-87a2cddd2c41',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/md20438',
     'listing': 'auction',
     'location': 'fr, beaucaire',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 114051,
     'odometer_in_km': 114051,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-09-28',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2017}
2026-01-29 06:14:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: a53b92e7-7cd0-5922-8f2e-87a2cddd2c41 spider: auto1.fr
2026-01-29 06:14:42 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: a53b92e7-7cd0-5922-8f2e-87a2cddd2c41 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 114051, 'odometer_reading_unit': 'km', 'registration_date': '2017-09-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/md20438', 'expiration_date': '2026-01-29t16:15:22z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, beaucaire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 103, 'id': 'a53b92e7-7cd0-5922-8f2e-87a2cddd2c41', 'current_year_diff': 9, 'age_in_months': 100, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 114051}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 100,
     'auction_title': '',
     'c_o_2_emission_value': 103,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:15:22z',
     'fuel_type': 'petrol',
     'id': 'a53b92e7-7cd0-5922-8f2e-87a2cddd2c41',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/md20438',
     'listing': 'auction',
     'location': 'fr, beaucaire',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 114051,
     'odometer_in_km': 114051,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-09-28',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:15:22Z',
 'fuel_type': 'petrol',
 'id': 'a53b92e7-7cd0-5922-8f2e-87a2cddd2c41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD20438',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 114051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2017}
2026-01-29 06:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MD20438%27 HTTP/1.1" 200 None
2026-01-29 06:14:42 [auto1.fr] INFO: Saving data for MD20438: {'auction_closing_time': 1769703322.0, 'created_time': 1768890974.666485, 'last_price_update_time': 1769667282.998382}
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MD20438') HTTP/1.1" 204 0
2026-01-29 06:14:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:43 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: HK33509
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK33509%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for HK33509: 2
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: NC83296
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NC83296%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for NC83296: 2
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: MM91324
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MM91324%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for MM91324: 0
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: CM55077
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CM55077%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for CM55077: 2
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: US58546
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27US58546%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for US58546: 2
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: KM74822
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KM74822%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for KM74822: 0
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: FV70132
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV70132%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for FV70132: 2
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: DA14954
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DA14954%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for DA14954: 2
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: UT00719
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT00719%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for UT00719: 0
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: WC45843
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WC45843%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for WC45843: 0
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: RK12806
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RK12806%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for RK12806: 0
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: HK94978
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK94978%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for HK94978: 0
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: LW21314
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LW21314%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for LW21314: 0
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: GA26468
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GA26468%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for GA26468: 2
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: GU48248
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU48248%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for GU48248: 0
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: EY36181
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EY36181%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for EY36181: 0
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: TF68202
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TF68202%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for TF68202: 0
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: GC33458
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GC33458%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for GC33458: 0
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: SB79238
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SB79238%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for SB79238: 0
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: MC17718
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC17718%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for MC17718: 0
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: HV63202
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HV63202%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for HV63202: 0
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: TL71629
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TL71629%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for TL71629: 0
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: ZJ48412
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZJ48412%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for ZJ48412: 0
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: GR17155
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GR17155%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for GR17155: 2
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: FV48582
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV48582%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for FV48582: 0
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: DD09768
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DD09768%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for DD09768: 0
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: HB63331
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HB63331%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for HB63331: 0
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: TA74732
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA74732%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for TA74732: 2
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: EJ00354
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EJ00354%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for EJ00354: 2
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: WK30709
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WK30709%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for WK30709: 0
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: SG20664
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SG20664%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for SG20664: 0
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: FL89219
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FL89219%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for FL89219: 0
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: SE24899
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SE24899%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for SE24899: 2
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: ZL04650
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZL04650%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for ZL04650: 2
2026-01-29 06:14:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XM39362/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: WX31817
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WX31817%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for WX31817: 0
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: NC79363
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NC79363%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for NC79363: 0
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: BU04449
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BU04449%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for BU04449: 2
2026-01-29 06:14:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: RT62766
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RT62766%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for RT62766: 0
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: ZS37764
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZS37764%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for ZS37764: 0
2026-01-29 06:14:43 [auto1.fr] INFO: Found listing with ID: RR25317
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RR25317%27 HTTP/1.1" 200 None
2026-01-29 06:14:43 [auto1.fr] INFO: Scrape type for RR25317: 2
2026-01-29 06:14:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DA73241> (referer: https://www.auto1.com/v1/car-details-view/DA73241/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdbc3d47-1162-573b-b521-e44256d1d384 with identifier: DA73241
2026-01-29 06:14:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdbc3d47-1162-573b-b521-e44256d1d384 with scrape type 2
2026-01-29 06:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdbc3d47-1162-573b-b521-e44256d1d384 with scrape type 2
2026-01-29 06:14:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bdbc3d47-1162-573b-b521-e44256d1d384, identifier: DA73241
2026-01-29 06:14:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bdbc3d47-1162-573b-b521-e44256d1d384 with identifier: DA73241
2026-01-29 06:14:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bdbc3d47-1162-573b-b521-e44256d1d384 with identifier: DA73241
2026-01-29 06:14:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bdbc3d47-1162-573b-b521-e44256d1d384 with identifier: DA73241 to the API
2026-01-29 06:14:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:14:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:14:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DA73241>
{'auction_title': '',
 'c_o_2_emission_value': 5,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'engine_horse_power': 230,
 'expiration_date': '2026-01-29T16:48:52Z',
 'fuel_type': 'hybrid',
 'id': 'bdbc3d47-1162-573b-b521-e44256d1d384',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA73241',
 'listing': 'auction',
 'location': 'FR, Bruges',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 21780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Hybrid Intuitive 2WD',
 'transmission': 'automatic',
 'trim': 'Intuitive 2WD',
 'year': 2024}
2026-01-29 06:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DA73241%27 HTTP/1.1" 200 None
2026-01-29 06:14:45 [auto1.fr] INFO: Saving data for DA73241: {'auction_closing_time': 1769705332.0, 'created_time': 1769533675.265431, 'last_price_update_time': 1769667285.517724}
2026-01-29 06:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DA73241') HTTP/1.1" 204 0
2026-01-29 06:14:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DM89058/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JH09763/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZY80199> (referer: https://www.auto1.com/v1/car-details-view/ZY80199/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2644c95c-f306-5fef-b932-8849123646a4 with identifier: ZY80199
2026-01-29 06:14:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2644c95c-f306-5fef-b932-8849123646a4 with scrape type 2
2026-01-29 06:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2644c95c-f306-5fef-b932-8849123646a4 with scrape type 2
2026-01-29 06:14:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2644c95c-f306-5fef-b932-8849123646a4, identifier: ZY80199
2026-01-29 06:14:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2644c95c-f306-5fef-b932-8849123646a4 with identifier: ZY80199
2026-01-29 06:14:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2644c95c-f306-5fef-b932-8849123646a4 with identifier: ZY80199
2026-01-29 06:14:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c4 cactus 1.2 e-thp rip curl', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c4 cactus', 'transmission': 'manual', 'odometer': 117156, 'odometer_reading_unit': 'km', 'registration_date': '2017-02-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zy80199', 'expiration_date': '2026-01-29t16:33:12z', 'origin_country_code': 'fr', 'trim': 'rip curl', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, montataire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 100, 'id': '2644c95c-f306-5fef-b932-8849123646a4', 'current_year_diff': 9, 'age_in_months': 107, 'make_model': 'citroen c4 cactus', 'sanitized_make': 'citroen', 'odometer_in_km': 117156}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 107,
     'auction_title': '',
     'c_o_2_emission_value': 100,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:33:12z',
     'fuel_type': 'petrol',
     'id': '2644c95c-f306-5fef-b932-8849123646a4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zy80199',
     'listing': 'auction',
     'location': 'fr, montataire',
     'make': 'citroen',
     'make_model': 'citroen c4 cactus',
     'model': 'c4 cactus',
     'odometer': 117156,
     'odometer_in_km': 117156,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-02-27',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c4 cactus 1.2 e-thp rip curl',
     'transmission': 'manual',
     'trim': 'rip curl',
     'year': 2017}
2026-01-29 06:14:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 2644c95c-f306-5fef-b932-8849123646a4 spider: auto1.fr
2026-01-29 06:14:46 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 2644c95c-f306-5fef-b932-8849123646a4 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c4 cactus 1.2 e-thp rip curl', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c4 cactus', 'transmission': 'manual', 'odometer': 117156, 'odometer_reading_unit': 'km', 'registration_date': '2017-02-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zy80199', 'expiration_date': '2026-01-29t16:33:12z', 'origin_country_code': 'fr', 'trim': 'rip curl', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, montataire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 100, 'id': '2644c95c-f306-5fef-b932-8849123646a4', 'current_year_diff': 9, 'age_in_months': 107, 'make_model': 'citroen c4 cactus', 'sanitized_make': 'citroen', 'odometer_in_km': 117156}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 107,
     'auction_title': '',
     'c_o_2_emission_value': 100,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:33:12z',
     'fuel_type': 'petrol',
     'id': '2644c95c-f306-5fef-b932-8849123646a4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zy80199',
     'listing': 'auction',
     'location': 'fr, montataire',
     'make': 'citroen',
     'make_model': 'citroen c4 cactus',
     'model': 'c4 cactus',
     'odometer': 117156,
     'odometer_in_km': 117156,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-02-27',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c4 cactus 1.2 e-thp rip curl',
     'transmission': 'manual',
     'trim': 'rip curl',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:33:12Z',
 'fuel_type': 'petrol',
 'id': '2644c95c-f306-5fef-b932-8849123646a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY80199',
 'listing': 'auction',
 'location': 'FR, Montataire',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 117156,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 e-THP Rip Curl',
 'transmission': 'manual',
 'trim': 'Rip Curl',
 'year': 2017}
2026-01-29 06:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZY80199%27 HTTP/1.1" 200 None
2026-01-29 06:14:46 [auto1.fr] INFO: Saving data for ZY80199: {'auction_closing_time': 1769704392.0, 'created_time': 1769534388.329143, 'last_price_update_time': 1769667286.90555}
2026-01-29 06:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZY80199') HTTP/1.1" 204 0
2026-01-29 06:14:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VF13466/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PJ86495/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YN34701/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZF17408/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HN29767> (referer: https://www.auto1.com/v1/car-details-view/HN29767/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a2b4807-6c46-5b99-8259-7bcf64292ae2 with identifier: HN29767
2026-01-29 06:14:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a2b4807-6c46-5b99-8259-7bcf64292ae2 with scrape type 2
2026-01-29 06:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a2b4807-6c46-5b99-8259-7bcf64292ae2 with scrape type 2
2026-01-29 06:14:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5a2b4807-6c46-5b99-8259-7bcf64292ae2, identifier: HN29767
2026-01-29 06:14:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5a2b4807-6c46-5b99-8259-7bcf64292ae2 with identifier: HN29767
2026-01-29 06:14:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5a2b4807-6c46-5b99-8259-7bcf64292ae2 with identifier: HN29767
2026-01-29 06:14:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 132003 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    132003
2026-01-29 06:14:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 5a2b4807-6c46-5b99-8259-7bcf64292ae2 spider: auto1.fr
2026-01-29 06:14:56 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 5a2b4807-6c46-5b99-8259-7bcf64292ae2 due to rule: high_mileage_for_make.json, error: 132003 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    132003
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-01-29T16:44:57Z',
 'fuel_type': 'diesel',
 'id': '5a2b4807-6c46-5b99-8259-7bcf64292ae2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN29767',
 'listing': 'auction',
 'location': 'FR, Wambrechies',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 132003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 508 2.0 Blue-HDi Féline',
 'transmission': 'automatic',
 'trim': 'Féline',
 'year': 2017}
2026-01-29 06:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HN29767%27 HTTP/1.1" 200 None
2026-01-29 06:14:56 [auto1.fr] INFO: Saving data for HN29767: {'auction_closing_time': 1769705097.0, 'created_time': 1769533576.421424, 'last_price_update_time': 1769667296.502608}
2026-01-29 06:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HN29767') HTTP/1.1" 204 0
2026-01-29 06:14:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JH29899> (referer: https://www.auto1.com/v1/car-details-view/JH29899/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZM68348/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1da67139-43fb-5009-bb67-755c59d57a99 with identifier: JH29899
2026-01-29 06:14:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1da67139-43fb-5009-bb67-755c59d57a99 with scrape type 2
2026-01-29 06:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1da67139-43fb-5009-bb67-755c59d57a99 with scrape type 2
2026-01-29 06:14:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1da67139-43fb-5009-bb67-755c59d57a99, identifier: JH29899
2026-01-29 06:14:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1da67139-43fb-5009-bb67-755c59d57a99 with identifier: JH29899
2026-01-29 06:14:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1da67139-43fb-5009-bb67-755c59d57a99 with identifier: JH29899
2026-01-29 06:14:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 74693, 'odometer_reading_unit': 'km', 'registration_date': '2020-06-04', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jh29899', 'expiration_date': '2026-01-29t16:50:47z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 155, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, tarnos', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 140, 'id': '1da67139-43fb-5009-bb67-755c59d57a99', 'current_year_diff': 6, 'age_in_months': 67, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 74693}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 67,
     'auction_title': '',
     'c_o_2_emission_value': 140,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 155,
     'expiration_date': '2026-01-29t16:50:47z',
     'fuel_type': 'petrol',
     'id': '1da67139-43fb-5009-bb67-755c59d57a99',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jh29899',
     'listing': 'auction',
     'location': 'fr, tarnos',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 74693,
     'odometer_in_km': 74693,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-06-04',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech gt',
     'transmission': 'automatic',
     'trim': 'gt',
     'year': 2020}
2026-01-29 06:14:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 1da67139-43fb-5009-bb67-755c59d57a99 spider: auto1.fr
2026-01-29 06:14:57 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 1da67139-43fb-5009-bb67-755c59d57a99 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 74693, 'odometer_reading_unit': 'km', 'registration_date': '2020-06-04', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jh29899', 'expiration_date': '2026-01-29t16:50:47z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 155, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, tarnos', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 140, 'id': '1da67139-43fb-5009-bb67-755c59d57a99', 'current_year_diff': 6, 'age_in_months': 67, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 74693}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 67,
     'auction_title': '',
     'c_o_2_emission_value': 140,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 155,
     'expiration_date': '2026-01-29t16:50:47z',
     'fuel_type': 'petrol',
     'id': '1da67139-43fb-5009-bb67-755c59d57a99',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jh29899',
     'listing': 'auction',
     'location': 'fr, tarnos',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 74693,
     'odometer_in_km': 74693,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-06-04',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech gt',
     'transmission': 'automatic',
     'trim': 'gt',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 155,
 'expiration_date': '2026-01-29T16:50:47Z',
 'fuel_type': 'petrol',
 'id': '1da67139-43fb-5009-bb67-755c59d57a99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH29899',
 'listing': 'auction',
 'location': 'FR, TARNOS',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 74693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2020}
2026-01-29 06:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JH29899%27 HTTP/1.1" 200 None
2026-01-29 06:14:57 [auto1.fr] INFO: Saving data for JH29899: {'auction_closing_time': 1769705447.0, 'created_time': 1769190396.490729, 'last_price_update_time': 1769667297.245245}
2026-01-29 06:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JH29899') HTTP/1.1" 204 0
2026-01-29 06:14:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WC54697/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XM39362> (referer: https://www.auto1.com/v1/car-details-view/XM39362/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZL04650/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 070aee58-254b-57d0-87c4-ec1e2e835ead with identifier: XM39362
2026-01-29 06:14:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 070aee58-254b-57d0-87c4-ec1e2e835ead with scrape type 2
2026-01-29 06:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 070aee58-254b-57d0-87c4-ec1e2e835ead with scrape type 2
2026-01-29 06:14:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 070aee58-254b-57d0-87c4-ec1e2e835ead, identifier: XM39362
2026-01-29 06:14:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 070aee58-254b-57d0-87c4-ec1e2e835ead with identifier: XM39362
2026-01-29 06:14:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 070aee58-254b-57d0-87c4-ec1e2e835ead with identifier: XM39362
2026-01-29 06:14:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel corsa 1.2 edition', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'corsa', 'transmission': 'manual', 'odometer': 57025, 'odometer_reading_unit': 'km', 'registration_date': '2021-06-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xm39362', 'expiration_date': '2026-01-29t16:20:13z', 'origin_country_code': 'fr', 'trim': 'edition', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ingrandes sur vienne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 117, 'id': '070aee58-254b-57d0-87c4-ec1e2e835ead', 'current_year_diff': 5, 'age_in_months': 55, 'make_model': 'opel corsa', 'sanitized_make': 'opel', 'odometer_in_km': 57025}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 55,
     'auction_title': '',
     'c_o_2_emission_value': 117,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 75,
     'expiration_date': '2026-01-29t16:20:13z',
     'fuel_type': 'petrol',
     'id': '070aee58-254b-57d0-87c4-ec1e2e835ead',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xm39362',
     'listing': 'auction',
     'location': 'fr, ingrandes sur vienne',
     'make': 'opel',
     'make_model': 'opel corsa',
     'model': 'corsa',
     'odometer': 57025,
     'odometer_in_km': 57025,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-06-23',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel corsa 1.2 edition',
     'transmission': 'manual',
     'trim': 'edition',
     'year': 2021}
2026-01-29 06:14:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 070aee58-254b-57d0-87c4-ec1e2e835ead spider: auto1.fr
2026-01-29 06:14:57 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 070aee58-254b-57d0-87c4-ec1e2e835ead due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel corsa 1.2 edition', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'corsa', 'transmission': 'manual', 'odometer': 57025, 'odometer_reading_unit': 'km', 'registration_date': '2021-06-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xm39362', 'expiration_date': '2026-01-29t16:20:13z', 'origin_country_code': 'fr', 'trim': 'edition', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ingrandes sur vienne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 117, 'id': '070aee58-254b-57d0-87c4-ec1e2e835ead', 'current_year_diff': 5, 'age_in_months': 55, 'make_model': 'opel corsa', 'sanitized_make': 'opel', 'odometer_in_km': 57025}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 55,
     'auction_title': '',
     'c_o_2_emission_value': 117,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 75,
     'expiration_date': '2026-01-29t16:20:13z',
     'fuel_type': 'petrol',
     'id': '070aee58-254b-57d0-87c4-ec1e2e835ead',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xm39362',
     'listing': 'auction',
     'location': 'fr, ingrandes sur vienne',
     'make': 'opel',
     'make_model': 'opel corsa',
     'model': 'corsa',
     'odometer': 57025,
     'odometer_in_km': 57025,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-06-23',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel corsa 1.2 edition',
     'transmission': 'manual',
     'trim': 'edition',
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:20:13Z',
 'fuel_type': 'petrol',
 'id': '070aee58-254b-57d0-87c4-ec1e2e835ead',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM39362',
 'listing': 'auction',
 'location': 'FR, Ingrandes sur Vienne',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 57025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2021}
2026-01-29 06:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XM39362%27 HTTP/1.1" 200 None
2026-01-29 06:14:57 [auto1.fr] INFO: Saving data for XM39362: {'auction_closing_time': 1769703613.0, 'created_time': 1769533809.45093, 'last_price_update_time': 1769667297.789238}
2026-01-29 06:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XM39362') HTTP/1.1" 204 0
2026-01-29 06:14:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RR25317/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DM89058> (referer: https://www.auto1.com/v1/car-details-view/DM89058/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f6b9876-5c0e-5a86-a581-28390aaa16a3 with identifier: DM89058
2026-01-29 06:14:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f6b9876-5c0e-5a86-a581-28390aaa16a3 with scrape type 2
2026-01-29 06:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f6b9876-5c0e-5a86-a581-28390aaa16a3 with scrape type 2
2026-01-29 06:14:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8f6b9876-5c0e-5a86-a581-28390aaa16a3, identifier: DM89058
2026-01-29 06:14:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8f6b9876-5c0e-5a86-a581-28390aaa16a3 with identifier: DM89058
2026-01-29 06:14:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8f6b9876-5c0e-5a86-a581-28390aaa16a3 with identifier: DM89058
2026-01-29 06:14:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8f6b9876-5c0e-5a86-a581-28390aaa16a3 with identifier: DM89058 to the API
2026-01-29 06:14:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:14:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:14:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DM89058>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2026-01-29T16:23:36Z',
 'fuel_type': 'diesel',
 'id': '8f6b9876-5c0e-5a86-a581-28390aaa16a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM89058',
 'listing': 'auction',
 'location': 'FR, Montataire',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 128025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2018}
2026-01-29 06:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DM89058%27 HTTP/1.1" 200 None
2026-01-29 06:14:58 [auto1.fr] INFO: Saving data for DM89058: {'auction_closing_time': 1769703816.0, 'created_time': 1769534247.233979, 'last_price_update_time': 1769667298.543079}
2026-01-29 06:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DM89058') HTTP/1.1" 204 0
2026-01-29 06:14:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BU04449/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JH09763> (referer: https://www.auto1.com/v1/car-details-view/JH09763/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0e40316-79f9-5711-b367-126db1bf5796 with identifier: JH09763
2026-01-29 06:14:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0e40316-79f9-5711-b367-126db1bf5796 with scrape type 2
2026-01-29 06:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0e40316-79f9-5711-b367-126db1bf5796 with scrape type 2
2026-01-29 06:14:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a0e40316-79f9-5711-b367-126db1bf5796, identifier: JH09763
2026-01-29 06:14:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a0e40316-79f9-5711-b367-126db1bf5796 with identifier: JH09763
2026-01-29 06:14:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a0e40316-79f9-5711-b367-126db1bf5796 with identifier: JH09763
2026-01-29 06:14:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a0e40316-79f9-5711-b367-126db1bf5796 with identifier: JH09763 to the API
2026-01-29 06:14:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:14:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:14:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JH09763>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 111,
 'expiration_date': '2026-01-29T16:34:29Z',
 'fuel_type': 'petrol',
 'id': 'a0e40316-79f9-5711-b367-126db1bf5796',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH09763',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 77098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki Vitara 1.0 BoosterJet Privilege 4x2',
 'transmission': 'manual',
 'trim': 'Privilege 4x2',
 'year': 2019}
2026-01-29 06:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JH09763%27 HTTP/1.1" 200 None
2026-01-29 06:14:59 [auto1.fr] INFO: Saving data for JH09763: {'auction_closing_time': 1769704469.0, 'created_time': 1769534105.75651, 'last_price_update_time': 1769667299.263716}
2026-01-29 06:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JH09763') HTTP/1.1" 204 0
2026-01-29 06:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MK94315/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZF17408> (referer: https://www.auto1.com/v1/car-details-view/ZF17408/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VF13466> (referer: https://www.auto1.com/v1/car-details-view/VF13466/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:14:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:14:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36281c2f-8af2-5988-8393-32802c45aa54 with identifier: ZF17408
2026-01-29 06:14:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36281c2f-8af2-5988-8393-32802c45aa54 with scrape type 2
2026-01-29 06:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36281c2f-8af2-5988-8393-32802c45aa54 with scrape type 2
2026-01-29 06:14:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 36281c2f-8af2-5988-8393-32802c45aa54, identifier: ZF17408
2026-01-29 06:14:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 36281c2f-8af2-5988-8393-32802c45aa54 with identifier: ZF17408
2026-01-29 06:14:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 36281c2f-8af2-5988-8393-32802c45aa54 with identifier: ZF17408
2026-01-29 06:14:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 36281c2f-8af2-5988-8393-32802c45aa54 with identifier: ZF17408 to the API
2026-01-29 06:14:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:14:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:14:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZF17408>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 192,
 'expiration_date': '2026-01-29T16:34:53Z',
 'fuel_type': 'petrol',
 'id': '36281c2f-8af2-5988-8393-32802c45aa54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF17408',
 'listing': 'auction',
 'location': 'FR, Marckolsheim',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 71636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman Cooper S Chili',
 'transmission': 'manual',
 'trim': 'Chili',
 'year': 2018}
2026-01-29 06:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZF17408%27 HTTP/1.1" 200 None
2026-01-29 06:14:59 [auto1.fr] INFO: Saving data for ZF17408: {'auction_closing_time': 1769704493.0, 'created_time': 1769447621.534643, 'last_price_update_time': 1769667299.981283}
2026-01-29 06:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZF17408') HTTP/1.1" 204 0
2026-01-29 06:15:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cc1a53f-780c-5aba-910a-064ea9cbf4ab with identifier: VF13466
2026-01-29 06:15:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cc1a53f-780c-5aba-910a-064ea9cbf4ab with scrape type 2
2026-01-29 06:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cc1a53f-780c-5aba-910a-064ea9cbf4ab with scrape type 2
2026-01-29 06:15:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5cc1a53f-780c-5aba-910a-064ea9cbf4ab, identifier: VF13466
2026-01-29 06:15:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5cc1a53f-780c-5aba-910a-064ea9cbf4ab with identifier: VF13466
2026-01-29 06:15:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5cc1a53f-780c-5aba-910a-064ea9cbf4ab with identifier: VF13466
2026-01-29 06:15:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'orange', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech gt pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 56487, 'odometer_reading_unit': 'km', 'registration_date': '2021-04-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vf13466', 'expiration_date': '2026-01-29t16:19:04z', 'origin_country_code': 'fr', 'trim': 'gt pack', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 155, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, marseille', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 140, 'id': '5cc1a53f-780c-5aba-910a-064ea9cbf4ab', 'current_year_diff': 5, 'age_in_months': 57, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 56487}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 57,
     'auction_title': '',
     'c_o_2_emission_value': 140,
     'category': None,
     'color': 'orange',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 155,
     'expiration_date': '2026-01-29t16:19:04z',
     'fuel_type': 'petrol',
     'id': '5cc1a53f-780c-5aba-910a-064ea9cbf4ab',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vf13466',
     'listing': 'auction',
     'location': 'fr, marseille',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 56487,
     'odometer_in_km': 56487,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-04-28',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech gt pack',
     'transmission': 'automatic',
     'trim': 'gt pack',
     'year': 2021}
2026-01-29 06:15:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 5cc1a53f-780c-5aba-910a-064ea9cbf4ab spider: auto1.fr
2026-01-29 06:15:00 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 5cc1a53f-780c-5aba-910a-064ea9cbf4ab due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'orange', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech gt pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 56487, 'odometer_reading_unit': 'km', 'registration_date': '2021-04-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vf13466', 'expiration_date': '2026-01-29t16:19:04z', 'origin_country_code': 'fr', 'trim': 'gt pack', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 155, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, marseille', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 140, 'id': '5cc1a53f-780c-5aba-910a-064ea9cbf4ab', 'current_year_diff': 5, 'age_in_months': 57, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 56487}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 57,
     'auction_title': '',
     'c_o_2_emission_value': 140,
     'category': None,
     'color': 'orange',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 155,
     'expiration_date': '2026-01-29t16:19:04z',
     'fuel_type': 'petrol',
     'id': '5cc1a53f-780c-5aba-910a-064ea9cbf4ab',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/vf13466',
     'listing': 'auction',
     'location': 'fr, marseille',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 56487,
     'odometer_in_km': 56487,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-04-28',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech gt pack',
     'transmission': 'automatic',
     'trim': 'gt pack',
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 155,
 'expiration_date': '2026-01-29T16:19:04Z',
 'fuel_type': 'petrol',
 'id': '5cc1a53f-780c-5aba-910a-064ea9cbf4ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF13466',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 56487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech GT Pack',
 'transmission': 'automatic',
 'trim': 'GT Pack',
 'year': 2021}
2026-01-29 06:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VF13466%27 HTTP/1.1" 200 None
2026-01-29 06:15:00 [auto1.fr] INFO: Saving data for VF13466: {'auction_closing_time': 1769703544.0, 'created_time': 1769447011.59425, 'last_price_update_time': 1769667300.346051}
2026-01-29 06:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VF13466') HTTP/1.1" 204 0
2026-01-29 06:15:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SE24899/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:15:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UB67784/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:15:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YN34701> (referer: https://www.auto1.com/v1/car-details-view/YN34701/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:15:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PJ86495> (referer: https://www.auto1.com/v1/car-details-view/PJ86495/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:15:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:15:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:15:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:15:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:15:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddc06545-4297-59b5-b248-ef51876b594f with identifier: YN34701
2026-01-29 06:15:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddc06545-4297-59b5-b248-ef51876b594f with scrape type 2
2026-01-29 06:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ddc06545-4297-59b5-b248-ef51876b594f with scrape type 2
2026-01-29 06:15:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ddc06545-4297-59b5-b248-ef51876b594f, identifier: YN34701
2026-01-29 06:15:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ddc06545-4297-59b5-b248-ef51876b594f with identifier: YN34701
2026-01-29 06:15:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ddc06545-4297-59b5-b248-ef51876b594f with identifier: YN34701
2026-01-29 06:15:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'manual', 'odometer': 85545, 'odometer_reading_unit': 'km', 'registration_date': '2019-07-11', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yn34701', 'expiration_date': '2026-01-29t16:13:50z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'boulogne-billancourt', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 104, 'id': 'ddc06545-4297-59b5-b248-ef51876b594f', 'current_year_diff': 7, 'age_in_months': 78, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 85545}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 78,
     'auction_title': '',
     'c_o_2_emission_value': 104,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:13:50z',
     'fuel_type': 'petrol',
     'id': 'ddc06545-4297-59b5-b248-ef51876b594f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yn34701',
     'listing': 'auction',
     'location': 'boulogne-billancourt',
     'make': 'citroen',
     'make_model': 'citroen c3 aircross',
     'model': 'c3 aircross',
     'odometer': 85545,
     'odometer_in_km': 85545,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-07-11',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 aircross 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2019}
2026-01-29 06:15:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: ddc06545-4297-59b5-b248-ef51876b594f spider: auto1.fr
2026-01-29 06:15:00 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: ddc06545-4297-59b5-b248-ef51876b594f due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'manual', 'odometer': 85545, 'odometer_reading_unit': 'km', 'registration_date': '2019-07-11', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yn34701', 'expiration_date': '2026-01-29t16:13:50z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'boulogne-billancourt', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 104, 'id': 'ddc06545-4297-59b5-b248-ef51876b594f', 'current_year_diff': 7, 'age_in_months': 78, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 85545}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 78,
     'auction_title': '',
     'c_o_2_emission_value': 104,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:13:50z',
     'fuel_type': 'petrol',
     'id': 'ddc06545-4297-59b5-b248-ef51876b594f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yn34701',
     'listing': 'auction',
     'location': 'boulogne-billancourt',
     'make': 'citroen',
     'make_model': 'citroen c3 aircross',
     'model': 'c3 aircross',
     'odometer': 85545,
     'odometer_in_km': 85545,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-07-11',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 aircross 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:13:50Z',
 'fuel_type': 'petrol',
 'id': 'ddc06545-4297-59b5-b248-ef51876b594f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN34701',
 'listing': 'auction',
 'location': 'Boulogne-Billancourt',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 85545,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2019}
2026-01-29 06:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YN34701%27 HTTP/1.1" 200 None
2026-01-29 06:15:00 [auto1.fr] INFO: Saving data for YN34701: {'auction_closing_time': 1769703230.0, 'created_time': 1769015150.15806, 'last_price_update_time': 1769667300.932037}
2026-01-29 06:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YN34701') HTTP/1.1" 204 0
2026-01-29 06:15:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b708396f-aa2c-5955-949f-d13394880fe5 with identifier: PJ86495
2026-01-29 06:15:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b708396f-aa2c-5955-949f-d13394880fe5 with scrape type 2
2026-01-29 06:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b708396f-aa2c-5955-949f-d13394880fe5 with scrape type 2
2026-01-29 06:15:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b708396f-aa2c-5955-949f-d13394880fe5, identifier: PJ86495
2026-01-29 06:15:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EJ00354/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:15:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b708396f-aa2c-5955-949f-d13394880fe5 with identifier: PJ86495
2026-01-29 06:15:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b708396f-aa2c-5955-949f-d13394880fe5 with identifier: PJ86495
2026-01-29 06:15:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech graphic', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 26124, 'odometer_reading_unit': 'km', 'registration_date': '2018-09-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pj86495', 'expiration_date': '2026-01-29t16:50:25z', 'origin_country_code': 'fr', 'trim': 'graphic', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, labege', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': 'b708396f-aa2c-5955-949f-d13394880fe5', 'current_year_diff': 8, 'age_in_months': 88, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 26124}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 88,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:50:25z',
     'fuel_type': 'petrol',
     'id': 'b708396f-aa2c-5955-949f-d13394880fe5',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pj86495',
     'listing': 'auction',
     'location': 'fr, labege',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 26124,
     'odometer_in_km': 26124,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-09-27',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech graphic',
     'transmission': 'manual',
     'trim': 'graphic',
     'year': 2018}
2026-01-29 06:15:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: b708396f-aa2c-5955-949f-d13394880fe5 spider: auto1.fr
2026-01-29 06:15:01 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: b708396f-aa2c-5955-949f-d13394880fe5 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech graphic', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 26124, 'odometer_reading_unit': 'km', 'registration_date': '2018-09-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pj86495', 'expiration_date': '2026-01-29t16:50:25z', 'origin_country_code': 'fr', 'trim': 'graphic', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, labege', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': 'b708396f-aa2c-5955-949f-d13394880fe5', 'current_year_diff': 8, 'age_in_months': 88, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 26124}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 88,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:50:25z',
     'fuel_type': 'petrol',
     'id': 'b708396f-aa2c-5955-949f-d13394880fe5',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/pj86495',
     'listing': 'auction',
     'location': 'fr, labege',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 26124,
     'odometer_in_km': 26124,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-09-27',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech graphic',
     'transmission': 'manual',
     'trim': 'graphic',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:50:25Z',
 'fuel_type': 'petrol',
 'id': 'b708396f-aa2c-5955-949f-d13394880fe5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ86495',
 'listing': 'auction',
 'location': 'FR, LABEGE',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 26124,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Graphic',
 'transmission': 'manual',
 'trim': 'Graphic',
 'year': 2018}
2026-01-29 06:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PJ86495%27 HTTP/1.1" 200 None
2026-01-29 06:15:01 [auto1.fr] INFO: Saving data for PJ86495: {'auction_closing_time': 1769705425.0, 'created_time': 1769533999.922562, 'last_price_update_time': 1769667301.467528}
2026-01-29 06:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PJ86495') HTTP/1.1" 204 0
2026-01-29 06:15:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:15:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TA74732/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:15:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GR17155/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:15:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZL04650> (referer: https://www.auto1.com/v1/car-details-view/ZL04650/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:15:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:15:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 904de724-6248-55b3-837c-21c6cf709c5f with identifier: ZL04650
2026-01-29 06:15:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 904de724-6248-55b3-837c-21c6cf709c5f with scrape type 2
2026-01-29 06:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 904de724-6248-55b3-837c-21c6cf709c5f with scrape type 2
2026-01-29 06:15:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 904de724-6248-55b3-837c-21c6cf709c5f, identifier: ZL04650
2026-01-29 06:15:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 904de724-6248-55b3-837c-21c6cf709c5f with identifier: ZL04650
2026-01-29 06:15:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 904de724-6248-55b3-837c-21c6cf709c5f with identifier: ZL04650
2026-01-29 06:15:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 163423 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    163423
2026-01-29 06:15:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 904de724-6248-55b3-837c-21c6cf709c5f spider: auto1.fr
2026-01-29 06:15:02 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 904de724-6248-55b3-837c-21c6cf709c5f due to rule: high_mileage_for_country.json, error: 163423 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    163423
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:19:01Z',
 'fuel_type': 'diesel',
 'id': '904de724-6248-55b3-837c-21c6cf709c5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL04650',
 'listing': 'auction',
 'location': 'FR, Marckolsheim',
 'make': 'Volkswagen',
 'model': 'Arteon',
 'odometer': 163423,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-04-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Arteon 2.0 TDI R-Line Exclusive 4Motion',
 'transmission': 'automatic',
 'trim': 'R-Line Exclusive 4Motion',
 'year': 2020}
2026-01-29 06:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZL04650%27 HTTP/1.1" 200 None
2026-01-29 06:15:02 [auto1.fr] INFO: Saving data for ZL04650: {'auction_closing_time': 1769703541.0, 'created_time': 1767074444.635318, 'last_price_update_time': 1769667302.767932}
2026-01-29 06:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZL04650') HTTP/1.1" 204 0
2026-01-29 06:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZM68348> (referer: https://www.auto1.com/v1/car-details-view/ZM68348/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:15:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:15:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76b2f426-bd22-5a87-8bc5-861ad8980db7 with identifier: ZM68348
2026-01-29 06:15:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76b2f426-bd22-5a87-8bc5-861ad8980db7 with scrape type 2
2026-01-29 06:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76b2f426-bd22-5a87-8bc5-861ad8980db7 with scrape type 2
2026-01-29 06:15:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 76b2f426-bd22-5a87-8bc5-861ad8980db7, identifier: ZM68348
2026-01-29 06:15:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 76b2f426-bd22-5a87-8bc5-861ad8980db7 with identifier: ZM68348
2026-01-29 06:15:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 76b2f426-bd22-5a87-8bc5-861ad8980db7 with identifier: ZM68348
2026-01-29 06:15:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 133109 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    133109
2026-01-29 06:15:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 76b2f426-bd22-5a87-8bc5-861ad8980db7 spider: auto1.fr
2026-01-29 06:15:03 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 76b2f426-bd22-5a87-8bc5-861ad8980db7 due to rule: high_mileage_for_make.json, error: 133109 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    133109
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 177,
 'expiration_date': '2026-01-29T16:56:12Z',
 'fuel_type': 'diesel',
 'id': '76b2f426-bd22-5a87-8bc5-861ad8980db7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM68348',
 'listing': 'auction',
 'location': 'Pornichet',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 133109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-20',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 2.0 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2019}
2026-01-29 06:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZM68348%27 HTTP/1.1" 200 None
2026-01-29 06:15:03 [auto1.fr] INFO: Saving data for ZM68348: {'auction_closing_time': 1769705772.0, 'created_time': 1769014918.392846, 'last_price_update_time': 1769667303.310459}
2026-01-29 06:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZM68348') HTTP/1.1" 204 0
2026-01-29 06:15:04 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.743(s), this was the 1st time calling it.
2026-01-29 06:15:04 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.9215518350413525 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:15:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DA14954/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:15:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:15:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RR25317> (referer: https://www.auto1.com/v1/car-details-view/RR25317/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:15:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:15:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4ac1019-4797-5c8d-969e-76b37cdf567d with identifier: RR25317
2026-01-29 06:15:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4ac1019-4797-5c8d-969e-76b37cdf567d with scrape type 2
2026-01-29 06:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4ac1019-4797-5c8d-969e-76b37cdf567d with scrape type 2
2026-01-29 06:15:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f4ac1019-4797-5c8d-969e-76b37cdf567d, identifier: RR25317
2026-01-29 06:15:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f4ac1019-4797-5c8d-969e-76b37cdf567d with identifier: RR25317
2026-01-29 06:15:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f4ac1019-4797-5c8d-969e-76b37cdf567d with identifier: RR25317
2026-01-29 06:15:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f4ac1019-4797-5c8d-969e-76b37cdf567d with identifier: RR25317 to the API
2026-01-29 06:15:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:15:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:15:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RR25317>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 224,
 'expiration_date': '2026-01-29T16:41:27Z',
 'fuel_type': 'hybrid',
 'id': 'f4ac1019-4797-5c8d-969e-76b37cdf567d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR25317',
 'listing': 'auction',
 'location': 'FR, Houecourt',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 118847,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Hybrid 225 Allure',
 'transmission': 'automatic',
 'trim': '225 Allure',
 'year': 2021}
2026-01-29 06:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RR25317%27 HTTP/1.1" 200 None
2026-01-29 06:15:08 [auto1.fr] INFO: Saving data for RR25317: {'auction_closing_time': 1769704887.0, 'created_time': 1769533961.297066, 'last_price_update_time': 1769667308.814483}
2026-01-29 06:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RR25317') HTTP/1.1" 204 0
2026-01-29 06:15:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WC54697> (referer: https://www.auto1.com/v1/car-details-view/WC54697/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:15:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:15:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc7b32ab-db1c-5123-a904-8a34efc181d5 with identifier: WC54697
2026-01-29 06:15:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc7b32ab-db1c-5123-a904-8a34efc181d5 with scrape type 2
2026-01-29 06:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc7b32ab-db1c-5123-a904-8a34efc181d5 with scrape type 2
2026-01-29 06:15:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bc7b32ab-db1c-5123-a904-8a34efc181d5, identifier: WC54697
2026-01-29 06:15:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bc7b32ab-db1c-5123-a904-8a34efc181d5 with identifier: WC54697
2026-01-29 06:15:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bc7b32ab-db1c-5123-a904-8a34efc181d5 with identifier: WC54697
2026-01-29 06:15:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bc7b32ab-db1c-5123-a904-8a34efc181d5 with identifier: WC54697 to the API
2026-01-29 06:15:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:15:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:15:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WC54697>
{'auction_title': '',
 'c_o_2_emission_value': 30,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 299,
 'expiration_date': '2026-01-29T16:28:04Z',
 'fuel_type': 'hybrid',
 'id': 'bc7b32ab-db1c-5123-a904-8a34efc181d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC54697',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 102051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Hybrid GT Pack',
 'transmission': 'automatic',
 'trim': 'GT Pack',
 'year': 2021}
2026-01-29 06:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WC54697%27 HTTP/1.1" 200 None
2026-01-29 06:15:09 [auto1.fr] INFO: Saving data for WC54697: {'auction_closing_time': 1769704084.0, 'created_time': 1769534137.096944, 'last_price_update_time': 1769667309.386494}
2026-01-29 06:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WC54697') HTTP/1.1" 204 0
2026-01-29 06:15:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CM55077/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:15:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:15:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:15:12 [scrapy.extensions.logstats] INFO: Crawled 1100 pages (at 85 pages/min), scraped 240 items (at 20 items/min)
2026-01-29 06:15:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ML39767> (referer: https://www.auto1.com/v1/car-details-view/ML39767/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:15:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:15:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3307160-4467-5bd0-9d98-d3451b533b0c with identifier: ML39767
2026-01-29 06:15:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3307160-4467-5bd0-9d98-d3451b533b0c with scrape type 2
2026-01-29 06:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3307160-4467-5bd0-9d98-d3451b533b0c with scrape type 2
2026-01-29 06:15:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e3307160-4467-5bd0-9d98-d3451b533b0c, identifier: ML39767
2026-01-29 06:15:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e3307160-4467-5bd0-9d98-d3451b533b0c with identifier: ML39767
2026-01-29 06:15:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e3307160-4467-5bd0-9d98-d3451b533b0c with identifier: ML39767
2026-01-29 06:15:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo innovation', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'automatic', 'odometer': 82926, 'odometer_reading_unit': 'km', 'registration_date': '2018-07-15', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ml39767', 'expiration_date': '2026-01-29t16:06:25z', 'origin_country_code': 'fr', 'trim': 'innovation', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ambarès-et-lagrave', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'e3307160-4467-5bd0-9d98-d3451b533b0c', 'current_year_diff': 8, 'age_in_months': 90, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 82926}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 90,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:06:25z',
     'fuel_type': 'petrol',
     'id': 'e3307160-4467-5bd0-9d98-d3451b533b0c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ml39767',
     'listing': 'auction',
     'location': 'fr, ambarès-et-lagrave',
     'make': 'opel',
     'make_model': 'opel crossland x',
     'model': 'crossland x',
     'odometer': 82926,
     'odometer_in_km': 82926,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-07-15',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel crossland x 1.2 turbo innovation',
     'transmission': 'automatic',
     'trim': 'innovation',
     'year': 2018}
2026-01-29 06:15:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: e3307160-4467-5bd0-9d98-d3451b533b0c spider: auto1.fr
2026-01-29 06:15:13 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: e3307160-4467-5bd0-9d98-d3451b533b0c due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo innovation', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'automatic', 'odometer': 82926, 'odometer_reading_unit': 'km', 'registration_date': '2018-07-15', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ml39767', 'expiration_date': '2026-01-29t16:06:25z', 'origin_country_code': 'fr', 'trim': 'innovation', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ambarès-et-lagrave', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'e3307160-4467-5bd0-9d98-d3451b533b0c', 'current_year_diff': 8, 'age_in_months': 90, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 82926}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 90,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:06:25z',
     'fuel_type': 'petrol',
     'id': 'e3307160-4467-5bd0-9d98-d3451b533b0c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ml39767',
     'listing': 'auction',
     'location': 'fr, ambarès-et-lagrave',
     'make': 'opel',
     'make_model': 'opel crossland x',
     'model': 'crossland x',
     'odometer': 82926,
     'odometer_in_km': 82926,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-07-15',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel crossland x 1.2 turbo innovation',
     'transmission': 'automatic',
     'trim': 'innovation',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:06:25Z',
 'fuel_type': 'petrol',
 'id': 'e3307160-4467-5bd0-9d98-d3451b533b0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML39767',
 'listing': 'auction',
 'location': 'FR, Ambarès-et-Lagrave',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 82926,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo INNOVATION',
 'transmission': 'automatic',
 'trim': 'INNOVATION',
 'year': 2018}
2026-01-29 06:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ML39767%27 HTTP/1.1" 200 None
2026-01-29 06:15:13 [auto1.fr] INFO: Saving data for ML39767: {'auction_closing_time': 1769702785.0, 'created_time': 1769533947.40065, 'last_price_update_time': 1769667313.730776}
2026-01-29 06:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ML39767') HTTP/1.1" 204 0
2026-01-29 06:15:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MK94315> (referer: https://www.auto1.com/v1/car-details-view/MK94315/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:15:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:15:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fd8b600-60f3-51a3-ae06-1474bbaffd37 with identifier: MK94315
2026-01-29 06:15:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fd8b600-60f3-51a3-ae06-1474bbaffd37 with scrape type 2
2026-01-29 06:15:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fd8b600-60f3-51a3-ae06-1474bbaffd37 with scrape type 2
2026-01-29 06:15:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3fd8b600-60f3-51a3-ae06-1474bbaffd37, identifier: MK94315
2026-01-29 06:15:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3fd8b600-60f3-51a3-ae06-1474bbaffd37 with identifier: MK94315
2026-01-29 06:15:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3fd8b600-60f3-51a3-ae06-1474bbaffd37 with identifier: MK94315
2026-01-29 06:15:15 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'citan' containing 'citan'
2026-01-29 06:15:15 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 3fd8b600-60f3-51a3-ae06-1474bbaffd37 spider: auto1.fr
2026-01-29 06:15:15 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 3fd8b600-60f3-51a3-ae06-1474bbaffd37 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'citan' containing 'citan'
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:47:20Z',
 'fuel_type': 'diesel',
 'id': '3fd8b600-60f3-51a3-ae06-1474bbaffd37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK94315',
 'listing': 'auction',
 'location': 'Aubière',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 73948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-08',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 109 CDI lang',
 'transmission': 'manual',
 'trim': 'lang',
 'year': 2020}
2026-01-29 06:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MK94315%27 HTTP/1.1" 200 None
2026-01-29 06:15:15 [auto1.fr] INFO: Saving data for MK94315: {'auction_closing_time': 1769705240.0, 'created_time': 1769533796.148978, 'last_price_update_time': 1769667315.861985}
2026-01-29 06:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MK94315') HTTP/1.1" 204 0
2026-01-29 06:15:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NC83296/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:15:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:15:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UB67784> (referer: https://www.auto1.com/v1/car-details-view/UB67784/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:15:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:15:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 796b9a0c-a3de-51c3-a9cd-c25e12ae11d5 with identifier: UB67784
2026-01-29 06:15:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 796b9a0c-a3de-51c3-a9cd-c25e12ae11d5 with scrape type 2
2026-01-29 06:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 796b9a0c-a3de-51c3-a9cd-c25e12ae11d5 with scrape type 2
2026-01-29 06:15:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 796b9a0c-a3de-51c3-a9cd-c25e12ae11d5, identifier: UB67784
2026-01-29 06:15:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 796b9a0c-a3de-51c3-a9cd-c25e12ae11d5 with identifier: UB67784
2026-01-29 06:15:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 796b9a0c-a3de-51c3-a9cd-c25e12ae11d5 with identifier: UB67784
2026-01-29 06:15:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 796b9a0c-a3de-51c3-a9cd-c25e12ae11d5 with identifier: UB67784 to the API
2026-01-29 06:15:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:15:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:15:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UB67784>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 245,
 'expiration_date': '2026-01-29T16:38:20Z',
 'fuel_type': 'petrol',
 'id': '796b9a0c-a3de-51c3-a9cd-c25e12ae11d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB67784',
 'listing': 'auction',
 'location': 'FR, Villenoy',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 74650,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2020}
2026-01-29 06:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UB67784%27 HTTP/1.1" 200 None
2026-01-29 06:15:20 [auto1.fr] INFO: Saving data for UB67784: {'auction_closing_time': 1769704700.0, 'created_time': 1768891506.19198, 'last_price_update_time': 1769667320.013307}
2026-01-29 06:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UB67784') HTTP/1.1" 204 0
2026-01-29 06:15:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EJ00354> (referer: https://www.auto1.com/v1/car-details-view/EJ00354/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:15:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:15:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 302f28a8-a64a-515d-98bc-0250ca89f995 with identifier: EJ00354
2026-01-29 06:15:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 302f28a8-a64a-515d-98bc-0250ca89f995 with scrape type 2
2026-01-29 06:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 302f28a8-a64a-515d-98bc-0250ca89f995 with scrape type 2
2026-01-29 06:15:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 302f28a8-a64a-515d-98bc-0250ca89f995, identifier: EJ00354
2026-01-29 06:15:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 302f28a8-a64a-515d-98bc-0250ca89f995 with identifier: EJ00354
2026-01-29 06:15:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 302f28a8-a64a-515d-98bc-0250ca89f995 with identifier: EJ00354
2026-01-29 06:15:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot rifter 1.2 puretech allure l2', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': 'rifter', 'transmission': 'automatic', 'odometer': 98000, 'odometer_reading_unit': 'km', 'registration_date': '2020-01-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ej00354', 'expiration_date': '2026-01-29t16:49:32z', 'origin_country_code': 'fr', 'trim': 'allure l2', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 117, 'id': '302f28a8-a64a-515d-98bc-0250ca89f995', 'current_year_diff': 6, 'age_in_months': 71, 'make_model': 'peugeot rifter', 'sanitized_make': 'peugeot', 'odometer_in_km': 98000}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 71,
     'auction_title': '',
     'c_o_2_emission_value': 117,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:49:32z',
     'fuel_type': 'petrol',
     'id': '302f28a8-a64a-515d-98bc-0250ca89f995',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ej00354',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'peugeot',
     'make_model': 'peugeot rifter',
     'model': 'rifter',
     'odometer': 98000,
     'odometer_in_km': 98000,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-01-30',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot rifter 1.2 puretech allure l2',
     'transmission': 'automatic',
     'trim': 'allure l2',
     'year': 2020}
2026-01-29 06:15:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 302f28a8-a64a-515d-98bc-0250ca89f995 spider: auto1.fr
2026-01-29 06:15:22 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 302f28a8-a64a-515d-98bc-0250ca89f995 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot rifter 1.2 puretech allure l2', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': 'rifter', 'transmission': 'automatic', 'odometer': 98000, 'odometer_reading_unit': 'km', 'registration_date': '2020-01-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ej00354', 'expiration_date': '2026-01-29t16:49:32z', 'origin_country_code': 'fr', 'trim': 'allure l2', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 117, 'id': '302f28a8-a64a-515d-98bc-0250ca89f995', 'current_year_diff': 6, 'age_in_months': 71, 'make_model': 'peugeot rifter', 'sanitized_make': 'peugeot', 'odometer_in_km': 98000}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 71,
     'auction_title': '',
     'c_o_2_emission_value': 117,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:49:32z',
     'fuel_type': 'petrol',
     'id': '302f28a8-a64a-515d-98bc-0250ca89f995',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ej00354',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'peugeot',
     'make_model': 'peugeot rifter',
     'model': 'rifter',
     'odometer': 98000,
     'odometer_in_km': 98000,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-01-30',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot rifter 1.2 puretech allure l2',
     'transmission': 'automatic',
     'trim': 'allure l2',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:49:32Z',
 'fuel_type': 'petrol',
 'id': '302f28a8-a64a-515d-98bc-0250ca89f995',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ00354',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 98000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Rifter 1.2 PureTech Allure L2',
 'transmission': 'automatic',
 'trim': 'Allure L2',
 'year': 2020}
2026-01-29 06:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EJ00354%27 HTTP/1.1" 200 None
2026-01-29 06:15:22 [auto1.fr] INFO: Saving data for EJ00354: {'auction_closing_time': 1769705372.0, 'created_time': 1769148204.793376, 'last_price_update_time': 1769667322.996915}
2026-01-29 06:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EJ00354') HTTP/1.1" 204 0
2026-01-29 06:15:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GR17155> (referer: https://www.auto1.com/v1/car-details-view/GR17155/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:15:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:15:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc71bc73-24a0-5e1d-ad22-385c7e293354 with identifier: GR17155
2026-01-29 06:15:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc71bc73-24a0-5e1d-ad22-385c7e293354 with scrape type 2
2026-01-29 06:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc71bc73-24a0-5e1d-ad22-385c7e293354 with scrape type 2
2026-01-29 06:15:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cc71bc73-24a0-5e1d-ad22-385c7e293354, identifier: GR17155
2026-01-29 06:15:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cc71bc73-24a0-5e1d-ad22-385c7e293354 with identifier: GR17155
2026-01-29 06:15:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cc71bc73-24a0-5e1d-ad22-385c7e293354 with identifier: GR17155
2026-01-29 06:15:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'manual', 'odometer': 31880, 'odometer_reading_unit': 'km', 'registration_date': '2021-05-25', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gr17155', 'expiration_date': '2026-01-29t16:07:38z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, villenoy', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 128, 'id': 'cc71bc73-24a0-5e1d-ad22-385c7e293354', 'current_year_diff': 5, 'age_in_months': 56, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 31880}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 56,
     'auction_title': '',
     'c_o_2_emission_value': 128,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:07:38z',
     'fuel_type': 'petrol',
     'id': 'cc71bc73-24a0-5e1d-ad22-385c7e293354',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gr17155',
     'listing': 'auction',
     'location': 'fr, villenoy',
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 31880,
     'odometer_in_km': 31880,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-05-25',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 1.2 puretech gt',
     'transmission': 'manual',
     'trim': 'gt',
     'year': 2021}
2026-01-29 06:15:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: cc71bc73-24a0-5e1d-ad22-385c7e293354 spider: auto1.fr
2026-01-29 06:15:25 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: cc71bc73-24a0-5e1d-ad22-385c7e293354 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'manual', 'odometer': 31880, 'odometer_reading_unit': 'km', 'registration_date': '2021-05-25', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gr17155', 'expiration_date': '2026-01-29t16:07:38z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, villenoy', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 128, 'id': 'cc71bc73-24a0-5e1d-ad22-385c7e293354', 'current_year_diff': 5, 'age_in_months': 56, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 31880}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 56,
     'auction_title': '',
     'c_o_2_emission_value': 128,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:07:38z',
     'fuel_type': 'petrol',
     'id': 'cc71bc73-24a0-5e1d-ad22-385c7e293354',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gr17155',
     'listing': 'auction',
     'location': 'fr, villenoy',
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 31880,
     'odometer_in_km': 31880,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-05-25',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 1.2 puretech gt',
     'transmission': 'manual',
     'trim': 'gt',
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:07:38Z',
 'fuel_type': 'petrol',
 'id': 'cc71bc73-24a0-5e1d-ad22-385c7e293354',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR17155',
 'listing': 'auction',
 'location': 'FR, Villenoy',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 31880,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.2 PureTech GT',
 'transmission': 'manual',
 'trim': 'GT',
 'year': 2021}
2026-01-29 06:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GR17155%27 HTTP/1.1" 200 None
2026-01-29 06:15:25 [auto1.fr] INFO: Saving data for GR17155: {'auction_closing_time': 1769702858.0, 'created_time': 1766598479.92799, 'last_price_update_time': 1769667325.444617}
2026-01-29 06:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GR17155') HTTP/1.1" 204 0
2026-01-29 06:15:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SE24899> (referer: https://www.auto1.com/v1/car-details-view/SE24899/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:15:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:15:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/US58546/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:15:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:15:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ddc6bc7-dae9-5005-af52-f8f1eb6c4e5c with identifier: SE24899
2026-01-29 06:15:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ddc6bc7-dae9-5005-af52-f8f1eb6c4e5c with scrape type 2
2026-01-29 06:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ddc6bc7-dae9-5005-af52-f8f1eb6c4e5c with scrape type 2
2026-01-29 06:15:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8ddc6bc7-dae9-5005-af52-f8f1eb6c4e5c, identifier: SE24899
2026-01-29 06:15:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8ddc6bc7-dae9-5005-af52-f8f1eb6c4e5c with identifier: SE24899
2026-01-29 06:15:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8ddc6bc7-dae9-5005-af52-f8f1eb6c4e5c with identifier: SE24899
2026-01-29 06:15:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 e-thp gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 119995, 'odometer_reading_unit': 'km', 'registration_date': '2019-05-19', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/se24899', 'expiration_date': '2026-01-29t16:22:32z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, mougins', 'category': None, 'seats_number': 5, 'c_o_2_emission_value': 117, 'id': '8ddc6bc7-dae9-5005-af52-f8f1eb6c4e5c', 'current_year_diff': 7, 'age_in_months': 80, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 119995}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 80,
     'auction_title': '',
     'c_o_2_emission_value': 117,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:22:32z',
     'fuel_type': 'petrol',
     'id': '8ddc6bc7-dae9-5005-af52-f8f1eb6c4e5c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/se24899',
     'listing': 'auction',
     'location': 'fr, mougins',
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 119995,
     'odometer_in_km': 119995,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-05-19',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 1.2 e-thp gt line',
     'transmission': 'automatic',
     'trim': 'gt line',
     'year': 2019}
2026-01-29 06:15:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 8ddc6bc7-dae9-5005-af52-f8f1eb6c4e5c spider: auto1.fr
2026-01-29 06:15:25 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 8ddc6bc7-dae9-5005-af52-f8f1eb6c4e5c due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 e-thp gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 119995, 'odometer_reading_unit': 'km', 'registration_date': '2019-05-19', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/se24899', 'expiration_date': '2026-01-29t16:22:32z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, mougins', 'category': None, 'seats_number': 5, 'c_o_2_emission_value': 117, 'id': '8ddc6bc7-dae9-5005-af52-f8f1eb6c4e5c', 'current_year_diff': 7, 'age_in_months': 80, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 119995}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 80,
     'auction_title': '',
     'c_o_2_emission_value': 117,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:22:32z',
     'fuel_type': 'petrol',
     'id': '8ddc6bc7-dae9-5005-af52-f8f1eb6c4e5c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/se24899',
     'listing': 'auction',
     'location': 'fr, mougins',
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 119995,
     'odometer_in_km': 119995,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-05-19',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 1.2 e-thp gt line',
     'transmission': 'automatic',
     'trim': 'gt line',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:22:32Z',
 'fuel_type': 'petrol',
 'id': '8ddc6bc7-dae9-5005-af52-f8f1eb6c4e5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE24899',
 'listing': 'auction',
 'location': 'FR, MOUGINS',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 119995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2019}
2026-01-29 06:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SE24899%27 HTTP/1.1" 200 None
2026-01-29 06:15:25 [auto1.fr] INFO: Saving data for SE24899: {'auction_closing_time': 1769703752.0, 'created_time': 1769449018.219041, 'last_price_update_time': 1769667325.967224}
2026-01-29 06:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SE24899') HTTP/1.1" 204 0
2026-01-29 06:15:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DA14954> (referer: https://www.auto1.com/v1/car-details-view/DA14954/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:15:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:15:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e59ad2b8-5412-5fa7-87f4-b2be7a9b0bee with identifier: DA14954
2026-01-29 06:15:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e59ad2b8-5412-5fa7-87f4-b2be7a9b0bee with scrape type 2
2026-01-29 06:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e59ad2b8-5412-5fa7-87f4-b2be7a9b0bee with scrape type 2
2026-01-29 06:15:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e59ad2b8-5412-5fa7-87f4-b2be7a9b0bee, identifier: DA14954
2026-01-29 06:15:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e59ad2b8-5412-5fa7-87f4-b2be7a9b0bee with identifier: DA14954
2026-01-29 06:15:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e59ad2b8-5412-5fa7-87f4-b2be7a9b0bee with identifier: DA14954
2026-01-29 06:15:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel corsa 1.2 elegance business', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'corsa', 'transmission': 'manual', 'odometer': 24359, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/da14954', 'expiration_date': '2026-01-29t16:06:22z', 'origin_country_code': 'fr', 'trim': 'elegance business', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, tarnos', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'e59ad2b8-5412-5fa7-87f4-b2be7a9b0bee', 'current_year_diff': 4, 'age_in_months': 43, 'make_model': 'opel corsa', 'sanitized_make': 'opel', 'odometer_in_km': 24359}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 43,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 75,
     'expiration_date': '2026-01-29t16:06:22z',
     'fuel_type': 'petrol',
     'id': 'e59ad2b8-5412-5fa7-87f4-b2be7a9b0bee',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/da14954',
     'listing': 'auction',
     'location': 'fr, tarnos',
     'make': 'opel',
     'make_model': 'opel corsa',
     'model': 'corsa',
     'odometer': 24359,
     'odometer_in_km': 24359,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-06-29',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel corsa 1.2 elegance business',
     'transmission': 'manual',
     'trim': 'elegance business',
     'year': 2022}
2026-01-29 06:15:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: e59ad2b8-5412-5fa7-87f4-b2be7a9b0bee spider: auto1.fr
2026-01-29 06:15:26 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: e59ad2b8-5412-5fa7-87f4-b2be7a9b0bee due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel corsa 1.2 elegance business', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'corsa', 'transmission': 'manual', 'odometer': 24359, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/da14954', 'expiration_date': '2026-01-29t16:06:22z', 'origin_country_code': 'fr', 'trim': 'elegance business', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, tarnos', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'e59ad2b8-5412-5fa7-87f4-b2be7a9b0bee', 'current_year_diff': 4, 'age_in_months': 43, 'make_model': 'opel corsa', 'sanitized_make': 'opel', 'odometer_in_km': 24359}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 43,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 75,
     'expiration_date': '2026-01-29t16:06:22z',
     'fuel_type': 'petrol',
     'id': 'e59ad2b8-5412-5fa7-87f4-b2be7a9b0bee',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/da14954',
     'listing': 'auction',
     'location': 'fr, tarnos',
     'make': 'opel',
     'make_model': 'opel corsa',
     'model': 'corsa',
     'odometer': 24359,
     'odometer_in_km': 24359,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-06-29',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel corsa 1.2 elegance business',
     'transmission': 'manual',
     'trim': 'elegance business',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:06:22Z',
 'fuel_type': 'petrol',
 'id': 'e59ad2b8-5412-5fa7-87f4-b2be7a9b0bee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA14954',
 'listing': 'auction',
 'location': 'FR, TARNOS',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 24359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Elegance Business',
 'transmission': 'manual',
 'trim': 'Elegance Business',
 'year': 2022}
2026-01-29 06:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DA14954%27 HTTP/1.1" 200 None
2026-01-29 06:15:26 [auto1.fr] INFO: Saving data for DA14954: {'auction_closing_time': 1769702782.0, 'created_time': 1769533900.263855, 'last_price_update_time': 1769667326.696842}
2026-01-29 06:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DA14954') HTTP/1.1" 204 0
2026-01-29 06:15:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TA74732> (referer: https://www.auto1.com/v1/car-details-view/TA74732/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:15:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:15:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 806b533d-3ebd-5601-8cbd-f4d2d4800e24 with identifier: TA74732
2026-01-29 06:15:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 806b533d-3ebd-5601-8cbd-f4d2d4800e24 with scrape type 2
2026-01-29 06:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 806b533d-3ebd-5601-8cbd-f4d2d4800e24 with scrape type 2
2026-01-29 06:15:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 806b533d-3ebd-5601-8cbd-f4d2d4800e24, identifier: TA74732
2026-01-29 06:15:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 806b533d-3ebd-5601-8cbd-f4d2d4800e24 with identifier: TA74732
2026-01-29 06:15:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 806b533d-3ebd-5601-8cbd-f4d2d4800e24 with identifier: TA74732
2026-01-29 06:15:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 806b533d-3ebd-5601-8cbd-f4d2d4800e24 with identifier: TA74732 to the API
2026-01-29 06:15:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:15:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:15:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TA74732>
{'auction_title': '',
 'c_o_2_emission_value': 71,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 457,
 'expiration_date': '2026-01-29T16:17:25Z',
 'fuel_type': 'hybrid',
 'id': '806b533d-3ebd-5601-8cbd-f4d2d4800e24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA74732',
 'listing': 'auction',
 'location': 'FR, LA CHAPELLE LONGUEVILLE',
 'make': 'Ford',
 'model': 'Explorer',
 'odometer': 83907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-03',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Ford Explorer 3.0 Plug-in Hybrid 4x4 ST-Line',
 'transmission': 'automatic',
 'trim': '4x4 ST-Line',
 'year': 2022}
2026-01-29 06:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA74732%27 HTTP/1.1" 200 None
2026-01-29 06:15:27 [auto1.fr] INFO: Saving data for TA74732: {'auction_closing_time': 1769703445.0, 'created_time': 1769061807.934713, 'last_price_update_time': 1769667327.462132}
2026-01-29 06:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TA74732') HTTP/1.1" 204 0
2026-01-29 06:15:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HY98668/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:15:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:15:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:15:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:15:29 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:15:29 [auto1.fr] INFO: Found listing with ID: YM52260
2026-01-29 06:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YM52260%27 HTTP/1.1" 200 None
2026-01-29 06:15:29 [auto1.fr] INFO: Scrape type for YM52260: 0
2026-01-29 06:15:29 [auto1.fr] INFO: Found listing with ID: BM43404
2026-01-29 06:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BM43404%27 HTTP/1.1" 200 None
2026-01-29 06:15:29 [auto1.fr] INFO: Scrape type for BM43404: 2
2026-01-29 06:15:29 [auto1.fr] INFO: Found listing with ID: RT74055
2026-01-29 06:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RT74055%27 HTTP/1.1" 200 None
2026-01-29 06:15:29 [auto1.fr] INFO: Scrape type for RT74055: 2
2026-01-29 06:15:29 [auto1.fr] INFO: Found listing with ID: MW65975
2026-01-29 06:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MW65975%27 HTTP/1.1" 200 None
2026-01-29 06:15:29 [auto1.fr] INFO: Scrape type for MW65975: 0
2026-01-29 06:15:29 [auto1.fr] INFO: Found listing with ID: RK51734
2026-01-29 06:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RK51734%27 HTTP/1.1" 200 None
2026-01-29 06:15:29 [auto1.fr] INFO: Scrape type for RK51734: 2
2026-01-29 06:15:29 [auto1.fr] INFO: Found listing with ID: BM94017
2026-01-29 06:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BM94017%27 HTTP/1.1" 200 None
2026-01-29 06:15:29 [auto1.fr] INFO: Scrape type for BM94017: 2
2026-01-29 06:15:29 [auto1.fr] INFO: Found listing with ID: KY15407
2026-01-29 06:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KY15407%27 HTTP/1.1" 200 None
2026-01-29 06:15:29 [auto1.fr] INFO: Scrape type for KY15407: 2
2026-01-29 06:15:29 [auto1.fr] INFO: Found listing with ID: WX54036
2026-01-29 06:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WX54036%27 HTTP/1.1" 200 None
2026-01-29 06:15:29 [auto1.fr] INFO: Scrape type for WX54036: 2
2026-01-29 06:15:29 [auto1.fr] INFO: Found listing with ID: KR14598
2026-01-29 06:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KR14598%27 HTTP/1.1" 200 None
2026-01-29 06:15:29 [auto1.fr] INFO: Scrape type for KR14598: 2
2026-01-29 06:15:29 [auto1.fr] INFO: Found listing with ID: ZW46500
2026-01-29 06:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZW46500%27 HTTP/1.1" 200 None
2026-01-29 06:15:29 [auto1.fr] INFO: Scrape type for ZW46500: 0
2026-01-29 06:15:29 [auto1.fr] INFO: Found listing with ID: GF93617
2026-01-29 06:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF93617%27 HTTP/1.1" 200 None
2026-01-29 06:15:29 [auto1.fr] INFO: Scrape type for GF93617: 2
2026-01-29 06:15:29 [auto1.fr] INFO: Found listing with ID: FL30620
2026-01-29 06:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FL30620%27 HTTP/1.1" 200 None
2026-01-29 06:15:29 [auto1.fr] INFO: Scrape type for FL30620: 2
2026-01-29 06:15:29 [auto1.fr] INFO: Found listing with ID: FU48055
2026-01-29 06:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FU48055%27 HTTP/1.1" 200 None
2026-01-29 06:15:29 [auto1.fr] INFO: Scrape type for FU48055: 2
2026-01-29 06:15:29 [auto1.fr] INFO: Found listing with ID: UL44230
2026-01-29 06:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL44230%27 HTTP/1.1" 200 None
2026-01-29 06:15:30 [auto1.fr] INFO: Scrape type for UL44230: 2
2026-01-29 06:15:30 [auto1.fr] INFO: Found listing with ID: BS60557
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BS60557%27 HTTP/1.1" 200 None
2026-01-29 06:15:30 [auto1.fr] INFO: Scrape type for BS60557: 0
2026-01-29 06:15:30 [auto1.fr] INFO: Found listing with ID: AV64539
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV64539%27 HTTP/1.1" 200 None
2026-01-29 06:15:30 [auto1.fr] INFO: Scrape type for AV64539: 2
2026-01-29 06:15:30 [auto1.fr] INFO: Found listing with ID: YF36553
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YF36553%27 HTTP/1.1" 200 None
2026-01-29 06:15:30 [auto1.fr] INFO: Scrape type for YF36553: 0
2026-01-29 06:15:30 [auto1.fr] INFO: Found listing with ID: EH43016
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EH43016%27 HTTP/1.1" 200 None
2026-01-29 06:15:30 [auto1.fr] INFO: Scrape type for EH43016: 2
2026-01-29 06:15:30 [auto1.fr] INFO: Found listing with ID: FH12109
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FH12109%27 HTTP/1.1" 200 None
2026-01-29 06:15:30 [auto1.fr] INFO: Scrape type for FH12109: 0
2026-01-29 06:15:30 [auto1.fr] INFO: Found listing with ID: UT37872
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT37872%27 HTTP/1.1" 200 None
2026-01-29 06:15:30 [auto1.fr] INFO: Scrape type for UT37872: 2
2026-01-29 06:15:30 [auto1.fr] INFO: Found listing with ID: VN63191
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN63191%27 HTTP/1.1" 200 None
2026-01-29 06:15:30 [auto1.fr] INFO: Scrape type for VN63191: 0
2026-01-29 06:15:30 [auto1.fr] INFO: Found listing with ID: BC92675
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BC92675%27 HTTP/1.1" 200 None
2026-01-29 06:15:30 [auto1.fr] INFO: Scrape type for BC92675: 0
2026-01-29 06:15:30 [auto1.fr] INFO: Found listing with ID: MC08975
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC08975%27 HTTP/1.1" 200 None
2026-01-29 06:15:30 [auto1.fr] INFO: Scrape type for MC08975: 2
2026-01-29 06:15:30 [auto1.fr] INFO: Found listing with ID: WK52565
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WK52565%27 HTTP/1.1" 200 None
2026-01-29 06:15:30 [auto1.fr] INFO: Scrape type for WK52565: 0
2026-01-29 06:15:30 [auto1.fr] INFO: Found listing with ID: VA07916
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VA07916%27 HTTP/1.1" 200 None
2026-01-29 06:15:30 [auto1.fr] INFO: Scrape type for VA07916: 2
2026-01-29 06:15:30 [auto1.fr] INFO: Found listing with ID: GE50772
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GE50772%27 HTTP/1.1" 200 None
2026-01-29 06:15:30 [auto1.fr] INFO: Scrape type for GE50772: 2
2026-01-29 06:15:30 [auto1.fr] INFO: Found listing with ID: HC75422
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC75422%27 HTTP/1.1" 200 None
2026-01-29 06:15:30 [auto1.fr] INFO: Scrape type for HC75422: 0
2026-01-29 06:15:30 [auto1.fr] INFO: Found listing with ID: UW37728
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UW37728%27 HTTP/1.1" 200 None
2026-01-29 06:15:30 [auto1.fr] INFO: Scrape type for UW37728: 0
2026-01-29 06:15:30 [auto1.fr] INFO: Found listing with ID: FM22383
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FM22383%27 HTTP/1.1" 200 None
2026-01-29 06:15:30 [auto1.fr] INFO: Scrape type for FM22383: 2
2026-01-29 06:15:30 [auto1.fr] INFO: Found listing with ID: CG65710
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CG65710%27 HTTP/1.1" 200 None
2026-01-29 06:15:30 [auto1.fr] INFO: Scrape type for CG65710: 0
2026-01-29 06:15:30 [auto1.fr] INFO: Found listing with ID: MA22170
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MA22170%27 HTTP/1.1" 200 None
2026-01-29 06:15:30 [auto1.fr] INFO: Scrape type for MA22170: 0
2026-01-29 06:15:30 [auto1.fr] INFO: Found listing with ID: EC06252
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EC06252%27 HTTP/1.1" 200 None
2026-01-29 06:15:30 [auto1.fr] INFO: Scrape type for EC06252: 2
2026-01-29 06:15:30 [auto1.fr] INFO: Found listing with ID: ZP54568
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP54568%27 HTTP/1.1" 200 None
2026-01-29 06:15:30 [auto1.fr] INFO: Scrape type for ZP54568: 2
2026-01-29 06:15:30 [auto1.fr] INFO: Found listing with ID: SM03584
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SM03584%27 HTTP/1.1" 200 None
2026-01-29 06:15:30 [auto1.fr] INFO: Scrape type for SM03584: 0
2026-01-29 06:15:30 [auto1.fr] INFO: Found listing with ID: NF05150
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NF05150%27 HTTP/1.1" 200 None
2026-01-29 06:15:30 [auto1.fr] INFO: Scrape type for NF05150: 2
2026-01-29 06:15:30 [auto1.fr] INFO: Found listing with ID: CC53284
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CC53284%27 HTTP/1.1" 200 None
2026-01-29 06:15:30 [auto1.fr] INFO: Scrape type for CC53284: 2
2026-01-29 06:15:30 [auto1.fr] INFO: Found listing with ID: SV63833
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV63833%27 HTTP/1.1" 200 None
2026-01-29 06:15:30 [auto1.fr] INFO: Scrape type for SV63833: 0
2026-01-29 06:15:30 [auto1.fr] INFO: Found listing with ID: WT94356
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WT94356%27 HTTP/1.1" 200 None
2026-01-29 06:15:30 [auto1.fr] INFO: Scrape type for WT94356: 0
2026-01-29 06:15:30 [auto1.fr] INFO: Found listing with ID: RP45777
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RP45777%27 HTTP/1.1" 200 None
2026-01-29 06:15:30 [auto1.fr] INFO: Scrape type for RP45777: 2
2026-01-29 06:15:30 [auto1.fr] INFO: Found listing with ID: VK62240
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VK62240%27 HTTP/1.1" 200 None
2026-01-29 06:15:30 [auto1.fr] INFO: Scrape type for VK62240: 0
2026-01-29 06:15:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HK33509/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:15:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:15:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/US58546> (referer: https://www.auto1.com/v1/car-details-view/US58546/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:15:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:15:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 612ffed8-e981-57c5-ab3a-d8903458b2f6 with identifier: US58546
2026-01-29 06:15:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 612ffed8-e981-57c5-ab3a-d8903458b2f6 with scrape type 2
2026-01-29 06:15:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 612ffed8-e981-57c5-ab3a-d8903458b2f6 with scrape type 2
2026-01-29 06:15:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 612ffed8-e981-57c5-ab3a-d8903458b2f6, identifier: US58546
2026-01-29 06:15:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 612ffed8-e981-57c5-ab3a-d8903458b2f6 with identifier: US58546
2026-01-29 06:15:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 612ffed8-e981-57c5-ab3a-d8903458b2f6 with identifier: US58546
2026-01-29 06:15:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 612ffed8-e981-57c5-ab3a-d8903458b2f6 with identifier: US58546 to the API
2026-01-29 06:15:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:15:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:15:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/US58546>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 170,
 'expiration_date': '2026-01-29T16:35:05Z',
 'fuel_type': 'diesel',
 'id': '612ffed8-e981-57c5-ab3a-d8903458b2f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US58546',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 120056,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic Executive',
 'transmission': 'automatic',
 'trim': '4Matic Executive',
 'year': 2019}
2026-01-29 06:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27US58546%27 HTTP/1.1" 200 None
2026-01-29 06:15:43 [auto1.fr] INFO: Saving data for US58546: {'auction_closing_time': 1769704505.0, 'created_time': 1767719457.526488, 'last_price_update_time': 1769667343.902738}
2026-01-29 06:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='US58546') HTTP/1.1" 204 0
2026-01-29 06:15:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HY98668> (referer: https://www.auto1.com/v1/car-details-view/HY98668/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:15:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HC30752/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:15:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:15:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:15:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4819d591-0b40-595b-986b-06a4f8730215 with identifier: HY98668
2026-01-29 06:15:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4819d591-0b40-595b-986b-06a4f8730215 with scrape type 2
2026-01-29 06:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4819d591-0b40-595b-986b-06a4f8730215 with scrape type 2
2026-01-29 06:15:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4819d591-0b40-595b-986b-06a4f8730215, identifier: HY98668
2026-01-29 06:15:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4819d591-0b40-595b-986b-06a4f8730215 with identifier: HY98668
2026-01-29 06:15:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4819d591-0b40-595b-986b-06a4f8730215 with identifier: HY98668
2026-01-29 06:15:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4819d591-0b40-595b-986b-06a4f8730215 with identifier: HY98668 to the API
2026-01-29 06:15:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:15:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:15:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HY98668>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:28:25Z',
 'fuel_type': 'diesel',
 'id': '4819d591-0b40-595b-986b-06a4f8730215',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY98668',
 'listing': 'auction',
 'location': 'FR, Creutzwald',
 'make': 'BMW',
 'model': '2er',
 'odometer': 79746,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2er 220d Gran Coupe xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2020}
2026-01-29 06:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HY98668%27 HTTP/1.1" 200 None
2026-01-29 06:15:44 [auto1.fr] INFO: Saving data for HY98668: {'auction_closing_time': 1769704105.0, 'created_time': 1769449243.859829, 'last_price_update_time': 1769667344.514476}
2026-01-29 06:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HY98668') HTTP/1.1" 204 0
2026-01-29 06:15:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CM55077> (referer: https://www.auto1.com/v1/car-details-view/CM55077/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:15:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:15:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a38b26b-0587-5fb2-a2ec-aa72cc08a208 with identifier: CM55077
2026-01-29 06:15:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a38b26b-0587-5fb2-a2ec-aa72cc08a208 with scrape type 2
2026-01-29 06:15:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a38b26b-0587-5fb2-a2ec-aa72cc08a208 with scrape type 2
2026-01-29 06:15:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4a38b26b-0587-5fb2-a2ec-aa72cc08a208, identifier: CM55077
2026-01-29 06:15:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4a38b26b-0587-5fb2-a2ec-aa72cc08a208 with identifier: CM55077
2026-01-29 06:15:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4a38b26b-0587-5fb2-a2ec-aa72cc08a208 with identifier: CM55077
2026-01-29 06:15:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'ranger' containing 'ranger'
2026-01-29 06:15:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 4a38b26b-0587-5fb2-a2ec-aa72cc08a208 spider: auto1.fr
2026-01-29 06:15:45 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 4a38b26b-0587-5fb2-a2ec-aa72cc08a208 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'ranger' containing 'ranger'
{'auction_title': '',
 'c_o_2_emission_value': 228,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '3.2L',
 'engine_horse_power': 200,
 'expiration_date': '2026-01-29T16:05:15Z',
 'fuel_type': 'diesel',
 'id': '4a38b26b-0587-5fb2-a2ec-aa72cc08a208',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM55077',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 117027,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Ranger 3.2 TDCi Doppelkabine 4x4 Wildtrak',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Wildtrak',
 'year': 2018}
2026-01-29 06:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CM55077%27 HTTP/1.1" 200 None
2026-01-29 06:15:45 [auto1.fr] INFO: Saving data for CM55077: {'auction_closing_time': 1769702715.0, 'created_time': 1769533995.785496, 'last_price_update_time': 1769667345.854215}
2026-01-29 06:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CM55077') HTTP/1.1" 204 0
2026-01-29 06:15:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NC83296> (referer: https://www.auto1.com/v1/car-details-view/NC83296/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:15:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:15:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c78d319f-c9fd-5e72-9d53-d0d048a93a0a with identifier: NC83296
2026-01-29 06:15:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c78d319f-c9fd-5e72-9d53-d0d048a93a0a with scrape type 2
2026-01-29 06:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c78d319f-c9fd-5e72-9d53-d0d048a93a0a with scrape type 2
2026-01-29 06:15:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c78d319f-c9fd-5e72-9d53-d0d048a93a0a, identifier: NC83296
2026-01-29 06:15:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c78d319f-c9fd-5e72-9d53-d0d048a93a0a with identifier: NC83296
2026-01-29 06:15:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c78d319f-c9fd-5e72-9d53-d0d048a93a0a with identifier: NC83296
2026-01-29 06:15:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2026-01-29 06:15:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: c78d319f-c9fd-5e72-9d53-d0d048a93a0a spider: auto1.fr
2026-01-29 06:15:46 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: c78d319f-c9fd-5e72-9d53-d0d048a93a0a due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:53:47Z',
 'fuel_type': 'diesel',
 'id': 'c78d319f-c9fd-5e72-9d53-d0d048a93a0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC83296',
 'listing': 'auction',
 'location': 'FR, Quincieux',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 100993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-02',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Peugeot Partner 1.5 Blue-HDi Grip L1',
 'transmission': 'manual',
 'trim': 'Grip L1',
 'year': 2020}
2026-01-29 06:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NC83296%27 HTTP/1.1" 200 None
2026-01-29 06:15:46 [auto1.fr] INFO: Saving data for NC83296: {'auction_closing_time': 1769705627.0, 'created_time': 1769533425.427582, 'last_price_update_time': 1769667346.617464}
2026-01-29 06:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NC83296') HTTP/1.1" 204 0
2026-01-29 06:15:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:15:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:15:47 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: XL56912
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XL56912%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for XL56912: 2
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: YY43314
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YY43314%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for YY43314: 2
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: PF09129
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF09129%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for PF09129: 2
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: SX67867
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SX67867%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for SX67867: 0
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: AY83940
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AY83940%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for AY83940: 0
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: YA72966
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YA72966%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for YA72966: 2
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: WM08681
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM08681%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for WM08681: 2
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: XS96199
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XS96199%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for XS96199: 2
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: BK54346
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BK54346%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for BK54346: 2
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: JK43883
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JK43883%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for JK43883: 2
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: YH56697
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YH56697%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for YH56697: 2
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: FL41948
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FL41948%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for FL41948: 2
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: NT37660
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NT37660%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for NT37660: 2
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: KU98574
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KU98574%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for KU98574: 0
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: BS58270
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BS58270%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for BS58270: 0
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: LG90693
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LG90693%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for LG90693: 0
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: ZT14321
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZT14321%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for ZT14321: 0
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: AB70525
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AB70525%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for AB70525: 0
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: WU79860
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU79860%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for WU79860: 2
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: WB13363
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB13363%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for WB13363: 2
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: DC25219
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DC25219%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for DC25219: 2
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: EY98812
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EY98812%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for EY98812: 0
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: WK73205
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WK73205%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for WK73205: 2
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: KN28885
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KN28885%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for KN28885: 2
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: VA25102
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VA25102%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for VA25102: 0
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: UZ15055
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UZ15055%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for UZ15055: 0
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: TA97799
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA97799%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for TA97799: 2
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: VF09133
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VF09133%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for VF09133: 2
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: DC30957
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DC30957%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for DC30957: 2
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: PY87648
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY87648%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for PY87648: 0
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: PL30560
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PL30560%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for PL30560: 0
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: YY54326
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YY54326%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for YY54326: 0
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: CU15195
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CU15195%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for CU15195: 2
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: SF14121
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF14121%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for SF14121: 0
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: BK00017
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BK00017%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for BK00017: 0
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: EL96659
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EL96659%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for EL96659: 0
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: AH07009
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AH07009%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for AH07009: 2
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: BG56824
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BG56824%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for BG56824: 0
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: DX75820
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DX75820%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for DX75820: 2
2026-01-29 06:15:47 [auto1.fr] INFO: Found listing with ID: XT29816
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XT29816%27 HTTP/1.1" 200 None
2026-01-29 06:15:47 [auto1.fr] INFO: Scrape type for XT29816: 0
2026-01-29 06:15:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BM43404/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:15:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:15:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KY15407/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:15:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:16:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BM94017/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:16:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:16:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RK51734/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:16:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:16:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HK33509> (referer: https://www.auto1.com/v1/car-details-view/HK33509/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:16:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:16:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02e68d32-11c2-5946-8084-c2e1e6a074bf with identifier: HK33509
2026-01-29 06:16:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02e68d32-11c2-5946-8084-c2e1e6a074bf with scrape type 2
2026-01-29 06:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02e68d32-11c2-5946-8084-c2e1e6a074bf with scrape type 2
2026-01-29 06:16:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 02e68d32-11c2-5946-8084-c2e1e6a074bf, identifier: HK33509
2026-01-29 06:16:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 02e68d32-11c2-5946-8084-c2e1e6a074bf with identifier: HK33509
2026-01-29 06:16:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 02e68d32-11c2-5946-8084-c2e1e6a074bf with identifier: HK33509
2026-01-29 06:16:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 02e68d32-11c2-5946-8084-c2e1e6a074bf with identifier: HK33509 to the API
2026-01-29 06:16:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:16:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:16:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HK33509>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:29:44Z',
 'fuel_type': 'diesel',
 'id': '02e68d32-11c2-5946-8084-c2e1e6a074bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK33509',
 'listing': 'auction',
 'location': 'FR, Warluis',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 56690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 d Sensation',
 'transmission': 'automatic',
 'trim': 'Sensation',
 'year': 2019}
2026-01-29 06:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK33509%27 HTTP/1.1" 200 None
2026-01-29 06:16:06 [auto1.fr] INFO: Saving data for HK33509: {'auction_closing_time': 1769704184.0, 'created_time': 1768889221.424784, 'last_price_update_time': 1769667366.552491}
2026-01-29 06:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HK33509') HTTP/1.1" 204 0
2026-01-29 06:16:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CC53284/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:16:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:16:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NF05150/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:16:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:16:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZP54568/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:16:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:16:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BU04449> (referer: https://www.auto1.com/v1/car-details-view/BU04449/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:16:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:16:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7a1598a-e092-5261-9ded-2ac7b20c2cef with identifier: BU04449
2026-01-29 06:16:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7a1598a-e092-5261-9ded-2ac7b20c2cef with scrape type 2
2026-01-29 06:16:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7a1598a-e092-5261-9ded-2ac7b20c2cef with scrape type 2
2026-01-29 06:16:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f7a1598a-e092-5261-9ded-2ac7b20c2cef, identifier: BU04449
2026-01-29 06:16:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f7a1598a-e092-5261-9ded-2ac7b20c2cef with identifier: BU04449
2026-01-29 06:16:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f7a1598a-e092-5261-9ded-2ac7b20c2cef with identifier: BU04449
2026-01-29 06:16:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f7a1598a-e092-5261-9ded-2ac7b20c2cef with identifier: BU04449 to the API
2026-01-29 06:16:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:16:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:16:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BU04449>
{'auction_title': '',
 'c_o_2_emission_value': 93,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 72,
 'expiration_date': '2026-01-29T16:07:50Z',
 'fuel_type': 'petrol',
 'id': 'f7a1598a-e092-5261-9ded-2ac7b20c2cef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU04449',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Peugeot',
 'model': '108',
 'odometer': 63797,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-27',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Peugeot 108 1.0 VTi Access',
 'transmission': 'manual',
 'trim': 'Access',
 'year': 2018}
2026-01-29 06:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BU04449%27 HTTP/1.1" 200 None
2026-01-29 06:16:12 [auto1.fr] INFO: Saving data for BU04449: {'auction_closing_time': 1769702870.0, 'created_time': 1769190347.342082, 'last_price_update_time': 1769667372.974803}
2026-01-29 06:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BU04449') HTTP/1.1" 204 0
2026-01-29 06:16:12 [scrapy.extensions.logstats] INFO: Crawled 1128 pages (at 28 pages/min), scraped 246 items (at 6 items/min)
2026-01-29 06:16:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FV70132/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:16:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:16:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BM43404> (referer: https://www.auto1.com/v1/car-details-view/BM43404/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:16:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:16:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2086b86f-f217-50b1-b6b5-124ffe8ad2c1 with identifier: BM43404
2026-01-29 06:16:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2086b86f-f217-50b1-b6b5-124ffe8ad2c1 with scrape type 2
2026-01-29 06:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2086b86f-f217-50b1-b6b5-124ffe8ad2c1 with scrape type 2
2026-01-29 06:16:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2086b86f-f217-50b1-b6b5-124ffe8ad2c1, identifier: BM43404
2026-01-29 06:16:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2086b86f-f217-50b1-b6b5-124ffe8ad2c1 with identifier: BM43404
2026-01-29 06:16:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2086b86f-f217-50b1-b6b5-124ffe8ad2c1 with identifier: BM43404
2026-01-29 06:16:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2086b86f-f217-50b1-b6b5-124ffe8ad2c1 with identifier: BM43404 to the API
2026-01-29 06:16:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:16:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:16:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BM43404>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 184,
 'expiration_date': '2026-01-29T16:05:27Z',
 'fuel_type': 'hybrid',
 'id': '2086b86f-f217-50b1-b6b5-124ffe8ad2c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM43404',
 'listing': 'auction',
 'location': 'FR, Warluis',
 'make': 'BMW',
 'model': '3er',
 'odometer': 67273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-08-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 330e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2023}
2026-01-29 06:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BM43404%27 HTTP/1.1" 200 None
2026-01-29 06:16:15 [auto1.fr] INFO: Saving data for BM43404: {'auction_closing_time': 1769702727.0, 'created_time': 1764781759.959467, 'last_price_update_time': 1769667375.679589}
2026-01-29 06:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BM43404') HTTP/1.1" 204 0
2026-01-29 06:16:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DX75820/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:16:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:16:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KY15407> (referer: https://www.auto1.com/v1/car-details-view/KY15407/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:16:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:16:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0da4ebea-d7be-5fa3-a4b7-7b6a61dd7e22 with identifier: KY15407
2026-01-29 06:16:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0da4ebea-d7be-5fa3-a4b7-7b6a61dd7e22 with scrape type 2
2026-01-29 06:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0da4ebea-d7be-5fa3-a4b7-7b6a61dd7e22 with scrape type 2
2026-01-29 06:16:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0da4ebea-d7be-5fa3-a4b7-7b6a61dd7e22, identifier: KY15407
2026-01-29 06:16:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0da4ebea-d7be-5fa3-a4b7-7b6a61dd7e22 with identifier: KY15407
2026-01-29 06:16:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0da4ebea-d7be-5fa3-a4b7-7b6a61dd7e22 with identifier: KY15407
2026-01-29 06:16:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0da4ebea-d7be-5fa3-a4b7-7b6a61dd7e22 with identifier: KY15407 to the API
2026-01-29 06:16:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:16:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:16:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KY15407>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:30:37Z',
 'fuel_type': 'diesel',
 'id': '0da4ebea-d7be-5fa3-a4b7-7b6a61dd7e22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY15407',
 'listing': 'auction',
 'location': 'FR, Le Cellier',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 124225,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 xDrive 18d M Sport X',
 'transmission': 'automatic',
 'trim': 'M Sport X',
 'year': 2019}
2026-01-29 06:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KY15407%27 HTTP/1.1" 200 None
2026-01-29 06:16:18 [auto1.fr] INFO: Saving data for KY15407: {'auction_closing_time': 1769704237.0, 'created_time': 1768025001.055621, 'last_price_update_time': 1769667378.147242}
2026-01-29 06:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KY15407') HTTP/1.1" 204 0
2026-01-29 06:16:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WX54036/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:16:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:16:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BM94017> (referer: https://www.auto1.com/v1/car-details-view/BM94017/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:16:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:16:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a48977a2-8d3b-5ae4-bc2e-b90f71938d8d with identifier: BM94017
2026-01-29 06:16:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a48977a2-8d3b-5ae4-bc2e-b90f71938d8d with scrape type 2
2026-01-29 06:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a48977a2-8d3b-5ae4-bc2e-b90f71938d8d with scrape type 2
2026-01-29 06:16:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a48977a2-8d3b-5ae4-bc2e-b90f71938d8d, identifier: BM94017
2026-01-29 06:16:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a48977a2-8d3b-5ae4-bc2e-b90f71938d8d with identifier: BM94017
2026-01-29 06:16:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a48977a2-8d3b-5ae4-bc2e-b90f71938d8d with identifier: BM94017
2026-01-29 06:16:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a48977a2-8d3b-5ae4-bc2e-b90f71938d8d with identifier: BM94017 to the API
2026-01-29 06:16:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:16:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:16:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BM94017>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': 'Taxi',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 165,
 'expiration_date': '2026-01-29T16:47:12Z',
 'fuel_type': 'petrol',
 'id': 'a48977a2-8d3b-5ae4-bc2e-b90f71938d8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM94017',
 'listing': 'auction',
 'location': 'FR, Nanteuil-le-Haudouin',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 98409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 THP GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2017}
2026-01-29 06:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BM94017%27 HTTP/1.1" 200 None
2026-01-29 06:16:28 [auto1.fr] INFO: Saving data for BM94017: {'auction_closing_time': 1769705232.0, 'created_time': 1766598727.299121, 'last_price_update_time': 1769667388.15623}
2026-01-29 06:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BM94017') HTTP/1.1" 204 0
2026-01-29 06:16:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RK51734> (referer: https://www.auto1.com/v1/car-details-view/RK51734/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:16:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:16:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc4bcc05-91d1-51e2-83ef-c1782b38eca0 with identifier: RK51734
2026-01-29 06:16:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc4bcc05-91d1-51e2-83ef-c1782b38eca0 with scrape type 2
2026-01-29 06:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc4bcc05-91d1-51e2-83ef-c1782b38eca0 with scrape type 2
2026-01-29 06:16:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bc4bcc05-91d1-51e2-83ef-c1782b38eca0, identifier: RK51734
2026-01-29 06:16:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bc4bcc05-91d1-51e2-83ef-c1782b38eca0 with identifier: RK51734
2026-01-29 06:16:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bc4bcc05-91d1-51e2-83ef-c1782b38eca0 with identifier: RK51734
2026-01-29 06:16:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bc4bcc05-91d1-51e2-83ef-c1782b38eca0 with identifier: RK51734 to the API
2026-01-29 06:16:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:16:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:16:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RK51734>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-01-29T16:21:04Z',
 'fuel_type': 'petrol',
 'id': 'bc4bcc05-91d1-51e2-83ef-c1782b38eca0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK51734',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 49839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2021}
2026-01-29 06:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RK51734%27 HTTP/1.1" 200 None
2026-01-29 06:16:30 [auto1.fr] INFO: Saving data for RK51734: {'auction_closing_time': 1769703664.0, 'created_time': 1768818946.217435, 'last_price_update_time': 1769667390.134604}
2026-01-29 06:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RK51734') HTTP/1.1" 204 0
2026-01-29 06:16:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AH07009/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:16:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:16:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CC53284> (referer: https://www.auto1.com/v1/car-details-view/CC53284/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:16:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:16:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fabcad4-013c-5bce-b743-5986a5e651c3 with identifier: CC53284
2026-01-29 06:16:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fabcad4-013c-5bce-b743-5986a5e651c3 with scrape type 2
2026-01-29 06:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fabcad4-013c-5bce-b743-5986a5e651c3 with scrape type 2
2026-01-29 06:16:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6fabcad4-013c-5bce-b743-5986a5e651c3, identifier: CC53284
2026-01-29 06:16:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6fabcad4-013c-5bce-b743-5986a5e651c3 with identifier: CC53284
2026-01-29 06:16:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6fabcad4-013c-5bce-b743-5986a5e651c3 with identifier: CC53284
2026-01-29 06:16:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech feel pack', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'manual', 'odometer': 42000, 'odometer_reading_unit': 'km', 'registration_date': '2022-02-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cc53284', 'expiration_date': '2026-01-29t16:04:48z', 'origin_country_code': 'fr', 'trim': 'feel pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, allennes-les-marais', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '6fabcad4-013c-5bce-b743-5986a5e651c3', 'current_year_diff': 4, 'age_in_months': 47, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 42000}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 47,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:04:48z',
     'fuel_type': 'petrol',
     'id': '6fabcad4-013c-5bce-b743-5986a5e651c3',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cc53284',
     'listing': 'auction',
     'location': 'fr, allennes-les-marais',
     'make': 'citroen',
     'make_model': 'citroen c3 aircross',
     'model': 'c3 aircross',
     'odometer': 42000,
     'odometer_in_km': 42000,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-02-28',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 aircross 1.2 puretech feel pack',
     'transmission': 'manual',
     'trim': 'feel pack',
     'year': 2022}
2026-01-29 06:16:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 6fabcad4-013c-5bce-b743-5986a5e651c3 spider: auto1.fr
2026-01-29 06:16:36 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 6fabcad4-013c-5bce-b743-5986a5e651c3 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech feel pack', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'manual', 'odometer': 42000, 'odometer_reading_unit': 'km', 'registration_date': '2022-02-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cc53284', 'expiration_date': '2026-01-29t16:04:48z', 'origin_country_code': 'fr', 'trim': 'feel pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, allennes-les-marais', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '6fabcad4-013c-5bce-b743-5986a5e651c3', 'current_year_diff': 4, 'age_in_months': 47, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 42000}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 47,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:04:48z',
     'fuel_type': 'petrol',
     'id': '6fabcad4-013c-5bce-b743-5986a5e651c3',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cc53284',
     'listing': 'auction',
     'location': 'fr, allennes-les-marais',
     'make': 'citroen',
     'make_model': 'citroen c3 aircross',
     'model': 'c3 aircross',
     'odometer': 42000,
     'odometer_in_km': 42000,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-02-28',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 aircross 1.2 puretech feel pack',
     'transmission': 'manual',
     'trim': 'feel pack',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:04:48Z',
 'fuel_type': 'petrol',
 'id': '6fabcad4-013c-5bce-b743-5986a5e651c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC53284',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 42000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Feel Pack',
 'transmission': 'manual',
 'trim': 'Feel Pack',
 'year': 2022}
2026-01-29 06:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CC53284%27 HTTP/1.1" 200 None
2026-01-29 06:16:36 [auto1.fr] INFO: Saving data for CC53284: {'auction_closing_time': 1769702688.0, 'created_time': 1769580176.615882, 'last_price_update_time': 1769667396.087705}
2026-01-29 06:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CC53284') HTTP/1.1" 204 0
2026-01-29 06:16:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NF05150> (referer: https://www.auto1.com/v1/car-details-view/NF05150/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:16:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:16:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51e46566-44cb-503e-9134-9acef08e8fac with identifier: NF05150
2026-01-29 06:16:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51e46566-44cb-503e-9134-9acef08e8fac with scrape type 2
2026-01-29 06:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51e46566-44cb-503e-9134-9acef08e8fac with scrape type 2
2026-01-29 06:16:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 51e46566-44cb-503e-9134-9acef08e8fac, identifier: NF05150
2026-01-29 06:16:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 51e46566-44cb-503e-9134-9acef08e8fac with identifier: NF05150
2026-01-29 06:16:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 51e46566-44cb-503e-9134-9acef08e8fac with identifier: NF05150
2026-01-29 06:16:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 51e46566-44cb-503e-9134-9acef08e8fac with identifier: NF05150 to the API
2026-01-29 06:16:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:16:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:16:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NF05150>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:30:54Z',
 'fuel_type': 'diesel',
 'id': '51e46566-44cb-503e-9134-9acef08e8fac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF05150',
 'listing': 'auction',
 'location': 'FR, MOUGINS',
 'make': 'BMW',
 'model': '3er',
 'odometer': 126777,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320d xDrive Luxury Line',
 'transmission': 'automatic',
 'trim': 'xDrive Luxury Line',
 'year': 2020}
2026-01-29 06:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NF05150%27 HTTP/1.1" 200 None
2026-01-29 06:16:38 [auto1.fr] INFO: Saving data for NF05150: {'auction_closing_time': 1769704254.0, 'created_time': 1768644240.906919, 'last_price_update_time': 1769667398.962433}
2026-01-29 06:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NF05150') HTTP/1.1" 204 0
2026-01-29 06:16:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CU15195/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:16:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:16:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FV70132> (referer: https://www.auto1.com/v1/car-details-view/FV70132/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:16:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:16:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3554a4c5-1f54-5e6d-a656-054c969a6246 with identifier: FV70132
2026-01-29 06:16:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3554a4c5-1f54-5e6d-a656-054c969a6246 with scrape type 2
2026-01-29 06:16:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3554a4c5-1f54-5e6d-a656-054c969a6246 with scrape type 2
2026-01-29 06:16:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3554a4c5-1f54-5e6d-a656-054c969a6246, identifier: FV70132
2026-01-29 06:16:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3554a4c5-1f54-5e6d-a656-054c969a6246 with identifier: FV70132
2026-01-29 06:16:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3554a4c5-1f54-5e6d-a656-054c969a6246 with identifier: FV70132
2026-01-29 06:16:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'manual', 'odometer': 171033, 'odometer_reading_unit': 'km', 'registration_date': '2018-10-17', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fv70132', 'expiration_date': '2026-01-29t16:52:03z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 106, 'id': '3554a4c5-1f54-5e6d-a656-054c969a6246', 'current_year_diff': 8, 'age_in_months': 87, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 171033}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 87,
     'auction_title': '',
     'c_o_2_emission_value': 106,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:52:03z',
     'fuel_type': 'petrol',
     'id': '3554a4c5-1f54-5e6d-a656-054c969a6246',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fv70132',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'citroen',
     'make_model': 'citroen c3 aircross',
     'model': 'c3 aircross',
     'odometer': 171033,
     'odometer_in_km': 171033,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-10-17',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 aircross 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2018}
2026-01-29 06:16:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 3554a4c5-1f54-5e6d-a656-054c969a6246 spider: auto1.fr
2026-01-29 06:16:45 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 3554a4c5-1f54-5e6d-a656-054c969a6246 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'manual', 'odometer': 171033, 'odometer_reading_unit': 'km', 'registration_date': '2018-10-17', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fv70132', 'expiration_date': '2026-01-29t16:52:03z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 106, 'id': '3554a4c5-1f54-5e6d-a656-054c969a6246', 'current_year_diff': 8, 'age_in_months': 87, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 171033}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 87,
     'auction_title': '',
     'c_o_2_emission_value': 106,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:52:03z',
     'fuel_type': 'petrol',
     'id': '3554a4c5-1f54-5e6d-a656-054c969a6246',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fv70132',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'citroen',
     'make_model': 'citroen c3 aircross',
     'model': 'c3 aircross',
     'odometer': 171033,
     'odometer_in_km': 171033,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-10-17',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 aircross 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:52:03Z',
 'fuel_type': 'petrol',
 'id': '3554a4c5-1f54-5e6d-a656-054c969a6246',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV70132',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 171033,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2018}
2026-01-29 06:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV70132%27 HTTP/1.1" 200 None
2026-01-29 06:16:45 [auto1.fr] INFO: Saving data for FV70132: {'auction_closing_time': 1769705523.0, 'created_time': 1769449472.464795, 'last_price_update_time': 1769667405.757079}
2026-01-29 06:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FV70132') HTTP/1.1" 204 0
2026-01-29 06:16:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZP54568> (referer: https://www.auto1.com/v1/car-details-view/ZP54568/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:16:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:16:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60d33eb8-98aa-5eee-9784-86e81b5bccb5 with identifier: ZP54568
2026-01-29 06:16:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60d33eb8-98aa-5eee-9784-86e81b5bccb5 with scrape type 2
2026-01-29 06:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60d33eb8-98aa-5eee-9784-86e81b5bccb5 with scrape type 2
2026-01-29 06:16:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 60d33eb8-98aa-5eee-9784-86e81b5bccb5, identifier: ZP54568
2026-01-29 06:16:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 60d33eb8-98aa-5eee-9784-86e81b5bccb5 with identifier: ZP54568
2026-01-29 06:16:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 60d33eb8-98aa-5eee-9784-86e81b5bccb5 with identifier: ZP54568
2026-01-29 06:16:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 60d33eb8-98aa-5eee-9784-86e81b5bccb5 with identifier: ZP54568 to the API
2026-01-29 06:16:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:16:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:16:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZP54568>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:59:03Z',
 'fuel_type': 'diesel',
 'id': '60d33eb8-98aa-5eee-9784-86e81b5bccb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP54568',
 'listing': 'auction',
 'location': 'FR, La Riche',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 108443,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Active Pack',
 'transmission': 'automatic',
 'trim': 'Active Pack',
 'year': 2022}
2026-01-29 06:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP54568%27 HTTP/1.1" 200 None
2026-01-29 06:16:47 [auto1.fr] INFO: Saving data for ZP54568: {'auction_closing_time': 1769705943.0, 'created_time': 1769533733.611449, 'last_price_update_time': 1769667407.358909}
2026-01-29 06:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZP54568') HTTP/1.1" 204 0
2026-01-29 06:16:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DC30957/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:16:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:17:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DX75820> (referer: https://www.auto1.com/v1/car-details-view/DX75820/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:17:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:17:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 069beb4d-189b-56db-b02a-ff71d41c0438 with identifier: DX75820
2026-01-29 06:17:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 069beb4d-189b-56db-b02a-ff71d41c0438 with scrape type 2
2026-01-29 06:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 069beb4d-189b-56db-b02a-ff71d41c0438 with scrape type 2
2026-01-29 06:17:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 069beb4d-189b-56db-b02a-ff71d41c0438, identifier: DX75820
2026-01-29 06:17:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 069beb4d-189b-56db-b02a-ff71d41c0438 with identifier: DX75820
2026-01-29 06:17:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 069beb4d-189b-56db-b02a-ff71d41c0438 with identifier: DX75820
2026-01-29 06:17:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'ranger' containing 'ranger'
2026-01-29 06:17:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 069beb4d-189b-56db-b02a-ff71d41c0438 spider: auto1.fr
2026-01-29 06:17:06 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 069beb4d-189b-56db-b02a-ff71d41c0438 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'ranger' containing 'ranger'
{'auction_title': '',
 'c_o_2_emission_value': 228,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '3.2L',
 'engine_horse_power': 200,
 'expiration_date': '2026-01-29T16:49:02Z',
 'fuel_type': 'diesel',
 'id': '069beb4d-189b-56db-b02a-ff71d41c0438',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX75820',
 'listing': 'auction',
 'location': 'FR, Villenoy',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 183563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-24',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Ford Ranger 3.2 TDCi Extrakabine Limited 4x4',
 'transmission': 'automatic',
 'trim': 'Extrakabine Limited 4x4',
 'year': 2017}
2026-01-29 06:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DX75820%27 HTTP/1.1" 200 None
2026-01-29 06:17:06 [auto1.fr] INFO: Saving data for DX75820: {'auction_closing_time': 1769705342.0, 'created_time': 1768809692.110689, 'last_price_update_time': 1769667426.566566}
2026-01-29 06:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DX75820') HTTP/1.1" 204 0
2026-01-29 06:17:11 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.886(s), this was the 1st time calling it.
2026-01-29 06:17:11 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.550426412063825 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:17:12 [scrapy.extensions.logstats] INFO: Crawled 1143 pages (at 15 pages/min), scraped 252 items (at 6 items/min)
2026-01-29 06:17:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:17:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WX54036> (referer: https://www.auto1.com/v1/car-details-view/WX54036/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:17:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:17:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5914240d-76e6-53ee-89af-5c614f3bd3bd with identifier: WX54036
2026-01-29 06:17:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5914240d-76e6-53ee-89af-5c614f3bd3bd with scrape type 2
2026-01-29 06:17:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5914240d-76e6-53ee-89af-5c614f3bd3bd with scrape type 2
2026-01-29 06:17:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5914240d-76e6-53ee-89af-5c614f3bd3bd, identifier: WX54036
2026-01-29 06:17:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5914240d-76e6-53ee-89af-5c614f3bd3bd with identifier: WX54036
2026-01-29 06:17:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5914240d-76e6-53ee-89af-5c614f3bd3bd with identifier: WX54036
2026-01-29 06:17:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo' containing 'kangoo'
2026-01-29 06:17:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 5914240d-76e6-53ee-89af-5c614f3bd3bd spider: auto1.fr
2026-01-29 06:17:18 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 5914240d-76e6-53ee-89af-5c614f3bd3bd due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo' containing 'kangoo'
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:04:54Z',
 'fuel_type': 'diesel',
 'id': '5914240d-76e6-53ee-89af-5c614f3bd3bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX54036',
 'listing': 'auction',
 'location': 'FR, Montivillier',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 121681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-26',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 BLUE dCi Express Grand Confort L1',
 'transmission': 'manual',
 'trim': 'Express Grand Confort L1',
 'year': 2021}
2026-01-29 06:17:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:17:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WX54036%27 HTTP/1.1" 200 None
2026-01-29 06:17:18 [auto1.fr] INFO: Saving data for WX54036: {'auction_closing_time': 1769702694.0, 'created_time': 1769533441.372815, 'last_price_update_time': 1769667438.741553}
2026-01-29 06:17:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:17:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WX54036') HTTP/1.1" 204 0
2026-01-29 06:17:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KN28885/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:17:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:17:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VF09133/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:17:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:17:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AH07009> (referer: https://www.auto1.com/v1/car-details-view/AH07009/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:17:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:17:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 484b7eab-3280-5484-b476-80b1d9bbad47 with identifier: AH07009
2026-01-29 06:17:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 484b7eab-3280-5484-b476-80b1d9bbad47 with scrape type 2
2026-01-29 06:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 484b7eab-3280-5484-b476-80b1d9bbad47 with scrape type 2
2026-01-29 06:17:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 484b7eab-3280-5484-b476-80b1d9bbad47, identifier: AH07009
2026-01-29 06:17:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 484b7eab-3280-5484-b476-80b1d9bbad47 with identifier: AH07009
2026-01-29 06:17:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 484b7eab-3280-5484-b476-80b1d9bbad47 with identifier: AH07009
2026-01-29 06:17:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 484b7eab-3280-5484-b476-80b1d9bbad47 with identifier: AH07009 to the API
2026-01-29 06:17:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:17:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:17:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AH07009>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:35:37Z',
 'fuel_type': 'hybrid',
 'id': '484b7eab-3280-5484-b476-80b1d9bbad47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH07009',
 'listing': 'auction',
 'location': 'FR, Ingrandes sur Vienne',
 'make': 'Toyota',
 'model': 'Yaris Cross',
 'odometer': 35344,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-08-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris Cross 1.5 Hybrid Design',
 'transmission': 'automatic',
 'trim': 'Design',
 'year': 2022}
2026-01-29 06:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AH07009%27 HTTP/1.1" 200 None
2026-01-29 06:17:27 [auto1.fr] INFO: Saving data for AH07009: {'auction_closing_time': 1769704537.0, 'created_time': 1767805730.357672, 'last_price_update_time': 1769667447.113317}
2026-01-29 06:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AH07009') HTTP/1.1" 204 0
2026-01-29 06:17:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DC25219/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:17:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:17:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WK73205/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:17:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:17:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WB13363/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:17:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:17:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CU15195> (referer: https://www.auto1.com/v1/car-details-view/CU15195/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:17:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:17:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2a6f098-2b14-5289-80ed-9e434f84f2b3 with identifier: CU15195
2026-01-29 06:17:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2a6f098-2b14-5289-80ed-9e434f84f2b3 with scrape type 2
2026-01-29 06:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2a6f098-2b14-5289-80ed-9e434f84f2b3 with scrape type 2
2026-01-29 06:17:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e2a6f098-2b14-5289-80ed-9e434f84f2b3, identifier: CU15195
2026-01-29 06:17:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e2a6f098-2b14-5289-80ed-9e434f84f2b3 with identifier: CU15195
2026-01-29 06:17:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e2a6f098-2b14-5289-80ed-9e434f84f2b3 with identifier: CU15195
2026-01-29 06:17:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech graphic', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 98508, 'odometer_reading_unit': 'km', 'registration_date': '2018-04-16', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cu15195', 'expiration_date': '2026-01-29t16:10:13z', 'origin_country_code': 'fr', 'trim': 'graphic', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, vénissieux', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': 'e2a6f098-2b14-5289-80ed-9e434f84f2b3', 'current_year_diff': 8, 'age_in_months': 93, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 98508}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 93,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:10:13z',
     'fuel_type': 'petrol',
     'id': 'e2a6f098-2b14-5289-80ed-9e434f84f2b3',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cu15195',
     'listing': 'auction',
     'location': 'fr, vénissieux',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 98508,
     'odometer_in_km': 98508,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-04-16',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech graphic',
     'transmission': 'manual',
     'trim': 'graphic',
     'year': 2018}
2026-01-29 06:17:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: e2a6f098-2b14-5289-80ed-9e434f84f2b3 spider: auto1.fr
2026-01-29 06:17:47 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: e2a6f098-2b14-5289-80ed-9e434f84f2b3 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech graphic', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 98508, 'odometer_reading_unit': 'km', 'registration_date': '2018-04-16', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cu15195', 'expiration_date': '2026-01-29t16:10:13z', 'origin_country_code': 'fr', 'trim': 'graphic', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, vénissieux', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': 'e2a6f098-2b14-5289-80ed-9e434f84f2b3', 'current_year_diff': 8, 'age_in_months': 93, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 98508}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 93,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:10:13z',
     'fuel_type': 'petrol',
     'id': 'e2a6f098-2b14-5289-80ed-9e434f84f2b3',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cu15195',
     'listing': 'auction',
     'location': 'fr, vénissieux',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 98508,
     'odometer_in_km': 98508,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-04-16',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech graphic',
     'transmission': 'manual',
     'trim': 'graphic',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:10:13Z',
 'fuel_type': 'petrol',
 'id': 'e2a6f098-2b14-5289-80ed-9e434f84f2b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU15195',
 'listing': 'auction',
 'location': 'FR, Vénissieux',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 98508,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Graphic',
 'transmission': 'manual',
 'trim': 'Graphic',
 'year': 2018}
2026-01-29 06:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CU15195%27 HTTP/1.1" 200 None
2026-01-29 06:17:47 [auto1.fr] INFO: Saving data for CU15195: {'auction_closing_time': 1769703013.0, 'created_time': 1769533836.396632, 'last_price_update_time': 1769667467.405769}
2026-01-29 06:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CU15195') HTTP/1.1" 204 0
2026-01-29 06:17:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WU79860/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:17:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:17:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DC30957> (referer: https://www.auto1.com/v1/car-details-view/DC30957/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:17:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:17:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e3fc2ef-d589-5e74-a294-93aa48a5624c with identifier: DC30957
2026-01-29 06:17:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e3fc2ef-d589-5e74-a294-93aa48a5624c with scrape type 2
2026-01-29 06:17:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e3fc2ef-d589-5e74-a294-93aa48a5624c with scrape type 2
2026-01-29 06:17:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0e3fc2ef-d589-5e74-a294-93aa48a5624c, identifier: DC30957
2026-01-29 06:17:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0e3fc2ef-d589-5e74-a294-93aa48a5624c with identifier: DC30957
2026-01-29 06:17:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0e3fc2ef-d589-5e74-a294-93aa48a5624c with identifier: DC30957
2026-01-29 06:17:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'violet', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'renault captur 1.2 tce initiale paris', 'price': 0, 'currency': 'eur', 'make': 'renault', 'model': 'captur', 'transmission': 'manual', 'odometer': 34067, 'odometer_reading_unit': 'km', 'registration_date': '2017-09-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dc30957', 'expiration_date': '2026-01-29t16:09:50z', 'origin_country_code': 'fr', 'trim': 'initiale paris', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 120, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, warluis', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 125, 'id': '0e3fc2ef-d589-5e74-a294-93aa48a5624c', 'current_year_diff': 9, 'age_in_months': 100, 'make_model': 'renault captur', 'sanitized_make': 'renault', 'odometer_in_km': 34067}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 100,
     'auction_title': '',
     'c_o_2_emission_value': 125,
     'category': None,
     'color': 'violet',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 120,
     'expiration_date': '2026-01-29t16:09:50z',
     'fuel_type': 'petrol',
     'id': '0e3fc2ef-d589-5e74-a294-93aa48a5624c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dc30957',
     'listing': 'auction',
     'location': 'fr, warluis',
     'make': 'renault',
     'make_model': 'renault captur',
     'model': 'captur',
     'odometer': 34067,
     'odometer_in_km': 34067,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-09-24',
     'sanitized_make': 'renault',
     'seats_number': 5,
     'seller_name': None,
     'title': 'renault captur 1.2 tce initiale paris',
     'transmission': 'manual',
     'trim': 'initiale paris',
     'year': 2017}
2026-01-29 06:17:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 0e3fc2ef-d589-5e74-a294-93aa48a5624c spider: auto1.fr
2026-01-29 06:17:48 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 0e3fc2ef-d589-5e74-a294-93aa48a5624c due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'violet', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'renault captur 1.2 tce initiale paris', 'price': 0, 'currency': 'eur', 'make': 'renault', 'model': 'captur', 'transmission': 'manual', 'odometer': 34067, 'odometer_reading_unit': 'km', 'registration_date': '2017-09-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dc30957', 'expiration_date': '2026-01-29t16:09:50z', 'origin_country_code': 'fr', 'trim': 'initiale paris', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 120, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, warluis', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 125, 'id': '0e3fc2ef-d589-5e74-a294-93aa48a5624c', 'current_year_diff': 9, 'age_in_months': 100, 'make_model': 'renault captur', 'sanitized_make': 'renault', 'odometer_in_km': 34067}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 100,
     'auction_title': '',
     'c_o_2_emission_value': 125,
     'category': None,
     'color': 'violet',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 120,
     'expiration_date': '2026-01-29t16:09:50z',
     'fuel_type': 'petrol',
     'id': '0e3fc2ef-d589-5e74-a294-93aa48a5624c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dc30957',
     'listing': 'auction',
     'location': 'fr, warluis',
     'make': 'renault',
     'make_model': 'renault captur',
     'model': 'captur',
     'odometer': 34067,
     'odometer_in_km': 34067,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-09-24',
     'sanitized_make': 'renault',
     'seats_number': 5,
     'seller_name': None,
     'title': 'renault captur 1.2 tce initiale paris',
     'transmission': 'manual',
     'trim': 'initiale paris',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:09:50Z',
 'fuel_type': 'petrol',
 'id': '0e3fc2ef-d589-5e74-a294-93aa48a5624c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC30957',
 'listing': 'auction',
 'location': 'FR, Warluis',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 34067,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.2 TCe Initiale Paris',
 'transmission': 'manual',
 'trim': 'Initiale Paris',
 'year': 2017}
2026-01-29 06:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DC30957%27 HTTP/1.1" 200 None
2026-01-29 06:17:48 [auto1.fr] INFO: Saving data for DC30957: {'auction_closing_time': 1769702990.0, 'created_time': 1769533626.439104, 'last_price_update_time': 1769667468.710192}
2026-01-29 06:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DC30957') HTTP/1.1" 204 0
2026-01-29 06:17:54 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.378(s), this was the 1st time calling it.
2026-01-29 06:17:54 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.611810125132434 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:17:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:18:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TA97799/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:18:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:18:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RT74055/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:18:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:18:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KN28885> (referer: https://www.auto1.com/v1/car-details-view/KN28885/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:18:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:18:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e91de8d-f61d-53f1-a558-699ddb627ef1 with identifier: KN28885
2026-01-29 06:18:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e91de8d-f61d-53f1-a558-699ddb627ef1 with scrape type 2
2026-01-29 06:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e91de8d-f61d-53f1-a558-699ddb627ef1 with scrape type 2
2026-01-29 06:18:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5e91de8d-f61d-53f1-a558-699ddb627ef1, identifier: KN28885
2026-01-29 06:18:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5e91de8d-f61d-53f1-a558-699ddb627ef1 with identifier: KN28885
2026-01-29 06:18:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5e91de8d-f61d-53f1-a558-699ddb627ef1 with identifier: KN28885
2026-01-29 06:18:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 150971 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150971
2026-01-29 06:18:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 5e91de8d-f61d-53f1-a558-699ddb627ef1 spider: auto1.fr
2026-01-29 06:18:07 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 5e91de8d-f61d-53f1-a558-699ddb627ef1 due to rule: high_mileage_for_country.json, error: 150971 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150971
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 230,
 'expiration_date': '2026-01-29T16:02:53Z',
 'fuel_type': 'hybrid',
 'id': '5e91de8d-f61d-53f1-a558-699ddb627ef1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN28885',
 'listing': 'auction',
 'location': 'FR, TARNOS',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 150971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Hybrid Creative 2WD',
 'transmission': 'automatic',
 'trim': 'Creative 2WD',
 'year': 2021}
2026-01-29 06:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KN28885%27 HTTP/1.1" 200 None
2026-01-29 06:18:07 [auto1.fr] INFO: Saving data for KN28885: {'auction_closing_time': 1769702573.0, 'created_time': 1769534112.013051, 'last_price_update_time': 1769667487.891781}
2026-01-29 06:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KN28885') HTTP/1.1" 204 0
2026-01-29 06:18:08 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.457(s), this was the 1st time calling it.
2026-01-29 06:18:08 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.844642745850612 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:18:12 [scrapy.extensions.logstats] INFO: Crawled 1156 pages (at 13 pages/min), scraped 253 items (at 1 items/min)
2026-01-29 06:18:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:18:16 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.251(s), this was the 1st time calling it.
2026-01-29 06:18:16 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.823490032979203 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:18:18 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.319(s), this was the 1st time calling it.
2026-01-29 06:18:18 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.835147001704544 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:18:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:18:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:18:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EC06252/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:18:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:18:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DC25219> (referer: https://www.auto1.com/v1/car-details-view/DC25219/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:18:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:18:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35713485-76ad-56b2-bc48-fa2834264344 with identifier: DC25219
2026-01-29 06:18:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35713485-76ad-56b2-bc48-fa2834264344 with scrape type 2
2026-01-29 06:18:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35713485-76ad-56b2-bc48-fa2834264344 with scrape type 2
2026-01-29 06:18:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 35713485-76ad-56b2-bc48-fa2834264344, identifier: DC25219
2026-01-29 06:18:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 35713485-76ad-56b2-bc48-fa2834264344 with identifier: DC25219
2026-01-29 06:18:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 35713485-76ad-56b2-bc48-fa2834264344 with identifier: DC25219
2026-01-29 06:18:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 35713485-76ad-56b2-bc48-fa2834264344 with identifier: DC25219 to the API
2026-01-29 06:18:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:18:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:18:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DC25219>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:58:02Z',
 'fuel_type': 'diesel',
 'id': '35713485-76ad-56b2-bc48-fa2834264344',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC25219',
 'listing': 'auction',
 'location': 'FR, Villenoy',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 109938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 CRDi Business 2WD',
 'transmission': 'automatic',
 'trim': 'Business 2WD',
 'year': 2019}
2026-01-29 06:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DC25219%27 HTTP/1.1" 200 None
2026-01-29 06:18:47 [auto1.fr] INFO: Saving data for DC25219: {'auction_closing_time': 1769705882.0, 'created_time': 1768890888.684565, 'last_price_update_time': 1769667527.420849}
2026-01-29 06:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DC25219') HTTP/1.1" 204 0
2026-01-29 06:18:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RP45777/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:18:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:18:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WB13363> (referer: https://www.auto1.com/v1/car-details-view/WB13363/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:18:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:18:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dba1d84e-cb97-5653-b212-e22c4b81ce7a with identifier: WB13363
2026-01-29 06:18:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dba1d84e-cb97-5653-b212-e22c4b81ce7a with scrape type 2
2026-01-29 06:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dba1d84e-cb97-5653-b212-e22c4b81ce7a with scrape type 2
2026-01-29 06:18:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: dba1d84e-cb97-5653-b212-e22c4b81ce7a, identifier: WB13363
2026-01-29 06:18:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dba1d84e-cb97-5653-b212-e22c4b81ce7a with identifier: WB13363
2026-01-29 06:18:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dba1d84e-cb97-5653-b212-e22c4b81ce7a with identifier: WB13363
2026-01-29 06:18:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: dba1d84e-cb97-5653-b212-e22c4b81ce7a with identifier: WB13363 to the API
2026-01-29 06:18:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:18:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:18:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WB13363>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:25:40Z',
 'fuel_type': 'petrol',
 'id': 'dba1d84e-cb97-5653-b212-e22c4b81ce7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB13363',
 'listing': 'auction',
 'location': 'FR, Ambarès-et-Lagrave',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 82443,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2019}
2026-01-29 06:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB13363%27 HTTP/1.1" 200 None
2026-01-29 06:18:49 [auto1.fr] INFO: Saving data for WB13363: {'auction_closing_time': 1769703940.0, 'created_time': 1769534154.242388, 'last_price_update_time': 1769667529.842877}
2026-01-29 06:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WB13363') HTTP/1.1" 204 0
2026-01-29 06:18:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WK73205> (referer: https://www.auto1.com/v1/car-details-view/WK73205/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:18:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:18:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9a9d03f-0f2d-587d-a2f5-c5530d9e4137 with identifier: WK73205
2026-01-29 06:18:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9a9d03f-0f2d-587d-a2f5-c5530d9e4137 with scrape type 2
2026-01-29 06:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9a9d03f-0f2d-587d-a2f5-c5530d9e4137 with scrape type 2
2026-01-29 06:18:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b9a9d03f-0f2d-587d-a2f5-c5530d9e4137, identifier: WK73205
2026-01-29 06:18:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b9a9d03f-0f2d-587d-a2f5-c5530d9e4137 with identifier: WK73205
2026-01-29 06:18:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b9a9d03f-0f2d-587d-a2f5-c5530d9e4137 with identifier: WK73205
2026-01-29 06:18:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b9a9d03f-0f2d-587d-a2f5-c5530d9e4137 with identifier: WK73205 to the API
2026-01-29 06:18:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:18:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:18:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WK73205>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:20:48Z',
 'fuel_type': 'hybrid',
 'id': 'b9a9d03f-0f2d-587d-a2f5-c5530d9e4137',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK73205',
 'listing': 'auction',
 'location': 'FR, Nanteuil-le-Haudouin',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 78290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.6 Hybrid E-Tech Zen',
 'transmission': 'automatic',
 'trim': 'Zen',
 'year': 2020}
2026-01-29 06:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WK73205%27 HTTP/1.1" 200 None
2026-01-29 06:18:50 [auto1.fr] INFO: Saving data for WK73205: {'auction_closing_time': 1769703648.0, 'created_time': 1769068835.709729, 'last_price_update_time': 1769667530.474907}
2026-01-29 06:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WK73205') HTTP/1.1" 204 0
2026-01-29 06:18:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WU79860> (referer: https://www.auto1.com/v1/car-details-view/WU79860/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:18:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:18:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13395a11-ccec-5342-8e12-be3b5b002697 with identifier: WU79860
2026-01-29 06:18:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13395a11-ccec-5342-8e12-be3b5b002697 with scrape type 2
2026-01-29 06:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13395a11-ccec-5342-8e12-be3b5b002697 with scrape type 2
2026-01-29 06:18:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 13395a11-ccec-5342-8e12-be3b5b002697, identifier: WU79860
2026-01-29 06:18:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 13395a11-ccec-5342-8e12-be3b5b002697 with identifier: WU79860
2026-01-29 06:18:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 13395a11-ccec-5342-8e12-be3b5b002697 with identifier: WU79860
2026-01-29 06:18:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 13395a11-ccec-5342-8e12-be3b5b002697 with identifier: WU79860 to the API
2026-01-29 06:18:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:18:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:18:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WU79860>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:08:26Z',
 'fuel_type': 'diesel',
 'id': '13395a11-ccec-5342-8e12-be3b5b002697',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU79860',
 'listing': 'auction',
 'location': 'FR, Le Boulou',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 96351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2017}
2026-01-29 06:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU79860%27 HTTP/1.1" 200 None
2026-01-29 06:18:52 [auto1.fr] INFO: Saving data for WU79860: {'auction_closing_time': 1769702906.0, 'created_time': 1768644242.635309, 'last_price_update_time': 1769667532.182835}
2026-01-29 06:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WU79860') HTTP/1.1" 204 0
2026-01-29 06:18:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NT37660/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:18:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TA97799> (referer: https://www.auto1.com/v1/car-details-view/TA97799/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JK43883/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4658f28d-6f88-55c1-ad93-695380e6afbc with identifier: TA97799
2026-01-29 06:19:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4658f28d-6f88-55c1-ad93-695380e6afbc with scrape type 2
2026-01-29 06:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4658f28d-6f88-55c1-ad93-695380e6afbc with scrape type 2
2026-01-29 06:19:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4658f28d-6f88-55c1-ad93-695380e6afbc, identifier: TA97799
2026-01-29 06:19:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4658f28d-6f88-55c1-ad93-695380e6afbc with identifier: TA97799
2026-01-29 06:19:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4658f28d-6f88-55c1-ad93-695380e6afbc with identifier: TA97799
2026-01-29 06:19:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4658f28d-6f88-55c1-ad93-695380e6afbc with identifier: TA97799 to the API
2026-01-29 06:19:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:19:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:19:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TA97799>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 69,
 'expiration_date': '2026-01-29T16:39:03Z',
 'fuel_type': 'electro',
 'id': '4658f28d-6f88-55c1-ad93-695380e6afbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA97799',
 'listing': 'auction',
 'location': 'FR, Nanteuil-le-Haudouin',
 'make': 'Renault',
 'model': 'Zoe',
 'odometer': 72639,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Zoe electric drive 51 kW Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2020}
2026-01-29 06:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA97799%27 HTTP/1.1" 200 None
2026-01-29 06:19:01 [auto1.fr] INFO: Saving data for TA97799: {'auction_closing_time': 1769704743.0, 'created_time': 1769580056.998276, 'last_price_update_time': 1769667541.555364}
2026-01-29 06:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TA97799') HTTP/1.1" 204 0
2026-01-29 06:19:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RT74055> (referer: https://www.auto1.com/v1/car-details-view/RT74055/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XS96199/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39bf43d4-8a91-552a-9edc-a9656f6795c9 with identifier: RT74055
2026-01-29 06:19:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39bf43d4-8a91-552a-9edc-a9656f6795c9 with scrape type 2
2026-01-29 06:19:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39bf43d4-8a91-552a-9edc-a9656f6795c9 with scrape type 2
2026-01-29 06:19:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 39bf43d4-8a91-552a-9edc-a9656f6795c9, identifier: RT74055
2026-01-29 06:19:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 39bf43d4-8a91-552a-9edc-a9656f6795c9 with identifier: RT74055
2026-01-29 06:19:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 39bf43d4-8a91-552a-9edc-a9656f6795c9 with identifier: RT74055
2026-01-29 06:19:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 39bf43d4-8a91-552a-9edc-a9656f6795c9 with identifier: RT74055 to the API
2026-01-29 06:19:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:19:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:19:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RT74055>
{'auction_title': '',
 'c_o_2_emission_value': 79,
 'category': 'Taxi',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 141,
 'expiration_date': '2026-01-29T16:48:49Z',
 'fuel_type': 'hybrid',
 'id': '39bf43d4-8a91-552a-9edc-a9656f6795c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT74055',
 'listing': 'auction',
 'location': 'Nice',
 'make': 'Kia',
 'model': 'Niro',
 'odometer': 146894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Niro 1.6 Hybrid Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2019}
2026-01-29 06:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RT74055%27 HTTP/1.1" 200 None
2026-01-29 06:19:03 [auto1.fr] INFO: Saving data for RT74055: {'auction_closing_time': 1769705329.0, 'created_time': 1769534307.734554, 'last_price_update_time': 1769667543.037816}
2026-01-29 06:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RT74055') HTTP/1.1" 204 0
2026-01-29 06:19:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BK54346/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WM08681/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EC06252> (referer: https://www.auto1.com/v1/car-details-view/EC06252/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc602485-3c88-5d53-af08-88f8bfb484e1 with identifier: EC06252
2026-01-29 06:19:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc602485-3c88-5d53-af08-88f8bfb484e1 with scrape type 2
2026-01-29 06:19:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc602485-3c88-5d53-af08-88f8bfb484e1 with scrape type 2
2026-01-29 06:19:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fc602485-3c88-5d53-af08-88f8bfb484e1, identifier: EC06252
2026-01-29 06:19:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fc602485-3c88-5d53-af08-88f8bfb484e1 with identifier: EC06252
2026-01-29 06:19:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fc602485-3c88-5d53-af08-88f8bfb484e1 with identifier: EC06252
2026-01-29 06:19:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fc602485-3c88-5d53-af08-88f8bfb484e1 with identifier: EC06252 to the API
2026-01-29 06:19:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:19:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:19:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EC06252>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:22:57Z',
 'fuel_type': 'diesel',
 'id': 'fc602485-3c88-5d53-af08-88f8bfb484e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC06252',
 'listing': 'auction',
 'location': 'FR, Ludres',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 51735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-08-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Peugeot 208 1.5 Blue-HDi Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2021}
2026-01-29 06:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EC06252%27 HTTP/1.1" 200 None
2026-01-29 06:19:04 [auto1.fr] INFO: Saving data for EC06252: {'auction_closing_time': 1769703777.0, 'created_time': 1769534376.717598, 'last_price_update_time': 1769667544.629716}
2026-01-29 06:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EC06252') HTTP/1.1" 204 0
2026-01-29 06:19:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RP45777> (referer: https://www.auto1.com/v1/car-details-view/RP45777/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YA72966/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd5a38db-e293-5791-8f7c-df528d8dce37 with identifier: RP45777
2026-01-29 06:19:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd5a38db-e293-5791-8f7c-df528d8dce37 with scrape type 2
2026-01-29 06:19:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd5a38db-e293-5791-8f7c-df528d8dce37 with scrape type 2
2026-01-29 06:19:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cd5a38db-e293-5791-8f7c-df528d8dce37, identifier: RP45777
2026-01-29 06:19:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cd5a38db-e293-5791-8f7c-df528d8dce37 with identifier: RP45777
2026-01-29 06:19:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cd5a38db-e293-5791-8f7c-df528d8dce37 with identifier: RP45777
2026-01-29 06:19:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cd5a38db-e293-5791-8f7c-df528d8dce37 with identifier: RP45777 to the API
2026-01-29 06:19:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:19:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:19:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RP45777>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:20:56Z',
 'fuel_type': 'petrol',
 'id': 'cd5a38db-e293-5791-8f7c-df528d8dce37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP45777',
 'listing': 'auction',
 'location': 'FR, Marly-la-ville',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 120239,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Carat',
 'transmission': 'manual',
 'trim': 'Carat',
 'year': 2018}
2026-01-29 06:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RP45777%27 HTTP/1.1" 200 None
2026-01-29 06:19:05 [auto1.fr] INFO: Saving data for RP45777: {'auction_closing_time': 1769703656.0, 'created_time': 1769449017.992027, 'last_price_update_time': 1769667545.146821}
2026-01-29 06:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RP45777') HTTP/1.1" 204 0
2026-01-29 06:19:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PF09129/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YY43314/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NT37660> (referer: https://www.auto1.com/v1/car-details-view/NT37660/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8eb0015a-3b4d-59e5-a294-5dd63da7f01e with identifier: NT37660
2026-01-29 06:19:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8eb0015a-3b4d-59e5-a294-5dd63da7f01e with scrape type 2
2026-01-29 06:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8eb0015a-3b4d-59e5-a294-5dd63da7f01e with scrape type 2
2026-01-29 06:19:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8eb0015a-3b4d-59e5-a294-5dd63da7f01e, identifier: NT37660
2026-01-29 06:19:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8eb0015a-3b4d-59e5-a294-5dd63da7f01e with identifier: NT37660
2026-01-29 06:19:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8eb0015a-3b4d-59e5-a294-5dd63da7f01e with identifier: NT37660
2026-01-29 06:19:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8eb0015a-3b4d-59e5-a294-5dd63da7f01e with identifier: NT37660 to the API
2026-01-29 06:19:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:19:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:19:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NT37660>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 241,
 'expiration_date': '2026-01-29T16:18:01Z',
 'fuel_type': 'hybrid',
 'id': '8eb0015a-3b4d-59e5-a294-5dd63da7f01e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT37660',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 74384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-08-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Compass 1.3 T4 4xe Plug-in Hybrid S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2023}
2026-01-29 06:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NT37660%27 HTTP/1.1" 200 None
2026-01-29 06:19:06 [auto1.fr] INFO: Saving data for NT37660: {'auction_closing_time': 1769703481.0, 'created_time': 1769534275.325965, 'last_price_update_time': 1769667546.588422}
2026-01-29 06:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NT37660') HTTP/1.1" 204 0
2026-01-29 06:19:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XL56912/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JK43883> (referer: https://www.auto1.com/v1/car-details-view/JK43883/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20f87f59-6b6f-5ee2-9324-0a68cbfb3da8 with identifier: JK43883
2026-01-29 06:19:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20f87f59-6b6f-5ee2-9324-0a68cbfb3da8 with scrape type 2
2026-01-29 06:19:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20f87f59-6b6f-5ee2-9324-0a68cbfb3da8 with scrape type 2
2026-01-29 06:19:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 20f87f59-6b6f-5ee2-9324-0a68cbfb3da8, identifier: JK43883
2026-01-29 06:19:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 20f87f59-6b6f-5ee2-9324-0a68cbfb3da8 with identifier: JK43883
2026-01-29 06:19:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 20f87f59-6b6f-5ee2-9324-0a68cbfb3da8 with identifier: JK43883
2026-01-29 06:19:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 20f87f59-6b6f-5ee2-9324-0a68cbfb3da8 with identifier: JK43883 to the API
2026-01-29 06:19:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:19:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:19:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JK43883>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:34:13Z',
 'fuel_type': 'petrol',
 'id': '20f87f59-6b6f-5ee2-9324-0a68cbfb3da8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK43883',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 23890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2020}
2026-01-29 06:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JK43883%27 HTTP/1.1" 200 None
2026-01-29 06:19:08 [auto1.fr] INFO: Saving data for JK43883: {'auction_closing_time': 1769704453.0, 'created_time': 1768842346.478041, 'last_price_update_time': 1769667548.049465}
2026-01-29 06:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JK43883') HTTP/1.1" 204 0
2026-01-29 06:19:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XS96199> (referer: https://www.auto1.com/v1/car-details-view/XS96199/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b684aa32-db7e-5949-a827-808bf596dc5a with identifier: XS96199
2026-01-29 06:19:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b684aa32-db7e-5949-a827-808bf596dc5a with scrape type 2
2026-01-29 06:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b684aa32-db7e-5949-a827-808bf596dc5a with scrape type 2
2026-01-29 06:19:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b684aa32-db7e-5949-a827-808bf596dc5a, identifier: XS96199
2026-01-29 06:19:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b684aa32-db7e-5949-a827-808bf596dc5a with identifier: XS96199
2026-01-29 06:19:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b684aa32-db7e-5949-a827-808bf596dc5a with identifier: XS96199
2026-01-29 06:19:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b684aa32-db7e-5949-a827-808bf596dc5a with identifier: XS96199 to the API
2026-01-29 06:19:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:19:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:19:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XS96199>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:39:26Z',
 'fuel_type': 'diesel',
 'id': 'b684aa32-db7e-5949-a827-808bf596dc5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS96199',
 'listing': 'auction',
 'location': 'FR, Ambérieu en Bugey',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 102584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2020}
2026-01-29 06:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XS96199%27 HTTP/1.1" 200 None
2026-01-29 06:19:08 [auto1.fr] INFO: Saving data for XS96199: {'auction_closing_time': 1769704766.0, 'created_time': 1769533482.357821, 'last_price_update_time': 1769667548.838679}
2026-01-29 06:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XS96199') HTTP/1.1" 204 0
2026-01-29 06:19:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:10 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:19:10 [auto1.fr] INFO: Found listing with ID: DU05349
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DU05349%27 HTTP/1.1" 200 None
2026-01-29 06:19:10 [auto1.fr] INFO: Scrape type for DU05349: 0
2026-01-29 06:19:10 [auto1.fr] INFO: Found listing with ID: XC21641
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XC21641%27 HTTP/1.1" 200 None
2026-01-29 06:19:10 [auto1.fr] INFO: Scrape type for XC21641: 2
2026-01-29 06:19:10 [auto1.fr] INFO: Found listing with ID: WJ44785
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WJ44785%27 HTTP/1.1" 200 None
2026-01-29 06:19:10 [auto1.fr] INFO: Scrape type for WJ44785: 2
2026-01-29 06:19:10 [auto1.fr] INFO: Found listing with ID: SS66407
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SS66407%27 HTTP/1.1" 200 None
2026-01-29 06:19:10 [auto1.fr] INFO: Scrape type for SS66407: 0
2026-01-29 06:19:10 [auto1.fr] INFO: Found listing with ID: BT27170
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BT27170%27 HTTP/1.1" 200 None
2026-01-29 06:19:10 [auto1.fr] INFO: Scrape type for BT27170: 2
2026-01-29 06:19:10 [auto1.fr] INFO: Found listing with ID: AH80283
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AH80283%27 HTTP/1.1" 200 None
2026-01-29 06:19:10 [auto1.fr] INFO: Scrape type for AH80283: 2
2026-01-29 06:19:10 [auto1.fr] INFO: Found listing with ID: VR06438
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VR06438%27 HTTP/1.1" 200 None
2026-01-29 06:19:10 [auto1.fr] INFO: Scrape type for VR06438: 2
2026-01-29 06:19:10 [auto1.fr] INFO: Found listing with ID: RP06562
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RP06562%27 HTTP/1.1" 200 None
2026-01-29 06:19:10 [auto1.fr] INFO: Scrape type for RP06562: 0
2026-01-29 06:19:10 [auto1.fr] INFO: Found listing with ID: CV64232
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CV64232%27 HTTP/1.1" 200 None
2026-01-29 06:19:10 [auto1.fr] INFO: Scrape type for CV64232: 0
2026-01-29 06:19:10 [auto1.fr] INFO: Found listing with ID: VT88860
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VT88860%27 HTTP/1.1" 200 None
2026-01-29 06:19:10 [auto1.fr] INFO: Scrape type for VT88860: 0
2026-01-29 06:19:10 [auto1.fr] INFO: Found listing with ID: CK92925
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CK92925%27 HTTP/1.1" 200 None
2026-01-29 06:19:10 [auto1.fr] INFO: Scrape type for CK92925: 0
2026-01-29 06:19:10 [auto1.fr] INFO: Found listing with ID: NE95513
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NE95513%27 HTTP/1.1" 200 None
2026-01-29 06:19:10 [auto1.fr] INFO: Scrape type for NE95513: 0
2026-01-29 06:19:10 [auto1.fr] INFO: Found listing with ID: TD35011
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TD35011%27 HTTP/1.1" 200 None
2026-01-29 06:19:10 [auto1.fr] INFO: Scrape type for TD35011: 2
2026-01-29 06:19:10 [auto1.fr] INFO: Found listing with ID: AA38230
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AA38230%27 HTTP/1.1" 200 None
2026-01-29 06:19:10 [auto1.fr] INFO: Scrape type for AA38230: 2
2026-01-29 06:19:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VF09133> (referer: https://www.auto1.com/v1/car-details-view/VF09133/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:10 [auto1.fr] INFO: Found listing with ID: YS02747
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS02747%27 HTTP/1.1" 200 None
2026-01-29 06:19:10 [auto1.fr] INFO: Scrape type for YS02747: 2
2026-01-29 06:19:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:10 [auto1.fr] INFO: Found listing with ID: KR36076
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KR36076%27 HTTP/1.1" 200 None
2026-01-29 06:19:10 [auto1.fr] INFO: Scrape type for KR36076: 2
2026-01-29 06:19:10 [auto1.fr] INFO: Found listing with ID: HA06579
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HA06579%27 HTTP/1.1" 200 None
2026-01-29 06:19:10 [auto1.fr] INFO: Scrape type for HA06579: 0
2026-01-29 06:19:10 [auto1.fr] INFO: Found listing with ID: YV88570
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YV88570%27 HTTP/1.1" 200 None
2026-01-29 06:19:10 [auto1.fr] INFO: Scrape type for YV88570: 2
2026-01-29 06:19:10 [auto1.fr] INFO: Found listing with ID: BA87650
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BA87650%27 HTTP/1.1" 200 None
2026-01-29 06:19:10 [auto1.fr] INFO: Scrape type for BA87650: 0
2026-01-29 06:19:10 [auto1.fr] INFO: Found listing with ID: TC04302
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TC04302%27 HTTP/1.1" 200 None
2026-01-29 06:19:10 [auto1.fr] INFO: Scrape type for TC04302: 2
2026-01-29 06:19:10 [auto1.fr] INFO: Found listing with ID: DV57349
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DV57349%27 HTTP/1.1" 200 None
2026-01-29 06:19:10 [auto1.fr] INFO: Scrape type for DV57349: 2
2026-01-29 06:19:10 [auto1.fr] INFO: Found listing with ID: ND73172
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ND73172%27 HTTP/1.1" 200 None
2026-01-29 06:19:10 [auto1.fr] INFO: Scrape type for ND73172: 0
2026-01-29 06:19:10 [auto1.fr] INFO: Found listing with ID: ZP30272
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP30272%27 HTTP/1.1" 200 None
2026-01-29 06:19:10 [auto1.fr] INFO: Scrape type for ZP30272: 2
2026-01-29 06:19:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a34d8183-7a00-52f8-960e-bc88a37f7f2f with identifier: VF09133
2026-01-29 06:19:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a34d8183-7a00-52f8-960e-bc88a37f7f2f with scrape type 2
2026-01-29 06:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a34d8183-7a00-52f8-960e-bc88a37f7f2f with scrape type 2
2026-01-29 06:19:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a34d8183-7a00-52f8-960e-bc88a37f7f2f, identifier: VF09133
2026-01-29 06:19:10 [auto1.fr] INFO: Found listing with ID: RG56256
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG56256%27 HTTP/1.1" 200 None
2026-01-29 06:19:10 [auto1.fr] INFO: Scrape type for RG56256: 2
2026-01-29 06:19:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a34d8183-7a00-52f8-960e-bc88a37f7f2f with identifier: VF09133
2026-01-29 06:19:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a34d8183-7a00-52f8-960e-bc88a37f7f2f with identifier: VF09133
2026-01-29 06:19:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 177203 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    177203
2026-01-29 06:19:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: a34d8183-7a00-52f8-960e-bc88a37f7f2f spider: auto1.fr
2026-01-29 06:19:11 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: a34d8183-7a00-52f8-960e-bc88a37f7f2f due to rule: high_mileage_for_country.json, error: 177203 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    177203
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:13:23Z',
 'fuel_type': 'diesel',
 'id': 'a34d8183-7a00-52f8-960e-bc88a37f7f2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF09133',
 'listing': 'auction',
 'location': 'FR, \u200bCHEVIGNY-SAINT-SAUVEUR',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 177203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Active Business',
 'transmission': 'manual',
 'trim': 'Active Business',
 'year': 2019}
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VF09133%27 HTTP/1.1" 200 None
2026-01-29 06:19:11 [auto1.fr] INFO: Saving data for VF09133: {'auction_closing_time': 1769703203.0, 'created_time': 1768928533.933727, 'last_price_update_time': 1769667551.043866}
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VF09133') HTTP/1.1" 204 0
2026-01-29 06:19:11 [auto1.fr] INFO: Found listing with ID: CX31954
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CX31954%27 HTTP/1.1" 200 None
2026-01-29 06:19:11 [auto1.fr] INFO: Scrape type for CX31954: 0
2026-01-29 06:19:11 [auto1.fr] INFO: Found listing with ID: NL39371
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NL39371%27 HTTP/1.1" 200 None
2026-01-29 06:19:11 [auto1.fr] INFO: Scrape type for NL39371: 2
2026-01-29 06:19:11 [auto1.fr] INFO: Found listing with ID: AN18055
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AN18055%27 HTTP/1.1" 200 None
2026-01-29 06:19:11 [auto1.fr] INFO: Scrape type for AN18055: 0
2026-01-29 06:19:11 [auto1.fr] INFO: Found listing with ID: LA76309
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LA76309%27 HTTP/1.1" 200 None
2026-01-29 06:19:11 [auto1.fr] INFO: Scrape type for LA76309: 2
2026-01-29 06:19:11 [auto1.fr] INFO: Found listing with ID: YW43536
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YW43536%27 HTTP/1.1" 200 None
2026-01-29 06:19:11 [auto1.fr] INFO: Scrape type for YW43536: 0
2026-01-29 06:19:11 [auto1.fr] INFO: Found listing with ID: ZJ84017
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZJ84017%27 HTTP/1.1" 200 None
2026-01-29 06:19:11 [auto1.fr] INFO: Scrape type for ZJ84017: 0
2026-01-29 06:19:11 [auto1.fr] INFO: Found listing with ID: UK93702
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UK93702%27 HTTP/1.1" 200 None
2026-01-29 06:19:11 [auto1.fr] INFO: Scrape type for UK93702: 2
2026-01-29 06:19:11 [auto1.fr] INFO: Found listing with ID: PH82364
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH82364%27 HTTP/1.1" 200 None
2026-01-29 06:19:11 [auto1.fr] INFO: Scrape type for PH82364: 0
2026-01-29 06:19:11 [auto1.fr] INFO: Found listing with ID: SJ70870
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SJ70870%27 HTTP/1.1" 200 None
2026-01-29 06:19:11 [auto1.fr] INFO: Scrape type for SJ70870: 0
2026-01-29 06:19:11 [auto1.fr] INFO: Found listing with ID: ED70326
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ED70326%27 HTTP/1.1" 200 None
2026-01-29 06:19:11 [auto1.fr] INFO: Scrape type for ED70326: 2
2026-01-29 06:19:11 [auto1.fr] INFO: Found listing with ID: FL47275
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FL47275%27 HTTP/1.1" 200 None
2026-01-29 06:19:11 [auto1.fr] INFO: Scrape type for FL47275: 0
2026-01-29 06:19:11 [auto1.fr] INFO: Found listing with ID: FP08043
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP08043%27 HTTP/1.1" 200 None
2026-01-29 06:19:11 [auto1.fr] INFO: Scrape type for FP08043: 2
2026-01-29 06:19:11 [auto1.fr] INFO: Found listing with ID: TB83051
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TB83051%27 HTTP/1.1" 200 None
2026-01-29 06:19:11 [auto1.fr] INFO: Scrape type for TB83051: 0
2026-01-29 06:19:11 [auto1.fr] INFO: Found listing with ID: BU69247
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BU69247%27 HTTP/1.1" 200 None
2026-01-29 06:19:11 [auto1.fr] INFO: Scrape type for BU69247: 2
2026-01-29 06:19:11 [auto1.fr] INFO: Found listing with ID: NZ32657
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NZ32657%27 HTTP/1.1" 200 None
2026-01-29 06:19:11 [auto1.fr] INFO: Scrape type for NZ32657: 2
2026-01-29 06:19:11 [auto1.fr] INFO: Found listing with ID: TH80258
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TH80258%27 HTTP/1.1" 200 None
2026-01-29 06:19:11 [auto1.fr] INFO: Scrape type for TH80258: 2
2026-01-29 06:19:12 [scrapy.extensions.logstats] INFO: Crawled 1180 pages (at 24 pages/min), scraped 264 items (at 11 items/min)
2026-01-29 06:19:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BK54346> (referer: https://www.auto1.com/v1/car-details-view/BK54346/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 788d2e7e-cc87-5395-8193-d23fb9810f88 with identifier: BK54346
2026-01-29 06:19:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 788d2e7e-cc87-5395-8193-d23fb9810f88 with scrape type 2
2026-01-29 06:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 788d2e7e-cc87-5395-8193-d23fb9810f88 with scrape type 2
2026-01-29 06:19:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 788d2e7e-cc87-5395-8193-d23fb9810f88, identifier: BK54346
2026-01-29 06:19:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 788d2e7e-cc87-5395-8193-d23fb9810f88 with identifier: BK54346
2026-01-29 06:19:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 788d2e7e-cc87-5395-8193-d23fb9810f88 with identifier: BK54346
2026-01-29 06:19:15 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo' containing 'kangoo'
2026-01-29 06:19:15 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 788d2e7e-cc87-5395-8193-d23fb9810f88 spider: auto1.fr
2026-01-29 06:19:15 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 788d2e7e-cc87-5395-8193-d23fb9810f88 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo' containing 'kangoo'
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:26:54Z',
 'fuel_type': 'diesel',
 'id': '788d2e7e-cc87-5395-8193-d23fb9810f88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK54346',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 128335,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 BLUE dCi Express Extra Série Spéciale',
 'transmission': 'manual',
 'trim': 'Express Extra Série Spéciale',
 'year': 2020}
2026-01-29 06:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BK54346%27 HTTP/1.1" 200 None
2026-01-29 06:19:15 [auto1.fr] INFO: Saving data for BK54346: {'auction_closing_time': 1769704014.0, 'created_time': 1767027896.442916, 'last_price_update_time': 1769667555.832533}
2026-01-29 06:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BK54346') HTTP/1.1" 204 0
2026-01-29 06:19:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WM08681> (referer: https://www.auto1.com/v1/car-details-view/WM08681/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 939b8027-d26c-5ac5-b8bc-ffea407d831a with identifier: WM08681
2026-01-29 06:19:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 939b8027-d26c-5ac5-b8bc-ffea407d831a with scrape type 2
2026-01-29 06:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 939b8027-d26c-5ac5-b8bc-ffea407d831a with scrape type 2
2026-01-29 06:19:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 939b8027-d26c-5ac5-b8bc-ffea407d831a, identifier: WM08681
2026-01-29 06:19:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 939b8027-d26c-5ac5-b8bc-ffea407d831a with identifier: WM08681
2026-01-29 06:19:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 939b8027-d26c-5ac5-b8bc-ffea407d831a with identifier: WM08681
2026-01-29 06:19:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 939b8027-d26c-5ac5-b8bc-ffea407d831a with identifier: WM08681 to the API
2026-01-29 06:19:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:19:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:19:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WM08681>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 184,
 'expiration_date': '2026-01-29T16:22:32Z',
 'fuel_type': 'hybrid',
 'id': '939b8027-d26c-5ac5-b8bc-ffea407d831a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM08681',
 'listing': 'auction',
 'location': 'FR, WALON LE MEUX',
 'make': 'BMW',
 'model': '3er',
 'odometer': 59480,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 330e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2023}
2026-01-29 06:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM08681%27 HTTP/1.1" 200 None
2026-01-29 06:19:17 [auto1.fr] INFO: Saving data for WM08681: {'auction_closing_time': 1769703752.0, 'created_time': 1769447374.131071, 'last_price_update_time': 1769667557.249845}
2026-01-29 06:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WM08681') HTTP/1.1" 204 0
2026-01-29 06:19:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YA72966> (referer: https://www.auto1.com/v1/car-details-view/YA72966/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 570e5eb5-de99-52bf-a3c5-27224e50bdd8 with identifier: YA72966
2026-01-29 06:19:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 570e5eb5-de99-52bf-a3c5-27224e50bdd8 with scrape type 2
2026-01-29 06:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 570e5eb5-de99-52bf-a3c5-27224e50bdd8 with scrape type 2
2026-01-29 06:19:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 570e5eb5-de99-52bf-a3c5-27224e50bdd8, identifier: YA72966
2026-01-29 06:19:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 570e5eb5-de99-52bf-a3c5-27224e50bdd8 with identifier: YA72966
2026-01-29 06:19:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 570e5eb5-de99-52bf-a3c5-27224e50bdd8 with identifier: YA72966
2026-01-29 06:19:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 141085 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    141085
2026-01-29 06:19:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 570e5eb5-de99-52bf-a3c5-27224e50bdd8 spider: auto1.fr
2026-01-29 06:19:17 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 570e5eb5-de99-52bf-a3c5-27224e50bdd8 due to rule: high_mileage_for_make.json, error: 141085 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    141085
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-01-29T16:26:57Z',
 'fuel_type': 'diesel',
 'id': '570e5eb5-de99-52bf-a3c5-27224e50bdd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA72966',
 'listing': 'auction',
 'location': 'Castelnau le Lez',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 141085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-16',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 2.0 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2019}
2026-01-29 06:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YA72966%27 HTTP/1.1" 200 None
2026-01-29 06:19:17 [auto1.fr] INFO: Saving data for YA72966: {'auction_closing_time': 1769704017.0, 'created_time': 1769450225.464196, 'last_price_update_time': 1769667557.657937}
2026-01-29 06:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YA72966') HTTP/1.1" 204 0
2026-01-29 06:19:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PF09129> (referer: https://www.auto1.com/v1/car-details-view/PF09129/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 275660bb-e751-5949-b1f0-77bbdef60ffe with identifier: PF09129
2026-01-29 06:19:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 275660bb-e751-5949-b1f0-77bbdef60ffe with scrape type 2
2026-01-29 06:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 275660bb-e751-5949-b1f0-77bbdef60ffe with scrape type 2
2026-01-29 06:19:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 275660bb-e751-5949-b1f0-77bbdef60ffe, identifier: PF09129
2026-01-29 06:19:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 275660bb-e751-5949-b1f0-77bbdef60ffe with identifier: PF09129
2026-01-29 06:19:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 275660bb-e751-5949-b1f0-77bbdef60ffe with identifier: PF09129
2026-01-29 06:19:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 194187 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    194187
2026-01-29 06:19:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 275660bb-e751-5949-b1f0-77bbdef60ffe spider: auto1.fr
2026-01-29 06:19:18 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 275660bb-e751-5949-b1f0-77bbdef60ffe due to rule: high_mileage_for_country.json, error: 194187 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    194187
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 258,
 'expiration_date': '2026-01-29T16:38:21Z',
 'fuel_type': 'diesel',
 'id': '275660bb-e751-5949-b1f0-77bbdef60ffe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF09129',
 'listing': 'auction',
 'location': 'FR, TARNOS',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 194187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X4 xDrive 30d Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2018}
2026-01-29 06:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF09129%27 HTTP/1.1" 200 None
2026-01-29 06:19:19 [auto1.fr] INFO: Saving data for PF09129: {'auction_closing_time': 1769704701.0, 'created_time': 1769534106.393847, 'last_price_update_time': 1769667559.015198}
2026-01-29 06:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PF09129') HTTP/1.1" 204 0
2026-01-29 06:19:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VA07916/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FM22383/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GE50772/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UT37872/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MC08975/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YY43314> (referer: https://www.auto1.com/v1/car-details-view/YY43314/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0808c070-debf-5349-abae-e19aeaca91d0 with identifier: YY43314
2026-01-29 06:19:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0808c070-debf-5349-abae-e19aeaca91d0 with scrape type 2
2026-01-29 06:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0808c070-debf-5349-abae-e19aeaca91d0 with scrape type 2
2026-01-29 06:19:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0808c070-debf-5349-abae-e19aeaca91d0, identifier: YY43314
2026-01-29 06:19:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0808c070-debf-5349-abae-e19aeaca91d0 with identifier: YY43314
2026-01-29 06:19:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0808c070-debf-5349-abae-e19aeaca91d0 with identifier: YY43314
2026-01-29 06:19:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 vti style', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 93509, 'odometer_reading_unit': 'km', 'registration_date': '2017-11-12', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yy43314', 'expiration_date': '2026-01-29t16:33:28z', 'origin_country_code': 'fr', 'trim': 'style', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'biarritz', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 114, 'id': '0808c070-debf-5349-abae-e19aeaca91d0', 'current_year_diff': 9, 'age_in_months': 98, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 93509}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 98,
     'auction_title': '',
     'c_o_2_emission_value': 114,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:33:28z',
     'fuel_type': 'petrol',
     'id': '0808c070-debf-5349-abae-e19aeaca91d0',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yy43314',
     'listing': 'auction',
     'location': 'biarritz',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 93509,
     'odometer_in_km': 93509,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-11-12',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 vti style',
     'transmission': 'manual',
     'trim': 'style',
     'year': 2017}
2026-01-29 06:19:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 0808c070-debf-5349-abae-e19aeaca91d0 spider: auto1.fr
2026-01-29 06:19:26 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 0808c070-debf-5349-abae-e19aeaca91d0 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 vti style', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 93509, 'odometer_reading_unit': 'km', 'registration_date': '2017-11-12', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yy43314', 'expiration_date': '2026-01-29t16:33:28z', 'origin_country_code': 'fr', 'trim': 'style', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'biarritz', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 114, 'id': '0808c070-debf-5349-abae-e19aeaca91d0', 'current_year_diff': 9, 'age_in_months': 98, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 93509}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 98,
     'auction_title': '',
     'c_o_2_emission_value': 114,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:33:28z',
     'fuel_type': 'petrol',
     'id': '0808c070-debf-5349-abae-e19aeaca91d0',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yy43314',
     'listing': 'auction',
     'location': 'biarritz',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 93509,
     'odometer_in_km': 93509,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-11-12',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 vti style',
     'transmission': 'manual',
     'trim': 'style',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:33:28Z',
 'fuel_type': 'petrol',
 'id': '0808c070-debf-5349-abae-e19aeaca91d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY43314',
 'listing': 'auction',
 'location': 'Biarritz',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 93509,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 VTi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2017}
2026-01-29 06:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YY43314%27 HTTP/1.1" 200 None
2026-01-29 06:19:26 [auto1.fr] INFO: Saving data for YY43314: {'auction_closing_time': 1769704408.0, 'created_time': 1768928680.4486, 'last_price_update_time': 1769667566.215504}
2026-01-29 06:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YY43314') HTTP/1.1" 204 0
2026-01-29 06:19:26 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 265.054(s), this was the 2nd time calling it.
2026-01-29 06:19:26 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.9096139686084683 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:19:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HC30752> (referer: https://www.auto1.com/v1/car-details-view/HC30752/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71303a27-935c-5ed0-8ca9-60bc31ed025b with identifier: HC30752
2026-01-29 06:19:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71303a27-935c-5ed0-8ca9-60bc31ed025b with scrape type 2
2026-01-29 06:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71303a27-935c-5ed0-8ca9-60bc31ed025b with scrape type 2
2026-01-29 06:19:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 71303a27-935c-5ed0-8ca9-60bc31ed025b, identifier: HC30752
2026-01-29 06:19:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 71303a27-935c-5ed0-8ca9-60bc31ed025b with identifier: HC30752
2026-01-29 06:19:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 71303a27-935c-5ed0-8ca9-60bc31ed025b with identifier: HC30752
2026-01-29 06:19:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 71303a27-935c-5ed0-8ca9-60bc31ed025b with identifier: HC30752 to the API
2026-01-29 06:19:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:19:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:19:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HC30752>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-01-29T16:52:47Z',
 'fuel_type': 'petrol',
 'id': '71303a27-935c-5ed0-8ca9-60bc31ed025b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC30752',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 93361,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-07',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 X-Cite',
 'transmission': 'manual',
 'trim': 'X-Cite',
 'year': 2018}
2026-01-29 06:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC30752%27 HTTP/1.1" 200 None
2026-01-29 06:19:30 [auto1.fr] INFO: Saving data for HC30752: {'auction_closing_time': 1769705567.0, 'created_time': 1769534119.068046, 'last_price_update_time': 1769667570.152832}
2026-01-29 06:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HC30752') HTTP/1.1" 204 0
2026-01-29 06:19:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-01-29 06:19:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BU69247/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NZ32657/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AA38230/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FP08043/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GA26468/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UK93702/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VA07916> (referer: https://www.auto1.com/v1/car-details-view/VA07916/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a3f9ad9-adb1-5054-9810-ed26cca5cca0 with identifier: VA07916
2026-01-29 06:19:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a3f9ad9-adb1-5054-9810-ed26cca5cca0 with scrape type 2
2026-01-29 06:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a3f9ad9-adb1-5054-9810-ed26cca5cca0 with scrape type 2
2026-01-29 06:19:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7a3f9ad9-adb1-5054-9810-ed26cca5cca0, identifier: VA07916
2026-01-29 06:19:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7a3f9ad9-adb1-5054-9810-ed26cca5cca0 with identifier: VA07916
2026-01-29 06:19:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7a3f9ad9-adb1-5054-9810-ed26cca5cca0 with identifier: VA07916
2026-01-29 06:19:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7a3f9ad9-adb1-5054-9810-ed26cca5cca0 with identifier: VA07916 to the API
2026-01-29 06:19:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:19:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:19:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VA07916>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:14:49Z',
 'fuel_type': 'diesel',
 'id': '7a3f9ad9-adb1-5054-9810-ed26cca5cca0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA07916',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 98234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.5 Blue-HDi Feel Business',
 'transmission': 'automatic',
 'trim': 'Feel Business',
 'year': 2019}
2026-01-29 06:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VA07916%27 HTTP/1.1" 200 None
2026-01-29 06:19:39 [auto1.fr] INFO: Saving data for VA07916: {'auction_closing_time': 1769703289.0, 'created_time': 1767869051.868702, 'last_price_update_time': 1769667579.452064}
2026-01-29 06:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VA07916') HTTP/1.1" 204 0
2026-01-29 06:19:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MC08975> (referer: https://www.auto1.com/v1/car-details-view/MC08975/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b53bfdf-60b4-5561-927d-fad3e3590a28 with identifier: MC08975
2026-01-29 06:19:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b53bfdf-60b4-5561-927d-fad3e3590a28 with scrape type 2
2026-01-29 06:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b53bfdf-60b4-5561-927d-fad3e3590a28 with scrape type 2
2026-01-29 06:19:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4b53bfdf-60b4-5561-927d-fad3e3590a28, identifier: MC08975
2026-01-29 06:19:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4b53bfdf-60b4-5561-927d-fad3e3590a28 with identifier: MC08975
2026-01-29 06:19:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4b53bfdf-60b4-5561-927d-fad3e3590a28 with identifier: MC08975
2026-01-29 06:19:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4b53bfdf-60b4-5561-927d-fad3e3590a28 with identifier: MC08975 to the API
2026-01-29 06:19:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:19:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:19:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MC08975>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 204,
 'expiration_date': '2026-01-29T16:08:53Z',
 'fuel_type': 'electro',
 'id': '4b53bfdf-60b4-5561-927d-fad3e3590a28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC08975',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Kia',
 'model': 'Niro',
 'odometer': 104516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Niro electric drive 150 kW Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2021}
2026-01-29 06:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC08975%27 HTTP/1.1" 200 None
2026-01-29 06:19:44 [auto1.fr] INFO: Saving data for MC08975: {'auction_closing_time': 1769702933.0, 'created_time': 1769533617.321408, 'last_price_update_time': 1769667584.906602}
2026-01-29 06:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MC08975') HTTP/1.1" 204 0
2026-01-29 06:19:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GE50772> (referer: https://www.auto1.com/v1/car-details-view/GE50772/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:19:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:19:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43493716-dbb6-5e50-a3d0-72a832c3f085 with identifier: GE50772
2026-01-29 06:19:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43493716-dbb6-5e50-a3d0-72a832c3f085 with scrape type 2
2026-01-29 06:19:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43493716-dbb6-5e50-a3d0-72a832c3f085 with scrape type 2
2026-01-29 06:19:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 43493716-dbb6-5e50-a3d0-72a832c3f085, identifier: GE50772
2026-01-29 06:19:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 43493716-dbb6-5e50-a3d0-72a832c3f085 with identifier: GE50772
2026-01-29 06:19:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 43493716-dbb6-5e50-a3d0-72a832c3f085 with identifier: GE50772
2026-01-29 06:19:49 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 137197 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    137197
2026-01-29 06:19:49 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 43493716-dbb6-5e50-a3d0-72a832c3f085 spider: auto1.fr
2026-01-29 06:19:49 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 43493716-dbb6-5e50-a3d0-72a832c3f085 due to rule: high_mileage_for_make.json, error: 137197 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    137197
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:07:19Z',
 'fuel_type': 'diesel',
 'id': '43493716-dbb6-5e50-a3d0-72a832c3f085',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE50772',
 'listing': 'auction',
 'location': 'FR, Boulogne-Billancourt',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 137197,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2020}
2026-01-29 06:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GE50772%27 HTTP/1.1" 200 None
2026-01-29 06:19:49 [auto1.fr] INFO: Saving data for GE50772: {'auction_closing_time': 1769702839.0, 'created_time': 1769534455.151026, 'last_price_update_time': 1769667589.774785}
2026-01-29 06:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GE50772') HTTP/1.1" 204 0
2026-01-29 06:19:59 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.015(s), this was the 1st time calling it.
2026-01-29 06:19:59 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.405846000923956 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:20:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TH80258/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:20:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:20:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UT37872> (referer: https://www.auto1.com/v1/car-details-view/UT37872/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:20:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:20:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb15c980-b317-5c5e-bbac-9c7652d395d6 with identifier: UT37872
2026-01-29 06:20:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb15c980-b317-5c5e-bbac-9c7652d395d6 with scrape type 2
2026-01-29 06:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb15c980-b317-5c5e-bbac-9c7652d395d6 with scrape type 2
2026-01-29 06:20:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fb15c980-b317-5c5e-bbac-9c7652d395d6, identifier: UT37872
2026-01-29 06:20:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fb15c980-b317-5c5e-bbac-9c7652d395d6 with identifier: UT37872
2026-01-29 06:20:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fb15c980-b317-5c5e-bbac-9c7652d395d6 with identifier: UT37872
2026-01-29 06:20:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fb15c980-b317-5c5e-bbac-9c7652d395d6 with identifier: UT37872 to the API
2026-01-29 06:20:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:20:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:20:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UT37872>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:25:48Z',
 'fuel_type': 'diesel',
 'id': 'fb15c980-b317-5c5e-bbac-9c7652d395d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT37872',
 'listing': 'auction',
 'location': 'FR, Ingrandes sur Vienne',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 127947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.5 Blue-HDi Feel Business',
 'transmission': 'manual',
 'trim': 'Feel Business',
 'year': 2020}
2026-01-29 06:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT37872%27 HTTP/1.1" 200 None
2026-01-29 06:20:03 [auto1.fr] INFO: Saving data for UT37872: {'auction_closing_time': 1769703948.0, 'created_time': 1769061812.113443, 'last_price_update_time': 1769667603.061395}
2026-01-29 06:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UT37872') HTTP/1.1" 204 0
2026-01-29 06:20:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:20:12 [scrapy.extensions.logstats] INFO: Crawled 1202 pages (at 22 pages/min), scraped 269 items (at 5 items/min)
2026-01-29 06:20:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NZ32657> (referer: https://www.auto1.com/v1/car-details-view/NZ32657/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:20:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:20:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35f9bed6-0f80-5ab4-b328-0c1672bc16f1 with identifier: NZ32657
2026-01-29 06:20:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35f9bed6-0f80-5ab4-b328-0c1672bc16f1 with scrape type 2
2026-01-29 06:20:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35f9bed6-0f80-5ab4-b328-0c1672bc16f1 with scrape type 2
2026-01-29 06:20:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 35f9bed6-0f80-5ab4-b328-0c1672bc16f1, identifier: NZ32657
2026-01-29 06:20:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 35f9bed6-0f80-5ab4-b328-0c1672bc16f1 with identifier: NZ32657
2026-01-29 06:20:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 35f9bed6-0f80-5ab4-b328-0c1672bc16f1 with identifier: NZ32657
2026-01-29 06:20:14 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'renault kadjar 1.2 tce energy life', 'price': 0, 'currency': 'eur', 'make': 'renault', 'model': 'kadjar', 'transmission': 'manual', 'odometer': 143703, 'odometer_reading_unit': 'km', 'registration_date': '2017-10-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nz32657', 'expiration_date': '2026-01-29t16:08:41z', 'origin_country_code': 'fr', 'trim': 'life', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, beaucaire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 126, 'id': '35f9bed6-0f80-5ab4-b328-0c1672bc16f1', 'current_year_diff': 9, 'age_in_months': 99, 'make_model': 'renault kadjar', 'sanitized_make': 'renault', 'odometer_in_km': 143703}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 99,
     'auction_title': '',
     'c_o_2_emission_value': 126,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:08:41z',
     'fuel_type': 'petrol',
     'id': '35f9bed6-0f80-5ab4-b328-0c1672bc16f1',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nz32657',
     'listing': 'auction',
     'location': 'fr, beaucaire',
     'make': 'renault',
     'make_model': 'renault kadjar',
     'model': 'kadjar',
     'odometer': 143703,
     'odometer_in_km': 143703,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-10-26',
     'sanitized_make': 'renault',
     'seats_number': 5,
     'seller_name': None,
     'title': 'renault kadjar 1.2 tce energy life',
     'transmission': 'manual',
     'trim': 'life',
     'year': 2017}
2026-01-29 06:20:14 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 35f9bed6-0f80-5ab4-b328-0c1672bc16f1 spider: auto1.fr
2026-01-29 06:20:15 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 35f9bed6-0f80-5ab4-b328-0c1672bc16f1 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'renault kadjar 1.2 tce energy life', 'price': 0, 'currency': 'eur', 'make': 'renault', 'model': 'kadjar', 'transmission': 'manual', 'odometer': 143703, 'odometer_reading_unit': 'km', 'registration_date': '2017-10-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nz32657', 'expiration_date': '2026-01-29t16:08:41z', 'origin_country_code': 'fr', 'trim': 'life', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, beaucaire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 126, 'id': '35f9bed6-0f80-5ab4-b328-0c1672bc16f1', 'current_year_diff': 9, 'age_in_months': 99, 'make_model': 'renault kadjar', 'sanitized_make': 'renault', 'odometer_in_km': 143703}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 99,
     'auction_title': '',
     'c_o_2_emission_value': 126,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:08:41z',
     'fuel_type': 'petrol',
     'id': '35f9bed6-0f80-5ab4-b328-0c1672bc16f1',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nz32657',
     'listing': 'auction',
     'location': 'fr, beaucaire',
     'make': 'renault',
     'make_model': 'renault kadjar',
     'model': 'kadjar',
     'odometer': 143703,
     'odometer_in_km': 143703,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-10-26',
     'sanitized_make': 'renault',
     'seats_number': 5,
     'seller_name': None,
     'title': 'renault kadjar 1.2 tce energy life',
     'transmission': 'manual',
     'trim': 'life',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:08:41Z',
 'fuel_type': 'petrol',
 'id': '35f9bed6-0f80-5ab4-b328-0c1672bc16f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ32657',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 143703,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Kadjar 1.2 TCe Energy Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2017}
2026-01-29 06:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NZ32657%27 HTTP/1.1" 200 None
2026-01-29 06:20:15 [auto1.fr] INFO: Saving data for NZ32657: {'auction_closing_time': 1769702921.0, 'created_time': 1768412398.245158, 'last_price_update_time': 1769667615.045553}
2026-01-29 06:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NZ32657') HTTP/1.1" 204 0
2026-01-29 06:20:17 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.263(s), this was the 1st time calling it.
2026-01-29 06:20:17 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.055753179385374 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:20:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BU69247> (referer: https://www.auto1.com/v1/car-details-view/BU69247/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:20:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:20:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eafbe476-c996-583f-9f24-cd4e7ca6bc26 with identifier: BU69247
2026-01-29 06:20:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eafbe476-c996-583f-9f24-cd4e7ca6bc26 with scrape type 2
2026-01-29 06:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eafbe476-c996-583f-9f24-cd4e7ca6bc26 with scrape type 2
2026-01-29 06:20:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: eafbe476-c996-583f-9f24-cd4e7ca6bc26, identifier: BU69247
2026-01-29 06:20:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: eafbe476-c996-583f-9f24-cd4e7ca6bc26 with identifier: BU69247
2026-01-29 06:20:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: eafbe476-c996-583f-9f24-cd4e7ca6bc26 with identifier: BU69247
2026-01-29 06:20:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 51111, 'odometer_reading_unit': 'km', 'registration_date': '2017-05-10', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/bu69247', 'expiration_date': '2026-01-29t16:10:21z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, beaucaire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': 'eafbe476-c996-583f-9f24-cd4e7ca6bc26', 'current_year_diff': 9, 'age_in_months': 104, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 51111}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 104,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:10:21z',
     'fuel_type': 'petrol',
     'id': 'eafbe476-c996-583f-9f24-cd4e7ca6bc26',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/bu69247',
     'listing': 'auction',
     'location': 'fr, beaucaire',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 51111,
     'odometer_in_km': 51111,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-05-10',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2017}
2026-01-29 06:20:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: eafbe476-c996-583f-9f24-cd4e7ca6bc26 spider: auto1.fr
2026-01-29 06:20:19 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: eafbe476-c996-583f-9f24-cd4e7ca6bc26 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 51111, 'odometer_reading_unit': 'km', 'registration_date': '2017-05-10', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/bu69247', 'expiration_date': '2026-01-29t16:10:21z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, beaucaire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': 'eafbe476-c996-583f-9f24-cd4e7ca6bc26', 'current_year_diff': 9, 'age_in_months': 104, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 51111}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 104,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:10:21z',
     'fuel_type': 'petrol',
     'id': 'eafbe476-c996-583f-9f24-cd4e7ca6bc26',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/bu69247',
     'listing': 'auction',
     'location': 'fr, beaucaire',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 51111,
     'odometer_in_km': 51111,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-05-10',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:10:21Z',
 'fuel_type': 'petrol',
 'id': 'eafbe476-c996-583f-9f24-cd4e7ca6bc26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU69247',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 51111,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2017}
2026-01-29 06:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BU69247%27 HTTP/1.1" 200 None
2026-01-29 06:20:19 [auto1.fr] INFO: Saving data for BU69247: {'auction_closing_time': 1769703021.0, 'created_time': 1769447340.324757, 'last_price_update_time': 1769667619.257091}
2026-01-29 06:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BU69247') HTTP/1.1" 204 0
2026-01-29 06:20:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AA38230> (referer: https://www.auto1.com/v1/car-details-view/AA38230/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:20:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:20:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e2fcf41-3863-5c38-8c5b-64a812f69454 with identifier: AA38230
2026-01-29 06:20:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e2fcf41-3863-5c38-8c5b-64a812f69454 with scrape type 2
2026-01-29 06:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e2fcf41-3863-5c38-8c5b-64a812f69454 with scrape type 2
2026-01-29 06:20:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6e2fcf41-3863-5c38-8c5b-64a812f69454, identifier: AA38230
2026-01-29 06:20:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6e2fcf41-3863-5c38-8c5b-64a812f69454 with identifier: AA38230
2026-01-29 06:20:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6e2fcf41-3863-5c38-8c5b-64a812f69454 with identifier: AA38230
2026-01-29 06:20:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 108 1.2 vti collection', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '108', 'transmission': 'manual', 'odometer': 79546, 'odometer_reading_unit': 'km', 'registration_date': '2017-11-01', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/aa38230', 'expiration_date': '2026-01-29t16:26:48z', 'origin_country_code': 'fr', 'trim': 'collection', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marly-la-ville', 'category': None, 'seats_number': 4, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 99, 'id': '6e2fcf41-3863-5c38-8c5b-64a812f69454', 'current_year_diff': 9, 'age_in_months': 98, 'make_model': 'peugeot 108', 'sanitized_make': 'peugeot', 'odometer_in_km': 79546}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 98,
     'auction_title': '',
     'c_o_2_emission_value': 99,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:26:48z',
     'fuel_type': 'petrol',
     'id': '6e2fcf41-3863-5c38-8c5b-64a812f69454',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/aa38230',
     'listing': 'auction',
     'location': 'fr, marly-la-ville',
     'make': 'peugeot',
     'make_model': 'peugeot 108',
     'model': '108',
     'odometer': 79546,
     'odometer_in_km': 79546,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-11-01',
     'sanitized_make': 'peugeot',
     'seats_number': 4,
     'seller_name': None,
     'title': 'peugeot 108 1.2 vti collection',
     'transmission': 'manual',
     'trim': 'collection',
     'year': 2017}
2026-01-29 06:20:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 6e2fcf41-3863-5c38-8c5b-64a812f69454 spider: auto1.fr
2026-01-29 06:20:23 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 6e2fcf41-3863-5c38-8c5b-64a812f69454 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 108 1.2 vti collection', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '108', 'transmission': 'manual', 'odometer': 79546, 'odometer_reading_unit': 'km', 'registration_date': '2017-11-01', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/aa38230', 'expiration_date': '2026-01-29t16:26:48z', 'origin_country_code': 'fr', 'trim': 'collection', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marly-la-ville', 'category': None, 'seats_number': 4, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 99, 'id': '6e2fcf41-3863-5c38-8c5b-64a812f69454', 'current_year_diff': 9, 'age_in_months': 98, 'make_model': 'peugeot 108', 'sanitized_make': 'peugeot', 'odometer_in_km': 79546}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 98,
     'auction_title': '',
     'c_o_2_emission_value': 99,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:26:48z',
     'fuel_type': 'petrol',
     'id': '6e2fcf41-3863-5c38-8c5b-64a812f69454',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/aa38230',
     'listing': 'auction',
     'location': 'fr, marly-la-ville',
     'make': 'peugeot',
     'make_model': 'peugeot 108',
     'model': '108',
     'odometer': 79546,
     'odometer_in_km': 79546,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-11-01',
     'sanitized_make': 'peugeot',
     'seats_number': 4,
     'seller_name': None,
     'title': 'peugeot 108 1.2 vti collection',
     'transmission': 'manual',
     'trim': 'collection',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:26:48Z',
 'fuel_type': 'petrol',
 'id': '6e2fcf41-3863-5c38-8c5b-64a812f69454',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA38230',
 'listing': 'auction',
 'location': 'FR, Marly-la-ville',
 'make': 'Peugeot',
 'model': '108',
 'odometer': 79546,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-01',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Peugeot 108 1.2 VTi Collection',
 'transmission': 'manual',
 'trim': 'Collection',
 'year': 2017}
2026-01-29 06:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AA38230%27 HTTP/1.1" 200 None
2026-01-29 06:20:23 [auto1.fr] INFO: Saving data for AA38230: {'auction_closing_time': 1769704008.0, 'created_time': 1769533515.738742, 'last_price_update_time': 1769667623.406658}
2026-01-29 06:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AA38230') HTTP/1.1" 204 0
2026-01-29 06:20:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:20:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FP08043> (referer: https://www.auto1.com/v1/car-details-view/FP08043/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:20:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:20:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34fb56c0-41ac-5bc6-bbbd-94d5da87276b with identifier: FP08043
2026-01-29 06:20:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34fb56c0-41ac-5bc6-bbbd-94d5da87276b with scrape type 2
2026-01-29 06:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34fb56c0-41ac-5bc6-bbbd-94d5da87276b with scrape type 2
2026-01-29 06:20:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 34fb56c0-41ac-5bc6-bbbd-94d5da87276b, identifier: FP08043
2026-01-29 06:20:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 34fb56c0-41ac-5bc6-bbbd-94d5da87276b with identifier: FP08043
2026-01-29 06:20:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 34fb56c0-41ac-5bc6-bbbd-94d5da87276b with identifier: FP08043
2026-01-29 06:20:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 142023, 'odometer_reading_unit': 'km', 'registration_date': '2018-02-13', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fp08043', 'expiration_date': '2026-01-29t16:13:25z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, boé', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': '34fb56c0-41ac-5bc6-bbbd-94d5da87276b', 'current_year_diff': 8, 'age_in_months': 95, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 142023}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 95,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:13:25z',
     'fuel_type': 'petrol',
     'id': '34fb56c0-41ac-5bc6-bbbd-94d5da87276b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fp08043',
     'listing': 'auction',
     'location': 'fr, boé',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 142023,
     'odometer_in_km': 142023,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-02-13',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2018}
2026-01-29 06:20:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 34fb56c0-41ac-5bc6-bbbd-94d5da87276b spider: auto1.fr
2026-01-29 06:20:38 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 34fb56c0-41ac-5bc6-bbbd-94d5da87276b due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 142023, 'odometer_reading_unit': 'km', 'registration_date': '2018-02-13', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fp08043', 'expiration_date': '2026-01-29t16:13:25z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, boé', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': '34fb56c0-41ac-5bc6-bbbd-94d5da87276b', 'current_year_diff': 8, 'age_in_months': 95, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 142023}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 95,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:13:25z',
     'fuel_type': 'petrol',
     'id': '34fb56c0-41ac-5bc6-bbbd-94d5da87276b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fp08043',
     'listing': 'auction',
     'location': 'fr, boé',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 142023,
     'odometer_in_km': 142023,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-02-13',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:13:25Z',
 'fuel_type': 'petrol',
 'id': '34fb56c0-41ac-5bc6-bbbd-94d5da87276b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP08043',
 'listing': 'auction',
 'location': 'FR, Boé',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 142023,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2018}
2026-01-29 06:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP08043%27 HTTP/1.1" 200 None
2026-01-29 06:20:38 [auto1.fr] INFO: Saving data for FP08043: {'auction_closing_time': 1769703205.0, 'created_time': 1769534396.074844, 'last_price_update_time': 1769667638.710701}
2026-01-29 06:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FP08043') HTTP/1.1" 204 0
2026-01-29 06:20:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FL41948/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:20:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:20:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ED70326/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:20:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:20:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RG56256/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:20:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:20:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UK93702> (referer: https://www.auto1.com/v1/car-details-view/UK93702/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:20:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:20:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64a5227e-654c-5d5b-a9c8-b002bf76e2b2 with identifier: UK93702
2026-01-29 06:20:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64a5227e-654c-5d5b-a9c8-b002bf76e2b2 with scrape type 2
2026-01-29 06:20:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64a5227e-654c-5d5b-a9c8-b002bf76e2b2 with scrape type 2
2026-01-29 06:20:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 64a5227e-654c-5d5b-a9c8-b002bf76e2b2, identifier: UK93702
2026-01-29 06:20:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 64a5227e-654c-5d5b-a9c8-b002bf76e2b2 with identifier: UK93702
2026-01-29 06:20:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 64a5227e-654c-5d5b-a9c8-b002bf76e2b2 with identifier: UK93702
2026-01-29 06:20:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 64a5227e-654c-5d5b-a9c8-b002bf76e2b2 with identifier: UK93702 to the API
2026-01-29 06:20:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:20:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:20:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UK93702>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 228,
 'expiration_date': '2026-01-29T16:01:35Z',
 'fuel_type': 'electro',
 'id': '64a5227e-654c-5d5b-a9c8-b002bf76e2b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK93702',
 'listing': 'auction',
 'location': 'FR, Saint Aignan de Grandlieu',
 'make': 'Kia',
 'model': 'EV6',
 'odometer': 71264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia EV6 electric drive 168 kW GT Line 2WD',
 'transmission': 'automatic',
 'trim': 'GT Line 2WD',
 'year': 2021}
2026-01-29 06:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UK93702%27 HTTP/1.1" 200 None
2026-01-29 06:20:44 [auto1.fr] INFO: Saving data for UK93702: {'auction_closing_time': 1769702495.0, 'created_time': 1768844336.326725, 'last_price_update_time': 1769667644.108424}
2026-01-29 06:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UK93702') HTTP/1.1" 204 0
2026-01-29 06:20:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NL39371/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:20:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:20:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FM22383> (referer: https://www.auto1.com/v1/car-details-view/FM22383/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:20:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:20:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58f1c5f6-492a-56b6-a0af-c109af50904c with identifier: FM22383
2026-01-29 06:20:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58f1c5f6-492a-56b6-a0af-c109af50904c with scrape type 2
2026-01-29 06:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58f1c5f6-492a-56b6-a0af-c109af50904c with scrape type 2
2026-01-29 06:20:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 58f1c5f6-492a-56b6-a0af-c109af50904c, identifier: FM22383
2026-01-29 06:20:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 58f1c5f6-492a-56b6-a0af-c109af50904c with identifier: FM22383
2026-01-29 06:20:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 58f1c5f6-492a-56b6-a0af-c109af50904c with identifier: FM22383
2026-01-29 06:20:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 58f1c5f6-492a-56b6-a0af-c109af50904c with identifier: FM22383 to the API
2026-01-29 06:20:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:20:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:20:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FM22383>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:10:36Z',
 'fuel_type': 'diesel',
 'id': '58f1c5f6-492a-56b6-a0af-c109af50904c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM22383',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 120024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-24',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TDI Carat 4Motion',
 'transmission': 'automatic',
 'trim': 'Carat 4Motion',
 'year': 2019}
2026-01-29 06:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FM22383%27 HTTP/1.1" 200 None
2026-01-29 06:20:49 [auto1.fr] INFO: Saving data for FM22383: {'auction_closing_time': 1769703036.0, 'created_time': 1769533776.356677, 'last_price_update_time': 1769667649.411436}
2026-01-29 06:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FM22383') HTTP/1.1" 204 0
2026-01-29 06:21:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YH56697/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:21:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:21:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YV88570/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:21:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:21:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TC04302/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:21:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:21:12 [scrapy.extensions.logstats] INFO: Crawled 1215 pages (at 13 pages/min), scraped 271 items (at 2 items/min)
2026-01-29 06:21:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KR36076/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:21:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:21:29 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.091(s), this was the 1st time calling it.
2026-01-29 06:21:29 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.694157000935617 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:21:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:21:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DV57349/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:21:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:22:00 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.776(s), this was the 1st time calling it.
2026-01-29 06:22:00 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.8289095357292275 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:22:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FL41948> (referer: https://www.auto1.com/v1/car-details-view/FL41948/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:22:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:22:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e885eda-d9ec-5da3-8000-85e8bfedbeea with identifier: FL41948
2026-01-29 06:22:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e885eda-d9ec-5da3-8000-85e8bfedbeea with scrape type 2
2026-01-29 06:22:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e885eda-d9ec-5da3-8000-85e8bfedbeea with scrape type 2
2026-01-29 06:22:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0e885eda-d9ec-5da3-8000-85e8bfedbeea, identifier: FL41948
2026-01-29 06:22:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0e885eda-d9ec-5da3-8000-85e8bfedbeea with identifier: FL41948
2026-01-29 06:22:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0e885eda-d9ec-5da3-8000-85e8bfedbeea with identifier: FL41948
2026-01-29 06:22:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0e885eda-d9ec-5da3-8000-85e8bfedbeea with identifier: FL41948 to the API
2026-01-29 06:22:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:22:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:22:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FL41948>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 179,
 'expiration_date': '2026-01-29T16:40:18Z',
 'fuel_type': 'diesel',
 'id': '0e885eda-d9ec-5da3-8000-85e8bfedbeea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL41948',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 104962,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 Aircross 2.0 Blue-HDi Shine Pack',
 'transmission': 'automatic',
 'trim': 'Shine Pack',
 'year': 2020}
2026-01-29 06:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FL41948%27 HTTP/1.1" 200 None
2026-01-29 06:22:01 [auto1.fr] INFO: Saving data for FL41948: {'auction_closing_time': 1769704818.0, 'created_time': 1769534390.968519, 'last_price_update_time': 1769667721.323349}
2026-01-29 06:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FL41948') HTTP/1.1" 204 0
2026-01-29 06:22:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:22:12 [scrapy.extensions.logstats] INFO: Crawled 1218 pages (at 3 pages/min), scraped 272 items (at 1 items/min)
2026-01-29 06:22:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LA76309/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:22:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:22:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TD35011/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:22:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:22:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RG56256> (referer: https://www.auto1.com/v1/car-details-view/RG56256/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:22:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:22:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d9eaad3-d72d-51b4-9ebc-62ad2c8ae488 with identifier: RG56256
2026-01-29 06:22:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d9eaad3-d72d-51b4-9ebc-62ad2c8ae488 with scrape type 2
2026-01-29 06:22:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d9eaad3-d72d-51b4-9ebc-62ad2c8ae488 with scrape type 2
2026-01-29 06:22:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3d9eaad3-d72d-51b4-9ebc-62ad2c8ae488, identifier: RG56256
2026-01-29 06:22:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3d9eaad3-d72d-51b4-9ebc-62ad2c8ae488 with identifier: RG56256
2026-01-29 06:22:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3d9eaad3-d72d-51b4-9ebc-62ad2c8ae488 with identifier: RG56256
2026-01-29 06:22:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech active pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 31850, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/rg56256', 'expiration_date': '2026-01-29t16:35:23z', 'origin_country_code': 'fr', 'trim': 'active pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, saint aignan de grandlieu', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 119, 'id': '3d9eaad3-d72d-51b4-9ebc-62ad2c8ae488', 'current_year_diff': 4, 'age_in_months': 43, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 31850}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 43,
     'auction_title': '',
     'c_o_2_emission_value': 119,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 75,
     'expiration_date': '2026-01-29t16:35:23z',
     'fuel_type': 'petrol',
     'id': '3d9eaad3-d72d-51b4-9ebc-62ad2c8ae488',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/rg56256',
     'listing': 'auction',
     'location': 'fr, saint aignan de grandlieu',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 31850,
     'odometer_in_km': 31850,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-06-28',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech active pack',
     'transmission': 'manual',
     'trim': 'active pack',
     'year': 2022}
2026-01-29 06:22:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 3d9eaad3-d72d-51b4-9ebc-62ad2c8ae488 spider: auto1.fr
2026-01-29 06:22:21 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 3d9eaad3-d72d-51b4-9ebc-62ad2c8ae488 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech active pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 31850, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-28', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/rg56256', 'expiration_date': '2026-01-29t16:35:23z', 'origin_country_code': 'fr', 'trim': 'active pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, saint aignan de grandlieu', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 119, 'id': '3d9eaad3-d72d-51b4-9ebc-62ad2c8ae488', 'current_year_diff': 4, 'age_in_months': 43, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 31850}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 43,
     'auction_title': '',
     'c_o_2_emission_value': 119,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 75,
     'expiration_date': '2026-01-29t16:35:23z',
     'fuel_type': 'petrol',
     'id': '3d9eaad3-d72d-51b4-9ebc-62ad2c8ae488',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/rg56256',
     'listing': 'auction',
     'location': 'fr, saint aignan de grandlieu',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 31850,
     'odometer_in_km': 31850,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-06-28',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech active pack',
     'transmission': 'manual',
     'trim': 'active pack',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:35:23Z',
 'fuel_type': 'petrol',
 'id': '3d9eaad3-d72d-51b4-9ebc-62ad2c8ae488',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG56256',
 'listing': 'auction',
 'location': 'FR, Saint Aignan de Grandlieu',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 31850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Active Pack',
 'transmission': 'manual',
 'trim': 'Active Pack',
 'year': 2022}
2026-01-29 06:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG56256%27 HTTP/1.1" 200 None
2026-01-29 06:22:21 [auto1.fr] INFO: Saving data for RG56256: {'auction_closing_time': 1769704523.0, 'created_time': 1768412883.497235, 'last_price_update_time': 1769667741.719191}
2026-01-29 06:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RG56256') HTTP/1.1" 204 0
2026-01-29 06:22:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NL39371> (referer: https://www.auto1.com/v1/car-details-view/NL39371/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:22:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:22:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c653b345-9e5e-50fc-b7b9-006280e55d10 with identifier: NL39371
2026-01-29 06:22:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c653b345-9e5e-50fc-b7b9-006280e55d10 with scrape type 2
2026-01-29 06:22:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c653b345-9e5e-50fc-b7b9-006280e55d10 with scrape type 2
2026-01-29 06:22:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c653b345-9e5e-50fc-b7b9-006280e55d10, identifier: NL39371
2026-01-29 06:22:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c653b345-9e5e-50fc-b7b9-006280e55d10 with identifier: NL39371
2026-01-29 06:22:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c653b345-9e5e-50fc-b7b9-006280e55d10 with identifier: NL39371
2026-01-29 06:22:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c653b345-9e5e-50fc-b7b9-006280e55d10 with identifier: NL39371 to the API
2026-01-29 06:22:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:22:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:22:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NL39371>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-01-29T16:05:22Z',
 'fuel_type': 'petrol',
 'id': 'c653b345-9e5e-50fc-b7b9-006280e55d10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL39371',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'BMW',
 'model': '4er',
 'odometer': 67251,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-20',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW 4er 420i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-01-29 06:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NL39371%27 HTTP/1.1" 200 None
2026-01-29 06:22:30 [auto1.fr] INFO: Saving data for NL39371: {'auction_closing_time': 1769702722.0, 'created_time': 1768905628.65702, 'last_price_update_time': 1769667750.368661}
2026-01-29 06:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NL39371') HTTP/1.1" 204 0
2026-01-29 06:22:32 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.007(s), this was the 1st time calling it.
2026-01-29 06:22:32 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.618585180731852 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:22:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:22:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VR06438/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:22:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:22:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YV88570> (referer: https://www.auto1.com/v1/car-details-view/YV88570/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:22:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:22:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9f25b28-065d-51bf-ae90-c36b07d16b8f with identifier: YV88570
2026-01-29 06:22:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9f25b28-065d-51bf-ae90-c36b07d16b8f with scrape type 2
2026-01-29 06:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9f25b28-065d-51bf-ae90-c36b07d16b8f with scrape type 2
2026-01-29 06:22:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c9f25b28-065d-51bf-ae90-c36b07d16b8f, identifier: YV88570
2026-01-29 06:22:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c9f25b28-065d-51bf-ae90-c36b07d16b8f with identifier: YV88570
2026-01-29 06:22:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c9f25b28-065d-51bf-ae90-c36b07d16b8f with identifier: YV88570
2026-01-29 06:22:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 173625 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    173625
2026-01-29 06:22:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c9f25b28-065d-51bf-ae90-c36b07d16b8f spider: auto1.fr
2026-01-29 06:22:42 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: c9f25b28-065d-51bf-ae90-c36b07d16b8f due to rule: high_mileage_for_country.json, error: 173625 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    173625
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:01:15Z',
 'fuel_type': 'diesel',
 'id': 'c9f25b28-065d-51bf-ae90-c36b07d16b8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV88570',
 'listing': 'auction',
 'location': 'FR, Creutzwald',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 173625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-10',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 1.5 Blue-HDi Allure Business',
 'transmission': 'automatic',
 'trim': 'Allure Business',
 'year': 2019}
2026-01-29 06:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YV88570%27 HTTP/1.1" 200 None
2026-01-29 06:22:42 [auto1.fr] INFO: Saving data for YV88570: {'auction_closing_time': 1769702475.0, 'created_time': 1766597960.468634, 'last_price_update_time': 1769667762.491084}
2026-01-29 06:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YV88570') HTTP/1.1" 204 0
2026-01-29 06:22:53 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.194(s), this was the 1st time calling it.
2026-01-29 06:22:53 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.4224214414366925 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:22:53 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.787(s), this was the 1st time calling it.
2026-01-29 06:22:53 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.784174584618022 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:22:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:23:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:23:12 [scrapy.extensions.logstats] INFO: Crawled 1224 pages (at 6 pages/min), scraped 273 items (at 1 items/min)
2026-01-29 06:23:17 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.424(s), this was the 1st time calling it.
2026-01-29 06:23:17 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.8643481275549325 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:23:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TC04302> (referer: https://www.auto1.com/v1/car-details-view/TC04302/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:23:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:23:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b96562c-146b-5d39-8188-1a994e7c21b0 with identifier: TC04302
2026-01-29 06:23:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b96562c-146b-5d39-8188-1a994e7c21b0 with scrape type 2
2026-01-29 06:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b96562c-146b-5d39-8188-1a994e7c21b0 with scrape type 2
2026-01-29 06:23:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1b96562c-146b-5d39-8188-1a994e7c21b0, identifier: TC04302
2026-01-29 06:23:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1b96562c-146b-5d39-8188-1a994e7c21b0 with identifier: TC04302
2026-01-29 06:23:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1b96562c-146b-5d39-8188-1a994e7c21b0 with identifier: TC04302
2026-01-29 06:23:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 131357 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    131357
2026-01-29 06:23:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 1b96562c-146b-5d39-8188-1a994e7c21b0 spider: auto1.fr
2026-01-29 06:23:19 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 1b96562c-146b-5d39-8188-1a994e7c21b0 due to rule: high_mileage_for_make.json, error: 131357 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    131357
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:44:32Z',
 'fuel_type': 'petrol',
 'id': '1b96562c-146b-5d39-8188-1a994e7c21b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC04302',
 'listing': 'auction',
 'location': 'FR, Ambarès-et-Lagrave',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 131357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.0 TCe Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2019}
2026-01-29 06:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TC04302%27 HTTP/1.1" 200 None
2026-01-29 06:23:19 [auto1.fr] INFO: Saving data for TC04302: {'auction_closing_time': 1769705072.0, 'created_time': 1768118793.000297, 'last_price_update_time': 1769667799.37174}
2026-01-29 06:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TC04302') HTTP/1.1" 204 0
2026-01-29 06:23:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KR36076> (referer: https://www.auto1.com/v1/car-details-view/KR36076/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:23:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:23:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 279df0e1-7afa-5c00-972d-5cdaf1f2218b with identifier: KR36076
2026-01-29 06:23:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 279df0e1-7afa-5c00-972d-5cdaf1f2218b with scrape type 2
2026-01-29 06:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 279df0e1-7afa-5c00-972d-5cdaf1f2218b with scrape type 2
2026-01-29 06:23:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 279df0e1-7afa-5c00-972d-5cdaf1f2218b, identifier: KR36076
2026-01-29 06:23:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 279df0e1-7afa-5c00-972d-5cdaf1f2218b with identifier: KR36076
2026-01-29 06:23:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 279df0e1-7afa-5c00-972d-5cdaf1f2218b with identifier: KR36076
2026-01-29 06:23:20 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'renault captur 1.2 tce energy intens', 'price': 0, 'currency': 'eur', 'make': 'renault', 'model': 'captur', 'transmission': 'automatic', 'odometer': 33854, 'odometer_reading_unit': 'km', 'registration_date': '2018-01-15', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kr36076', 'expiration_date': '2026-01-29t16:08:38z', 'origin_country_code': 'fr', 'trim': 'intens', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 120, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'rezé', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 125, 'id': '279df0e1-7afa-5c00-972d-5cdaf1f2218b', 'current_year_diff': 8, 'age_in_months': 96, 'make_model': 'renault captur', 'sanitized_make': 'renault', 'odometer_in_km': 33854}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 96,
     'auction_title': '',
     'c_o_2_emission_value': 125,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 120,
     'expiration_date': '2026-01-29t16:08:38z',
     'fuel_type': 'petrol',
     'id': '279df0e1-7afa-5c00-972d-5cdaf1f2218b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kr36076',
     'listing': 'auction',
     'location': 'rezé',
     'make': 'renault',
     'make_model': 'renault captur',
     'model': 'captur',
     'odometer': 33854,
     'odometer_in_km': 33854,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-01-15',
     'sanitized_make': 'renault',
     'seats_number': 5,
     'seller_name': None,
     'title': 'renault captur 1.2 tce energy intens',
     'transmission': 'automatic',
     'trim': 'intens',
     'year': 2018}
2026-01-29 06:23:20 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 279df0e1-7afa-5c00-972d-5cdaf1f2218b spider: auto1.fr
2026-01-29 06:23:20 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 279df0e1-7afa-5c00-972d-5cdaf1f2218b due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'renault captur 1.2 tce energy intens', 'price': 0, 'currency': 'eur', 'make': 'renault', 'model': 'captur', 'transmission': 'automatic', 'odometer': 33854, 'odometer_reading_unit': 'km', 'registration_date': '2018-01-15', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kr36076', 'expiration_date': '2026-01-29t16:08:38z', 'origin_country_code': 'fr', 'trim': 'intens', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 120, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'rezé', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 125, 'id': '279df0e1-7afa-5c00-972d-5cdaf1f2218b', 'current_year_diff': 8, 'age_in_months': 96, 'make_model': 'renault captur', 'sanitized_make': 'renault', 'odometer_in_km': 33854}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 96,
     'auction_title': '',
     'c_o_2_emission_value': 125,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 120,
     'expiration_date': '2026-01-29t16:08:38z',
     'fuel_type': 'petrol',
     'id': '279df0e1-7afa-5c00-972d-5cdaf1f2218b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kr36076',
     'listing': 'auction',
     'location': 'rezé',
     'make': 'renault',
     'make_model': 'renault captur',
     'model': 'captur',
     'odometer': 33854,
     'odometer_in_km': 33854,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-01-15',
     'sanitized_make': 'renault',
     'seats_number': 5,
     'seller_name': None,
     'title': 'renault captur 1.2 tce energy intens',
     'transmission': 'automatic',
     'trim': 'intens',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:08:38Z',
 'fuel_type': 'petrol',
 'id': '279df0e1-7afa-5c00-972d-5cdaf1f2218b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR36076',
 'listing': 'auction',
 'location': 'Rezé',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 33854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.2 TCe Energy Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2018}
2026-01-29 06:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KR36076%27 HTTP/1.1" 200 None
2026-01-29 06:23:20 [auto1.fr] INFO: Saving data for KR36076: {'auction_closing_time': 1769702918.0, 'created_time': 1769449120.002195, 'last_price_update_time': 1769667800.650064}
2026-01-29 06:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KR36076') HTTP/1.1" 204 0
2026-01-29 06:23:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DV57349> (referer: https://www.auto1.com/v1/car-details-view/DV57349/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:23:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:23:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c319a91-245e-5b32-88c8-6c25d64499cf with identifier: DV57349
2026-01-29 06:23:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c319a91-245e-5b32-88c8-6c25d64499cf with scrape type 2
2026-01-29 06:23:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c319a91-245e-5b32-88c8-6c25d64499cf with scrape type 2
2026-01-29 06:23:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5c319a91-245e-5b32-88c8-6c25d64499cf, identifier: DV57349
2026-01-29 06:23:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5c319a91-245e-5b32-88c8-6c25d64499cf with identifier: DV57349
2026-01-29 06:23:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5c319a91-245e-5b32-88c8-6c25d64499cf with identifier: DV57349
2026-01-29 06:23:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 139053 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    139053
2026-01-29 06:23:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 5c319a91-245e-5b32-88c8-6c25d64499cf spider: auto1.fr
2026-01-29 06:23:22 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 5c319a91-245e-5b32-88c8-6c25d64499cf due to rule: high_mileage_for_make.json, error: 139053 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    139053
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:43:44Z',
 'fuel_type': 'diesel',
 'id': '5c319a91-245e-5b32-88c8-6c25d64499cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV57349',
 'listing': 'auction',
 'location': 'FR, Valence',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 139053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 Blue-HDi GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2018}
2026-01-29 06:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DV57349%27 HTTP/1.1" 200 None
2026-01-29 06:23:22 [auto1.fr] INFO: Saving data for DV57349: {'auction_closing_time': 1769705024.0, 'created_time': 1769533613.366824, 'last_price_update_time': 1769667802.924259}
2026-01-29 06:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DV57349') HTTP/1.1" 204 0
2026-01-29 06:23:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:23:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YS02747/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:23:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:23:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LA76309> (referer: https://www.auto1.com/v1/car-details-view/LA76309/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:23:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:23:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36c1338f-2d14-5740-acea-54a44fff3eae with identifier: LA76309
2026-01-29 06:23:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36c1338f-2d14-5740-acea-54a44fff3eae with scrape type 2
2026-01-29 06:23:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36c1338f-2d14-5740-acea-54a44fff3eae with scrape type 2
2026-01-29 06:23:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 36c1338f-2d14-5740-acea-54a44fff3eae, identifier: LA76309
2026-01-29 06:23:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 36c1338f-2d14-5740-acea-54a44fff3eae with identifier: LA76309
2026-01-29 06:23:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 36c1338f-2d14-5740-acea-54a44fff3eae with identifier: LA76309
2026-01-29 06:23:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'manual', 'odometer': 107150, 'odometer_reading_unit': 'km', 'registration_date': '2017-04-11', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/la76309', 'expiration_date': '2026-01-29t16:23:25z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ambarès-et-lagrave', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 117, 'id': '36c1338f-2d14-5740-acea-54a44fff3eae', 'current_year_diff': 9, 'age_in_months': 105, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 107150}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 105,
     'auction_title': '',
     'c_o_2_emission_value': 117,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:23:25z',
     'fuel_type': 'petrol',
     'id': '36c1338f-2d14-5740-acea-54a44fff3eae',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/la76309',
     'listing': 'auction',
     'location': 'fr, ambarès-et-lagrave',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 107150,
     'odometer_in_km': 107150,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-04-11',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2017}
2026-01-29 06:23:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 36c1338f-2d14-5740-acea-54a44fff3eae spider: auto1.fr
2026-01-29 06:23:29 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 36c1338f-2d14-5740-acea-54a44fff3eae due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'manual', 'odometer': 107150, 'odometer_reading_unit': 'km', 'registration_date': '2017-04-11', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/la76309', 'expiration_date': '2026-01-29t16:23:25z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ambarès-et-lagrave', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 117, 'id': '36c1338f-2d14-5740-acea-54a44fff3eae', 'current_year_diff': 9, 'age_in_months': 105, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 107150}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 105,
     'auction_title': '',
     'c_o_2_emission_value': 117,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:23:25z',
     'fuel_type': 'petrol',
     'id': '36c1338f-2d14-5740-acea-54a44fff3eae',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/la76309',
     'listing': 'auction',
     'location': 'fr, ambarès-et-lagrave',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 107150,
     'odometer_in_km': 107150,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-04-11',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:23:25Z',
 'fuel_type': 'petrol',
 'id': '36c1338f-2d14-5740-acea-54a44fff3eae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA76309',
 'listing': 'auction',
 'location': 'FR, Ambarès-et-Lagrave',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 107150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2017}
2026-01-29 06:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LA76309%27 HTTP/1.1" 200 None
2026-01-29 06:23:29 [auto1.fr] INFO: Saving data for LA76309: {'auction_closing_time': 1769703805.0, 'created_time': 1768889041.300861, 'last_price_update_time': 1769667809.383917}
2026-01-29 06:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LA76309') HTTP/1.1" 204 0
2026-01-29 06:23:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AH80283/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:23:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:23:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZP30272/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:23:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:23:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TD35011> (referer: https://www.auto1.com/v1/car-details-view/TD35011/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:23:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:23:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c417463d-f295-5b57-8d94-d9e1ef652741 with identifier: TD35011
2026-01-29 06:23:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c417463d-f295-5b57-8d94-d9e1ef652741 with scrape type 2
2026-01-29 06:23:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c417463d-f295-5b57-8d94-d9e1ef652741 with scrape type 2
2026-01-29 06:23:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c417463d-f295-5b57-8d94-d9e1ef652741, identifier: TD35011
2026-01-29 06:23:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c417463d-f295-5b57-8d94-d9e1ef652741 with identifier: TD35011
2026-01-29 06:23:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c417463d-f295-5b57-8d94-d9e1ef652741 with identifier: TD35011
2026-01-29 06:23:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gold', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 5008 1.2 puretech active', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '5008', 'transmission': 'manual', 'odometer': 132479, 'odometer_reading_unit': 'km', 'registration_date': '2017-07-11', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/td35011', 'expiration_date': '2026-01-29t16:56:03z', 'origin_country_code': 'fr', 'trim': 'active', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 117, 'id': 'c417463d-f295-5b57-8d94-d9e1ef652741', 'current_year_diff': 9, 'age_in_months': 102, 'make_model': 'peugeot 5008', 'sanitized_make': 'peugeot', 'odometer_in_km': 132479}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 102,
     'auction_title': '',
     'c_o_2_emission_value': 117,
     'category': None,
     'color': 'gold',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:56:03z',
     'fuel_type': 'petrol',
     'id': 'c417463d-f295-5b57-8d94-d9e1ef652741',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/td35011',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'peugeot',
     'make_model': 'peugeot 5008',
     'model': '5008',
     'odometer': 132479,
     'odometer_in_km': 132479,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-07-11',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 5008 1.2 puretech active',
     'transmission': 'manual',
     'trim': 'active',
     'year': 2017}
2026-01-29 06:23:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: c417463d-f295-5b57-8d94-d9e1ef652741 spider: auto1.fr
2026-01-29 06:23:37 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: c417463d-f295-5b57-8d94-d9e1ef652741 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gold', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 5008 1.2 puretech active', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '5008', 'transmission': 'manual', 'odometer': 132479, 'odometer_reading_unit': 'km', 'registration_date': '2017-07-11', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/td35011', 'expiration_date': '2026-01-29t16:56:03z', 'origin_country_code': 'fr', 'trim': 'active', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 117, 'id': 'c417463d-f295-5b57-8d94-d9e1ef652741', 'current_year_diff': 9, 'age_in_months': 102, 'make_model': 'peugeot 5008', 'sanitized_make': 'peugeot', 'odometer_in_km': 132479}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 102,
     'auction_title': '',
     'c_o_2_emission_value': 117,
     'category': None,
     'color': 'gold',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:56:03z',
     'fuel_type': 'petrol',
     'id': 'c417463d-f295-5b57-8d94-d9e1ef652741',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/td35011',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'peugeot',
     'make_model': 'peugeot 5008',
     'model': '5008',
     'odometer': 132479,
     'odometer_in_km': 132479,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-07-11',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 5008 1.2 puretech active',
     'transmission': 'manual',
     'trim': 'active',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:56:03Z',
 'fuel_type': 'petrol',
 'id': 'c417463d-f295-5b57-8d94-d9e1ef652741',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD35011',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 132479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 5008 1.2 PureTech Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2017}
2026-01-29 06:23:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TD35011%27 HTTP/1.1" 200 None
2026-01-29 06:23:37 [auto1.fr] INFO: Saving data for TD35011: {'auction_closing_time': 1769705763.0, 'created_time': 1769102389.758974, 'last_price_update_time': 1769667817.732144}
2026-01-29 06:23:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TD35011') HTTP/1.1" 204 0
2026-01-29 06:23:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VR06438> (referer: https://www.auto1.com/v1/car-details-view/VR06438/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:23:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:23:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e2114b8-72b8-5b03-a0f5-ece1504869da with identifier: VR06438
2026-01-29 06:23:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e2114b8-72b8-5b03-a0f5-ece1504869da with scrape type 2
2026-01-29 06:23:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e2114b8-72b8-5b03-a0f5-ece1504869da with scrape type 2
2026-01-29 06:23:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8e2114b8-72b8-5b03-a0f5-ece1504869da, identifier: VR06438
2026-01-29 06:23:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8e2114b8-72b8-5b03-a0f5-ece1504869da with identifier: VR06438
2026-01-29 06:23:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8e2114b8-72b8-5b03-a0f5-ece1504869da with identifier: VR06438
2026-01-29 06:23:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8e2114b8-72b8-5b03-a0f5-ece1504869da with identifier: VR06438 to the API
2026-01-29 06:23:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:23:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:23:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VR06438>
{'auction_title': '',
 'c_o_2_emission_value': 33,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 245,
 'expiration_date': '2026-01-29T16:58:40Z',
 'fuel_type': 'hybrid',
 'id': '8e2114b8-72b8-5b03-a0f5-ece1504869da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR06438',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 92742,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Cupra Formentor 1.4 e-HYBRID VZ',
 'transmission': 'automatic',
 'trim': 'VZ',
 'year': 2021}
2026-01-29 06:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VR06438%27 HTTP/1.1" 200 None
2026-01-29 06:23:39 [auto1.fr] INFO: Saving data for VR06438: {'auction_closing_time': 1769705920.0, 'created_time': 1769580043.59085, 'last_price_update_time': 1769667819.14741}
2026-01-29 06:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VR06438') HTTP/1.1" 204 0
2026-01-29 06:23:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BT27170/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:23:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:23:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XC21641/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:23:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:23:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:23:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:23:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YH56697> (referer: https://www.auto1.com/v1/car-details-view/YH56697/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:23:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:23:40 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:23:40 [auto1.fr] INFO: Found listing with ID: PM11780
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PM11780%27 HTTP/1.1" 200 None
2026-01-29 06:23:40 [auto1.fr] INFO: Scrape type for PM11780: 0
2026-01-29 06:23:40 [auto1.fr] INFO: Found listing with ID: SC26887
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SC26887%27 HTTP/1.1" 200 None
2026-01-29 06:23:40 [auto1.fr] INFO: Scrape type for SC26887: 2
2026-01-29 06:23:40 [auto1.fr] INFO: Found listing with ID: FY50527
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FY50527%27 HTTP/1.1" 200 None
2026-01-29 06:23:40 [auto1.fr] INFO: Scrape type for FY50527: 0
2026-01-29 06:23:40 [auto1.fr] INFO: Found listing with ID: NK01367
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK01367%27 HTTP/1.1" 200 None
2026-01-29 06:23:40 [auto1.fr] INFO: Scrape type for NK01367: 2
2026-01-29 06:23:40 [auto1.fr] INFO: Found listing with ID: VE62610
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VE62610%27 HTTP/1.1" 200 None
2026-01-29 06:23:40 [auto1.fr] INFO: Scrape type for VE62610: 2
2026-01-29 06:23:40 [auto1.fr] INFO: Found listing with ID: MY19591
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MY19591%27 HTTP/1.1" 200 None
2026-01-29 06:23:40 [auto1.fr] INFO: Scrape type for MY19591: 2
2026-01-29 06:23:40 [auto1.fr] INFO: Found listing with ID: XK43933
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XK43933%27 HTTP/1.1" 200 None
2026-01-29 06:23:40 [auto1.fr] INFO: Scrape type for XK43933: 2
2026-01-29 06:23:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79ba5915-66ac-5246-9575-92eb2041bca9 with identifier: YH56697
2026-01-29 06:23:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79ba5915-66ac-5246-9575-92eb2041bca9 with scrape type 2
2026-01-29 06:23:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79ba5915-66ac-5246-9575-92eb2041bca9 with scrape type 2
2026-01-29 06:23:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 79ba5915-66ac-5246-9575-92eb2041bca9, identifier: YH56697
2026-01-29 06:23:40 [auto1.fr] INFO: Found listing with ID: UT09319
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT09319%27 HTTP/1.1" 200 None
2026-01-29 06:23:40 [auto1.fr] INFO: Scrape type for UT09319: 0
2026-01-29 06:23:40 [auto1.fr] INFO: Found listing with ID: JB21555
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JB21555%27 HTTP/1.1" 200 None
2026-01-29 06:23:40 [auto1.fr] INFO: Scrape type for JB21555: 2
2026-01-29 06:23:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 79ba5915-66ac-5246-9575-92eb2041bca9 with identifier: YH56697
2026-01-29 06:23:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 79ba5915-66ac-5246-9575-92eb2041bca9 with identifier: YH56697
2026-01-29 06:23:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 e-thp gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 105593, 'odometer_reading_unit': 'km', 'registration_date': '2017-08-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yh56697', 'expiration_date': '2026-01-29t16:56:39z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 112, 'id': '79ba5915-66ac-5246-9575-92eb2041bca9', 'current_year_diff': 9, 'age_in_months': 100, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 105593}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 100,
     'auction_title': '',
     'c_o_2_emission_value': 112,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:56:39z',
     'fuel_type': 'petrol',
     'id': '79ba5915-66ac-5246-9575-92eb2041bca9',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yh56697',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 105593,
     'odometer_in_km': 105593,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-08-30',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 1.2 e-thp gt line',
     'transmission': 'automatic',
     'trim': 'gt line',
     'year': 2017}
2026-01-29 06:23:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 79ba5915-66ac-5246-9575-92eb2041bca9 spider: auto1.fr
2026-01-29 06:23:40 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 79ba5915-66ac-5246-9575-92eb2041bca9 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 e-thp gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 105593, 'odometer_reading_unit': 'km', 'registration_date': '2017-08-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yh56697', 'expiration_date': '2026-01-29t16:56:39z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 112, 'id': '79ba5915-66ac-5246-9575-92eb2041bca9', 'current_year_diff': 9, 'age_in_months': 100, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 105593}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 100,
     'auction_title': '',
     'c_o_2_emission_value': 112,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:56:39z',
     'fuel_type': 'petrol',
     'id': '79ba5915-66ac-5246-9575-92eb2041bca9',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yh56697',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 105593,
     'odometer_in_km': 105593,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-08-30',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 1.2 e-thp gt line',
     'transmission': 'automatic',
     'trim': 'gt line',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:56:39Z',
 'fuel_type': 'petrol',
 'id': '79ba5915-66ac-5246-9575-92eb2041bca9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH56697',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 105593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2017}
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YH56697%27 HTTP/1.1" 200 None
2026-01-29 06:23:40 [auto1.fr] INFO: Saving data for YH56697: {'auction_closing_time': 1769705799.0, 'created_time': 1768842572.081563, 'last_price_update_time': 1769667820.688132}
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YH56697') HTTP/1.1" 204 0
2026-01-29 06:23:40 [auto1.fr] INFO: Found listing with ID: BN24235
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BN24235%27 HTTP/1.1" 200 None
2026-01-29 06:23:40 [auto1.fr] INFO: Scrape type for BN24235: 0
2026-01-29 06:23:40 [auto1.fr] INFO: Found listing with ID: NR70688
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NR70688%27 HTTP/1.1" 200 None
2026-01-29 06:23:40 [auto1.fr] INFO: Scrape type for NR70688: 0
2026-01-29 06:23:40 [auto1.fr] INFO: Found listing with ID: ZE61894
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZE61894%27 HTTP/1.1" 200 None
2026-01-29 06:23:40 [auto1.fr] INFO: Scrape type for ZE61894: 2
2026-01-29 06:23:40 [auto1.fr] INFO: Found listing with ID: MB50785
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MB50785%27 HTTP/1.1" 200 None
2026-01-29 06:23:40 [auto1.fr] INFO: Scrape type for MB50785: 2
2026-01-29 06:23:40 [auto1.fr] INFO: Found listing with ID: JD17568
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD17568%27 HTTP/1.1" 200 None
2026-01-29 06:23:40 [auto1.fr] INFO: Scrape type for JD17568: 2
2026-01-29 06:23:40 [auto1.fr] INFO: Found listing with ID: LN17372
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LN17372%27 HTTP/1.1" 200 None
2026-01-29 06:23:40 [auto1.fr] INFO: Scrape type for LN17372: 0
2026-01-29 06:23:40 [auto1.fr] INFO: Found listing with ID: CB42594
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CB42594%27 HTTP/1.1" 200 None
2026-01-29 06:23:40 [auto1.fr] INFO: Scrape type for CB42594: 2
2026-01-29 06:23:40 [auto1.fr] INFO: Found listing with ID: AK06652
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AK06652%27 HTTP/1.1" 200 None
2026-01-29 06:23:40 [auto1.fr] INFO: Scrape type for AK06652: 0
2026-01-29 06:23:40 [auto1.fr] INFO: Found listing with ID: WJ79089
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WJ79089%27 HTTP/1.1" 200 None
2026-01-29 06:23:40 [auto1.fr] INFO: Scrape type for WJ79089: 2
2026-01-29 06:23:40 [auto1.fr] INFO: Found listing with ID: XR36503
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XR36503%27 HTTP/1.1" 200 None
2026-01-29 06:23:40 [auto1.fr] INFO: Scrape type for XR36503: 2
2026-01-29 06:23:40 [auto1.fr] INFO: Found listing with ID: TU14726
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU14726%27 HTTP/1.1" 200 None
2026-01-29 06:23:40 [auto1.fr] INFO: Scrape type for TU14726: 0
2026-01-29 06:23:40 [auto1.fr] INFO: Found listing with ID: JG57622
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG57622%27 HTTP/1.1" 200 None
2026-01-29 06:23:40 [auto1.fr] INFO: Scrape type for JG57622: 2
2026-01-29 06:23:40 [auto1.fr] INFO: Found listing with ID: BT54766
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BT54766%27 HTTP/1.1" 200 None
2026-01-29 06:23:40 [auto1.fr] INFO: Scrape type for BT54766: 2
2026-01-29 06:23:40 [auto1.fr] INFO: Found listing with ID: DB91824
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DB91824%27 HTTP/1.1" 200 None
2026-01-29 06:23:40 [auto1.fr] INFO: Scrape type for DB91824: 0
2026-01-29 06:23:40 [auto1.fr] INFO: Found listing with ID: EN41696
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EN41696%27 HTTP/1.1" 200 None
2026-01-29 06:23:40 [auto1.fr] INFO: Scrape type for EN41696: 0
2026-01-29 06:23:40 [auto1.fr] INFO: Found listing with ID: UB86096
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UB86096%27 HTTP/1.1" 200 None
2026-01-29 06:23:40 [auto1.fr] INFO: Scrape type for UB86096: 2
2026-01-29 06:23:40 [auto1.fr] INFO: Found listing with ID: CA18957
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA18957%27 HTTP/1.1" 200 None
2026-01-29 06:23:40 [auto1.fr] INFO: Scrape type for CA18957: 0
2026-01-29 06:23:40 [auto1.fr] INFO: Found listing with ID: MN00481
2026-01-29 06:23:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MN00481%27 HTTP/1.1" 200 None
2026-01-29 06:23:41 [auto1.fr] INFO: Scrape type for MN00481: 0
2026-01-29 06:23:41 [auto1.fr] INFO: Found listing with ID: KM27068
2026-01-29 06:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KM27068%27 HTTP/1.1" 200 None
2026-01-29 06:23:41 [auto1.fr] INFO: Scrape type for KM27068: 0
2026-01-29 06:23:41 [auto1.fr] INFO: Found listing with ID: YP84178
2026-01-29 06:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP84178%27 HTTP/1.1" 200 None
2026-01-29 06:23:41 [auto1.fr] INFO: Scrape type for YP84178: 0
2026-01-29 06:23:41 [auto1.fr] INFO: Found listing with ID: NY87258
2026-01-29 06:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NY87258%27 HTTP/1.1" 200 None
2026-01-29 06:23:41 [auto1.fr] INFO: Scrape type for NY87258: 2
2026-01-29 06:23:41 [auto1.fr] INFO: Found listing with ID: PM82836
2026-01-29 06:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PM82836%27 HTTP/1.1" 200 None
2026-01-29 06:23:41 [auto1.fr] INFO: Scrape type for PM82836: 0
2026-01-29 06:23:41 [auto1.fr] INFO: Found listing with ID: DJ13412
2026-01-29 06:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DJ13412%27 HTTP/1.1" 200 None
2026-01-29 06:23:41 [auto1.fr] INFO: Scrape type for DJ13412: 2
2026-01-29 06:23:41 [auto1.fr] INFO: Found listing with ID: JV55371
2026-01-29 06:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JV55371%27 HTTP/1.1" 200 None
2026-01-29 06:23:41 [auto1.fr] INFO: Scrape type for JV55371: 2
2026-01-29 06:23:41 [auto1.fr] INFO: Found listing with ID: ZD21574
2026-01-29 06:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZD21574%27 HTTP/1.1" 200 None
2026-01-29 06:23:41 [auto1.fr] INFO: Scrape type for ZD21574: 2
2026-01-29 06:23:41 [auto1.fr] INFO: Found listing with ID: JG18195
2026-01-29 06:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG18195%27 HTTP/1.1" 200 None
2026-01-29 06:23:41 [auto1.fr] INFO: Scrape type for JG18195: 0
2026-01-29 06:23:41 [auto1.fr] INFO: Found listing with ID: HA21419
2026-01-29 06:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HA21419%27 HTTP/1.1" 200 None
2026-01-29 06:23:41 [auto1.fr] INFO: Scrape type for HA21419: 0
2026-01-29 06:23:41 [auto1.fr] INFO: Found listing with ID: NA80241
2026-01-29 06:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NA80241%27 HTTP/1.1" 200 None
2026-01-29 06:23:41 [auto1.fr] INFO: Scrape type for NA80241: 0
2026-01-29 06:23:41 [auto1.fr] INFO: Found listing with ID: FM34234
2026-01-29 06:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FM34234%27 HTTP/1.1" 200 None
2026-01-29 06:23:41 [auto1.fr] INFO: Scrape type for FM34234: 2
2026-01-29 06:23:41 [auto1.fr] INFO: Found listing with ID: YL00082
2026-01-29 06:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YL00082%27 HTTP/1.1" 200 None
2026-01-29 06:23:41 [auto1.fr] INFO: Scrape type for YL00082: 0
2026-01-29 06:23:41 [auto1.fr] INFO: Found listing with ID: ZP55214
2026-01-29 06:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP55214%27 HTTP/1.1" 200 None
2026-01-29 06:23:41 [auto1.fr] INFO: Scrape type for ZP55214: 0
2026-01-29 06:23:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WJ44785/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:23:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:23:44 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 265.259(s), this was the 2nd time calling it.
2026-01-29 06:23:44 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 8.063642149007137 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:23:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EH43016/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:23:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:23:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UL44230/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:23:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:23:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-01-29 06:23:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZP30272> (referer: https://www.auto1.com/v1/car-details-view/ZP30272/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:23:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:23:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 815fd4c6-e9ae-5b56-a0a1-50a9c1aa0e6c with identifier: ZP30272
2026-01-29 06:23:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 815fd4c6-e9ae-5b56-a0a1-50a9c1aa0e6c with scrape type 2
2026-01-29 06:23:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 815fd4c6-e9ae-5b56-a0a1-50a9c1aa0e6c with scrape type 2
2026-01-29 06:23:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 815fd4c6-e9ae-5b56-a0a1-50a9c1aa0e6c, identifier: ZP30272
2026-01-29 06:23:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 815fd4c6-e9ae-5b56-a0a1-50a9c1aa0e6c with identifier: ZP30272
2026-01-29 06:23:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 815fd4c6-e9ae-5b56-a0a1-50a9c1aa0e6c with identifier: ZP30272
2026-01-29 06:23:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 815fd4c6-e9ae-5b56-a0a1-50a9c1aa0e6c with identifier: ZP30272 to the API
2026-01-29 06:23:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:23:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:23:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZP30272>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:26:40Z',
 'fuel_type': 'petrol',
 'id': '815fd4c6-e9ae-5b56-a0a1-50a9c1aa0e6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP30272',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 63144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-01-29 06:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP30272%27 HTTP/1.1" 200 None
2026-01-29 06:23:54 [auto1.fr] INFO: Saving data for ZP30272: {'auction_closing_time': 1769704000.0, 'created_time': 1769533449.861252, 'last_price_update_time': 1769667834.497211}
2026-01-29 06:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZP30272') HTTP/1.1" 204 0
2026-01-29 06:23:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YS02747> (referer: https://www.auto1.com/v1/car-details-view/YS02747/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:23:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:23:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e06efbd-6411-51e8-96e9-156692eff0ec with identifier: YS02747
2026-01-29 06:23:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e06efbd-6411-51e8-96e9-156692eff0ec with scrape type 2
2026-01-29 06:23:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e06efbd-6411-51e8-96e9-156692eff0ec with scrape type 2
2026-01-29 06:23:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3e06efbd-6411-51e8-96e9-156692eff0ec, identifier: YS02747
2026-01-29 06:23:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3e06efbd-6411-51e8-96e9-156692eff0ec with identifier: YS02747
2026-01-29 06:23:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3e06efbd-6411-51e8-96e9-156692eff0ec with identifier: YS02747
2026-01-29 06:23:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 40718, 'odometer_reading_unit': 'km', 'registration_date': '2021-11-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ys02747', 'expiration_date': '2026-01-29t16:00:42z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, nanterre', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '3e06efbd-6411-51e8-96e9-156692eff0ec', 'current_year_diff': 5, 'age_in_months': 50, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 40718}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 50,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:00:42z',
     'fuel_type': 'petrol',
     'id': '3e06efbd-6411-51e8-96e9-156692eff0ec',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ys02747',
     'listing': 'auction',
     'location': 'fr, nanterre',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 40718,
     'odometer_in_km': 40718,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-11-29',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech gt',
     'transmission': 'automatic',
     'trim': 'gt',
     'year': 2021}
2026-01-29 06:23:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 3e06efbd-6411-51e8-96e9-156692eff0ec spider: auto1.fr
2026-01-29 06:23:59 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 3e06efbd-6411-51e8-96e9-156692eff0ec due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 40718, 'odometer_reading_unit': 'km', 'registration_date': '2021-11-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ys02747', 'expiration_date': '2026-01-29t16:00:42z', 'origin_country_code': 'fr', 'trim': 'gt', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, nanterre', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '3e06efbd-6411-51e8-96e9-156692eff0ec', 'current_year_diff': 5, 'age_in_months': 50, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 40718}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 50,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:00:42z',
     'fuel_type': 'petrol',
     'id': '3e06efbd-6411-51e8-96e9-156692eff0ec',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ys02747',
     'listing': 'auction',
     'location': 'fr, nanterre',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 40718,
     'odometer_in_km': 40718,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-11-29',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech gt',
     'transmission': 'automatic',
     'trim': 'gt',
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:00:42Z',
 'fuel_type': 'petrol',
 'id': '3e06efbd-6411-51e8-96e9-156692eff0ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS02747',
 'listing': 'auction',
 'location': 'FR, Nanterre',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 40718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2021}
2026-01-29 06:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS02747%27 HTTP/1.1" 200 None
2026-01-29 06:23:59 [auto1.fr] INFO: Saving data for YS02747: {'auction_closing_time': 1769702442.0, 'created_time': 1769533793.933779, 'last_price_update_time': 1769667839.79858}
2026-01-29 06:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YS02747') HTTP/1.1" 204 0
2026-01-29 06:24:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XL56912> (referer: https://www.auto1.com/v1/car-details-view/XL56912/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:24:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:24:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c38d83b-d544-53f4-8f7a-e17c023eff8d with identifier: XL56912
2026-01-29 06:24:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c38d83b-d544-53f4-8f7a-e17c023eff8d with scrape type 2
2026-01-29 06:24:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c38d83b-d544-53f4-8f7a-e17c023eff8d with scrape type 2
2026-01-29 06:24:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8c38d83b-d544-53f4-8f7a-e17c023eff8d, identifier: XL56912
2026-01-29 06:24:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8c38d83b-d544-53f4-8f7a-e17c023eff8d with identifier: XL56912
2026-01-29 06:24:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8c38d83b-d544-53f4-8f7a-e17c023eff8d with identifier: XL56912
2026-01-29 06:24:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 163180 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    163180
2026-01-29 06:24:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 8c38d83b-d544-53f4-8f7a-e17c023eff8d spider: auto1.fr
2026-01-29 06:24:04 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 8c38d83b-d544-53f4-8f7a-e17c023eff8d due to rule: high_mileage_for_country.json, error: 163180 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    163180
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-01-29T16:33:44Z',
 'fuel_type': 'diesel',
 'id': '8c38d83b-d544-53f4-8f7a-e17c023eff8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL56912',
 'listing': 'auction',
 'location': 'FR, Auxerre',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 163180,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2017}
2026-01-29 06:24:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:24:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XL56912%27 HTTP/1.1" 200 None
2026-01-29 06:24:04 [auto1.fr] INFO: Saving data for XL56912: {'auction_closing_time': 1769704424.0, 'created_time': 1769533517.357323, 'last_price_update_time': 1769667844.045103}
2026-01-29 06:24:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:24:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XL56912') HTTP/1.1" 204 0
2026-01-29 06:24:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BT27170> (referer: https://www.auto1.com/v1/car-details-view/BT27170/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:24:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:24:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b796ba30-8b63-554e-8344-1b17638a8aa3 with identifier: BT27170
2026-01-29 06:24:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b796ba30-8b63-554e-8344-1b17638a8aa3 with scrape type 2
2026-01-29 06:24:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b796ba30-8b63-554e-8344-1b17638a8aa3 with scrape type 2
2026-01-29 06:24:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b796ba30-8b63-554e-8344-1b17638a8aa3, identifier: BT27170
2026-01-29 06:24:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b796ba30-8b63-554e-8344-1b17638a8aa3 with identifier: BT27170
2026-01-29 06:24:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b796ba30-8b63-554e-8344-1b17638a8aa3 with identifier: BT27170
2026-01-29 06:24:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 157291 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157291
2026-01-29 06:24:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b796ba30-8b63-554e-8344-1b17638a8aa3 spider: auto1.fr
2026-01-29 06:24:05 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: b796ba30-8b63-554e-8344-1b17638a8aa3 due to rule: high_mileage_for_country.json, error: 157291 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157291
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 205,
 'expiration_date': '2026-01-29T16:28:19Z',
 'fuel_type': 'diesel',
 'id': 'b796ba30-8b63-554e-8344-1b17638a8aa3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT27170',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 157291,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-01-29 06:24:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:24:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BT27170%27 HTTP/1.1" 200 None
2026-01-29 06:24:05 [auto1.fr] INFO: Saving data for BT27170: {'auction_closing_time': 1769704099.0, 'created_time': 1769493692.338154, 'last_price_update_time': 1769667845.363504}
2026-01-29 06:24:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:24:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BT27170') HTTP/1.1" 204 0
2026-01-29 06:24:07 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.328(s), this was the 1st time calling it.
2026-01-29 06:24:07 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.860724564389544 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:24:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FL30620/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:24:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:24:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XC21641> (referer: https://www.auto1.com/v1/car-details-view/XC21641/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:24:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:24:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a56d0ab-a3db-5e6c-9651-9ecf4946fb60 with identifier: XC21641
2026-01-29 06:24:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a56d0ab-a3db-5e6c-9651-9ecf4946fb60 with scrape type 2
2026-01-29 06:24:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a56d0ab-a3db-5e6c-9651-9ecf4946fb60 with scrape type 2
2026-01-29 06:24:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8a56d0ab-a3db-5e6c-9651-9ecf4946fb60, identifier: XC21641
2026-01-29 06:24:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8a56d0ab-a3db-5e6c-9651-9ecf4946fb60 with identifier: XC21641
2026-01-29 06:24:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8a56d0ab-a3db-5e6c-9651-9ecf4946fb60 with identifier: XC21641
2026-01-29 06:24:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'nissan qashqai 1.2 n-connecta', 'price': 0, 'currency': 'eur', 'make': 'nissan', 'model': 'qashqai', 'transmission': 'automatic', 'odometer': 86589, 'odometer_reading_unit': 'km', 'registration_date': '2018-04-04', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xc21641', 'expiration_date': '2026-01-29t16:03:06z', 'origin_country_code': 'fr', 'trim': 'n-connecta', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 115, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'le mans', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 129, 'id': '8a56d0ab-a3db-5e6c-9651-9ecf4946fb60', 'current_year_diff': 8, 'age_in_months': 93, 'make_model': 'nissan qashqai', 'sanitized_make': 'nissan', 'odometer_in_km': 86589}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 93,
     'auction_title': '',
     'c_o_2_emission_value': 129,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 115,
     'expiration_date': '2026-01-29t16:03:06z',
     'fuel_type': 'petrol',
     'id': '8a56d0ab-a3db-5e6c-9651-9ecf4946fb60',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xc21641',
     'listing': 'auction',
     'location': 'le mans',
     'make': 'nissan',
     'make_model': 'nissan qashqai',
     'model': 'qashqai',
     'odometer': 86589,
     'odometer_in_km': 86589,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-04-04',
     'sanitized_make': 'nissan',
     'seats_number': 5,
     'seller_name': None,
     'title': 'nissan qashqai 1.2 n-connecta',
     'transmission': 'automatic',
     'trim': 'n-connecta',
     'year': 2018}
2026-01-29 06:24:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 8a56d0ab-a3db-5e6c-9651-9ecf4946fb60 spider: auto1.fr
2026-01-29 06:24:11 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 8a56d0ab-a3db-5e6c-9651-9ecf4946fb60 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'nissan qashqai 1.2 n-connecta', 'price': 0, 'currency': 'eur', 'make': 'nissan', 'model': 'qashqai', 'transmission': 'automatic', 'odometer': 86589, 'odometer_reading_unit': 'km', 'registration_date': '2018-04-04', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xc21641', 'expiration_date': '2026-01-29t16:03:06z', 'origin_country_code': 'fr', 'trim': 'n-connecta', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 115, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'le mans', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 129, 'id': '8a56d0ab-a3db-5e6c-9651-9ecf4946fb60', 'current_year_diff': 8, 'age_in_months': 93, 'make_model': 'nissan qashqai', 'sanitized_make': 'nissan', 'odometer_in_km': 86589}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 93,
     'auction_title': '',
     'c_o_2_emission_value': 129,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 115,
     'expiration_date': '2026-01-29t16:03:06z',
     'fuel_type': 'petrol',
     'id': '8a56d0ab-a3db-5e6c-9651-9ecf4946fb60',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xc21641',
     'listing': 'auction',
     'location': 'le mans',
     'make': 'nissan',
     'make_model': 'nissan qashqai',
     'model': 'qashqai',
     'odometer': 86589,
     'odometer_in_km': 86589,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-04-04',
     'sanitized_make': 'nissan',
     'seats_number': 5,
     'seller_name': None,
     'title': 'nissan qashqai 1.2 n-connecta',
     'transmission': 'automatic',
     'trim': 'n-connecta',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:03:06Z',
 'fuel_type': 'petrol',
 'id': '8a56d0ab-a3db-5e6c-9651-9ecf4946fb60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC21641',
 'listing': 'auction',
 'location': 'Le Mans',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 86589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 N-Connecta',
 'transmission': 'automatic',
 'trim': 'N-Connecta',
 'year': 2018}
2026-01-29 06:24:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:24:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XC21641%27 HTTP/1.1" 200 None
2026-01-29 06:24:11 [auto1.fr] INFO: Saving data for XC21641: {'auction_closing_time': 1769702586.0, 'created_time': 1769533947.635335, 'last_price_update_time': 1769667851.996613}
2026-01-29 06:24:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:24:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XC21641') HTTP/1.1" 204 0
2026-01-29 06:24:12 [scrapy.extensions.logstats] INFO: Crawled 1246 pages (at 22 pages/min), scraped 275 items (at 2 items/min)
2026-01-29 06:24:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:24:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ED70326> (referer: https://www.auto1.com/v1/car-details-view/ED70326/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:24:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:24:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b98f539-eb7b-5f5e-8fbf-1c7ff4d0b23a with identifier: ED70326
2026-01-29 06:24:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b98f539-eb7b-5f5e-8fbf-1c7ff4d0b23a with scrape type 2
2026-01-29 06:24:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b98f539-eb7b-5f5e-8fbf-1c7ff4d0b23a with scrape type 2
2026-01-29 06:24:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2b98f539-eb7b-5f5e-8fbf-1c7ff4d0b23a, identifier: ED70326
2026-01-29 06:24:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2b98f539-eb7b-5f5e-8fbf-1c7ff4d0b23a with identifier: ED70326
2026-01-29 06:24:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2b98f539-eb7b-5f5e-8fbf-1c7ff4d0b23a with identifier: ED70326
2026-01-29 06:24:15 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 146454 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    146454
2026-01-29 06:24:15 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 2b98f539-eb7b-5f5e-8fbf-1c7ff4d0b23a spider: auto1.fr
2026-01-29 06:24:15 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 2b98f539-eb7b-5f5e-8fbf-1c7ff4d0b23a due to rule: high_mileage_for_make.json, error: 146454 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    146454
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:49:34Z',
 'fuel_type': 'diesel',
 'id': '2b98f539-eb7b-5f5e-8fbf-1c7ff4d0b23a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED70326',
 'listing': 'auction',
 'location': 'FR, LE HAVRE',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 146454,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2020}
2026-01-29 06:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ED70326%27 HTTP/1.1" 200 None
2026-01-29 06:24:15 [auto1.fr] INFO: Saving data for ED70326: {'auction_closing_time': 1769705374.0, 'created_time': 1768065109.357723, 'last_price_update_time': 1769667855.431615}
2026-01-29 06:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ED70326') HTTP/1.1" 204 0
2026-01-29 06:24:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GF93617/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:24:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:24:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FM34234/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:24:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:24:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WJ44785> (referer: https://www.auto1.com/v1/car-details-view/WJ44785/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:24:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:24:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f52a2b6e-bdb3-5ef5-abcc-da8517e0b905 with identifier: WJ44785
2026-01-29 06:24:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f52a2b6e-bdb3-5ef5-abcc-da8517e0b905 with scrape type 2
2026-01-29 06:24:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f52a2b6e-bdb3-5ef5-abcc-da8517e0b905 with scrape type 2
2026-01-29 06:24:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f52a2b6e-bdb3-5ef5-abcc-da8517e0b905, identifier: WJ44785
2026-01-29 06:24:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f52a2b6e-bdb3-5ef5-abcc-da8517e0b905 with identifier: WJ44785
2026-01-29 06:24:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f52a2b6e-bdb3-5ef5-abcc-da8517e0b905 with identifier: WJ44785
2026-01-29 06:24:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 155283 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    155283
2026-01-29 06:24:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f52a2b6e-bdb3-5ef5-abcc-da8517e0b905 spider: auto1.fr
2026-01-29 06:24:34 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: f52a2b6e-bdb3-5ef5-abcc-da8517e0b905 due to rule: high_mileage_for_country.json, error: 155283 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    155283
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-01-29T16:57:45Z',
 'fuel_type': 'diesel',
 'id': 'f52a2b6e-bdb3-5ef5-abcc-da8517e0b905',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ44785',
 'listing': 'auction',
 'location': 'Fouquières-lès-Lens',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 155283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-11',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Citroen C4 1.6 Blue-HDi Societe Millenium Business',
 'transmission': 'manual',
 'trim': 'Societe Millenium Business',
 'year': 2017}
2026-01-29 06:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WJ44785%27 HTTP/1.1" 200 None
2026-01-29 06:24:34 [auto1.fr] INFO: Saving data for WJ44785: {'auction_closing_time': 1769705865.0, 'created_time': 1769449577.539658, 'last_price_update_time': 1769667874.673106}
2026-01-29 06:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WJ44785') HTTP/1.1" 204 0
2026-01-29 06:24:50 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 267.223(s), this was the 2nd time calling it.
2026-01-29 06:24:50 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.060714806611016 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:24:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-01-29 06:25:10 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 266.999(s), this was the 2nd time calling it.
2026-01-29 06:25:10 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.342010783501753 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:25:12 [scrapy.extensions.logstats] INFO: Crawled 1250 pages (at 4 pages/min), scraped 275 items (at 0 items/min)
2026-01-29 06:25:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-01-29 06:25:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TH80258> (referer: https://www.auto1.com/v1/car-details-view/TH80258/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:25:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:25:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26cf1885-2b14-5260-a6d7-0bc8b64c9b3f with identifier: TH80258
2026-01-29 06:25:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26cf1885-2b14-5260-a6d7-0bc8b64c9b3f with scrape type 2
2026-01-29 06:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26cf1885-2b14-5260-a6d7-0bc8b64c9b3f with scrape type 2
2026-01-29 06:25:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 26cf1885-2b14-5260-a6d7-0bc8b64c9b3f, identifier: TH80258
2026-01-29 06:25:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 26cf1885-2b14-5260-a6d7-0bc8b64c9b3f with identifier: TH80258
2026-01-29 06:25:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 26cf1885-2b14-5260-a6d7-0bc8b64c9b3f with identifier: TH80258
2026-01-29 06:25:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 26cf1885-2b14-5260-a6d7-0bc8b64c9b3f with identifier: TH80258 to the API
2026-01-29 06:25:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:25:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:25:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TH80258>
{'auction_title': '',
 'c_o_2_emission_value': 67,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-01-29T16:51:56Z',
 'fuel_type': 'petrol',
 'id': '26cf1885-2b14-5260-a6d7-0bc8b64c9b3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH80258',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 78600,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 0.9 Energy Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2018}
2026-01-29 06:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TH80258%27 HTTP/1.1" 200 None
2026-01-29 06:25:16 [auto1.fr] INFO: Saving data for TH80258: {'auction_closing_time': 1769705516.0, 'created_time': 1769533791.885588, 'last_price_update_time': 1769667916.663211}
2026-01-29 06:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TH80258') HTTP/1.1" 204 0
2026-01-29 06:25:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JV55371/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:25:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:25:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DJ13412/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:25:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:25:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NY87258/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:25:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:25:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FL30620> (referer: https://www.auto1.com/v1/car-details-view/FL30620/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:25:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:25:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba245db9-74fc-54b2-9928-31a2b2c3dd3a with identifier: FL30620
2026-01-29 06:25:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba245db9-74fc-54b2-9928-31a2b2c3dd3a with scrape type 2
2026-01-29 06:25:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba245db9-74fc-54b2-9928-31a2b2c3dd3a with scrape type 2
2026-01-29 06:25:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ba245db9-74fc-54b2-9928-31a2b2c3dd3a, identifier: FL30620
2026-01-29 06:25:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ba245db9-74fc-54b2-9928-31a2b2c3dd3a with identifier: FL30620
2026-01-29 06:25:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ba245db9-74fc-54b2-9928-31a2b2c3dd3a with identifier: FL30620
2026-01-29 06:25:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ba245db9-74fc-54b2-9928-31a2b2c3dd3a with identifier: FL30620 to the API
2026-01-29 06:25:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:25:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:25:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FL30620>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:44:19Z',
 'fuel_type': 'diesel',
 'id': 'ba245db9-74fc-54b2-9928-31a2b2c3dd3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL30620',
 'listing': 'auction',
 'location': 'FR, Nanteuil-le-Haudouin',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 53147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-01-29 06:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FL30620%27 HTTP/1.1" 200 None
2026-01-29 06:25:42 [auto1.fr] INFO: Saving data for FL30620: {'auction_closing_time': 1769705059.0, 'created_time': 1769534374.968287, 'last_price_update_time': 1769667942.645259}
2026-01-29 06:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FL30620') HTTP/1.1" 204 0
2026-01-29 06:25:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZD21574/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:25:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:25:49 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.407(s), this was the 1st time calling it.
2026-01-29 06:25:49 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.387121599226291 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:25:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:25:57 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.601(s), this was the 1st time calling it.
2026-01-29 06:25:57 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.215425161426933 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:26:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:26:03 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.918(s), this was the 1st time calling it.
2026-01-29 06:26:03 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.945314547897845 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:26:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:26:12 [scrapy.extensions.logstats] INFO: Crawled 1256 pages (at 6 pages/min), scraped 277 items (at 2 items/min)
2026-01-29 06:26:26 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.877(s), this was the 1st time calling it.
2026-01-29 06:26:26 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.799344019451057 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:26:28 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.881(s), this was the 1st time calling it.
2026-01-29 06:26:28 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.130106266840353 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:26:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:26:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:26:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EH43016> (referer: https://www.auto1.com/v1/car-details-view/EH43016/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:26:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:26:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a34d59b-b40d-5f24-8658-0562cd98f1f2 with identifier: EH43016
2026-01-29 06:26:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a34d59b-b40d-5f24-8658-0562cd98f1f2 with scrape type 2
2026-01-29 06:26:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a34d59b-b40d-5f24-8658-0562cd98f1f2 with scrape type 2
2026-01-29 06:26:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0a34d59b-b40d-5f24-8658-0562cd98f1f2, identifier: EH43016
2026-01-29 06:26:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0a34d59b-b40d-5f24-8658-0562cd98f1f2 with identifier: EH43016
2026-01-29 06:26:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0a34d59b-b40d-5f24-8658-0562cd98f1f2 with identifier: EH43016
2026-01-29 06:26:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0a34d59b-b40d-5f24-8658-0562cd98f1f2 with identifier: EH43016 to the API
2026-01-29 06:26:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:26:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:26:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EH43016>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:16:27Z',
 'fuel_type': 'diesel',
 'id': '0a34d59b-b40d-5f24-8658-0562cd98f1f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH43016',
 'listing': 'auction',
 'location': 'FR, \u200bCHEVIGNY-SAINT-SAUVEUR',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 144680,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ateca 1.6 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2017}
2026-01-29 06:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EH43016%27 HTTP/1.1" 200 None
2026-01-29 06:26:49 [auto1.fr] INFO: Saving data for EH43016: {'auction_closing_time': 1769703387.0, 'created_time': 1768064655.51646, 'last_price_update_time': 1769668009.763537}
2026-01-29 06:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EH43016') HTTP/1.1" 204 0
2026-01-29 06:26:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GF93617> (referer: https://www.auto1.com/v1/car-details-view/GF93617/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:26:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:26:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f838f279-c9c8-5409-8215-cc48cce97cb8 with identifier: GF93617
2026-01-29 06:26:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f838f279-c9c8-5409-8215-cc48cce97cb8 with scrape type 2
2026-01-29 06:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f838f279-c9c8-5409-8215-cc48cce97cb8 with scrape type 2
2026-01-29 06:26:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f838f279-c9c8-5409-8215-cc48cce97cb8, identifier: GF93617
2026-01-29 06:26:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f838f279-c9c8-5409-8215-cc48cce97cb8 with identifier: GF93617
2026-01-29 06:26:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f838f279-c9c8-5409-8215-cc48cce97cb8 with identifier: GF93617
2026-01-29 06:26:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f838f279-c9c8-5409-8215-cc48cce97cb8 with identifier: GF93617 to the API
2026-01-29 06:26:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:26:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:26:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GF93617>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:12:35Z',
 'fuel_type': 'petrol',
 'id': 'f838f279-c9c8-5409-8215-cc48cce97cb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF93617',
 'listing': 'auction',
 'location': 'FR, LA CHAPELLE LONGUEVILLE',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 114681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Renegade 1.4 M-Air Limited FWD',
 'transmission': 'manual',
 'trim': 'Limited FWD',
 'year': 2017}
2026-01-29 06:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF93617%27 HTTP/1.1" 200 None
2026-01-29 06:26:59 [auto1.fr] INFO: Saving data for GF93617: {'auction_closing_time': 1769703155.0, 'created_time': 1767373838.005164, 'last_price_update_time': 1769668019.407377}
2026-01-29 06:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GF93617') HTTP/1.1" 204 0
2026-01-29 06:27:05 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 402.391(s), this was the 3rd time calling it.
2026-01-29 06:27:05 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.438076129475647 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:27:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 4th time calling it.
2026-01-29 06:27:12 [scrapy.extensions.logstats] INFO: Crawled 1258 pages (at 2 pages/min), scraped 279 items (at 2 items/min)
2026-01-29 06:27:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GA26468> (referer: https://www.auto1.com/v1/car-details-view/GA26468/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:27:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:27:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a730bb6-1761-55ac-8687-2a727c7c8fc8 with identifier: GA26468
2026-01-29 06:27:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a730bb6-1761-55ac-8687-2a727c7c8fc8 with scrape type 2
2026-01-29 06:27:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a730bb6-1761-55ac-8687-2a727c7c8fc8 with scrape type 2
2026-01-29 06:27:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5a730bb6-1761-55ac-8687-2a727c7c8fc8, identifier: GA26468
2026-01-29 06:27:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5a730bb6-1761-55ac-8687-2a727c7c8fc8 with identifier: GA26468
2026-01-29 06:27:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5a730bb6-1761-55ac-8687-2a727c7c8fc8 with identifier: GA26468
2026-01-29 06:27:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5a730bb6-1761-55ac-8687-2a727c7c8fc8 with identifier: GA26468 to the API
2026-01-29 06:27:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:27:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:27:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GA26468>
{'auction_title': '',
 'c_o_2_emission_value': 35,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 224,
 'expiration_date': '2026-01-29T16:00:27Z',
 'fuel_type': 'hybrid',
 'id': '5a730bb6-1761-55ac-8687-2a727c7c8fc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA26468',
 'listing': 'auction',
 'location': 'FR, Vezin-le-Coquet',
 'make': 'DS Automobiles',
 'model': 'DS9',
 'odometer': 40042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS Automobiles DS9 1.6 E-Tense Hybrid Rivoli +',
 'transmission': 'automatic',
 'trim': 'Rivoli +',
 'year': 2021}
2026-01-29 06:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GA26468%27 HTTP/1.1" 200 None
2026-01-29 06:27:18 [auto1.fr] INFO: Saving data for GA26468: {'auction_closing_time': 1769702427.0, 'created_time': 1769533616.942262, 'last_price_update_time': 1769668038.840973}
2026-01-29 06:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GA26468') HTTP/1.1" 204 0
2026-01-29 06:27:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JG57622/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:27:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:27:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XR36503/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:27:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:27:52 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.274(s), this was the 1st time calling it.
2026-01-29 06:27:52 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.935220181779527 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:27:54 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.652(s), this was the 1st time calling it.
2026-01-29 06:27:54 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.751272833978376 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:27:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:28:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:28:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UB86096/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:28:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:28:06 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 266.622(s), this was the 2nd time calling it.
2026-01-29 06:28:06 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.800760066230616 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:28:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DJ13412> (referer: https://www.auto1.com/v1/car-details-view/DJ13412/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:28:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:28:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c07c4ac0-d7bc-5938-b294-35941531d2f4 with identifier: DJ13412
2026-01-29 06:28:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c07c4ac0-d7bc-5938-b294-35941531d2f4 with scrape type 2
2026-01-29 06:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c07c4ac0-d7bc-5938-b294-35941531d2f4 with scrape type 2
2026-01-29 06:28:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c07c4ac0-d7bc-5938-b294-35941531d2f4, identifier: DJ13412
2026-01-29 06:28:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c07c4ac0-d7bc-5938-b294-35941531d2f4 with identifier: DJ13412
2026-01-29 06:28:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c07c4ac0-d7bc-5938-b294-35941531d2f4 with identifier: DJ13412
2026-01-29 06:28:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c07c4ac0-d7bc-5938-b294-35941531d2f4 with identifier: DJ13412 to the API
2026-01-29 06:28:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:28:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:28:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DJ13412>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:25:40Z',
 'fuel_type': 'diesel',
 'id': 'c07c4ac0-d7bc-5938-b294-35941531d2f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ13412',
 'listing': 'auction',
 'location': 'FR, Villenoy',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 118347,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2019}
2026-01-29 06:28:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:28:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DJ13412%27 HTTP/1.1" 200 None
2026-01-29 06:28:08 [auto1.fr] INFO: Saving data for DJ13412: {'auction_closing_time': 1769703940.0, 'created_time': 1768890021.694598, 'last_price_update_time': 1769668088.047268}
2026-01-29 06:28:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:28:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DJ13412') HTTP/1.1" 204 0
2026-01-29 06:28:12 [scrapy.extensions.logstats] INFO: Crawled 1263 pages (at 5 pages/min), scraped 281 items (at 2 items/min)
2026-01-29 06:28:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-01-29 06:28:12 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 265.769(s), this was the 2nd time calling it.
2026-01-29 06:28:12 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.847681178414153 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:28:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BT54766/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:28:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:28:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NY87258> (referer: https://www.auto1.com/v1/car-details-view/NY87258/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:28:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:28:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f221a03-3d09-5067-87bf-9172aeb1d222 with identifier: NY87258
2026-01-29 06:28:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f221a03-3d09-5067-87bf-9172aeb1d222 with scrape type 2
2026-01-29 06:28:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f221a03-3d09-5067-87bf-9172aeb1d222 with scrape type 2
2026-01-29 06:28:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1f221a03-3d09-5067-87bf-9172aeb1d222, identifier: NY87258
2026-01-29 06:28:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1f221a03-3d09-5067-87bf-9172aeb1d222 with identifier: NY87258
2026-01-29 06:28:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1f221a03-3d09-5067-87bf-9172aeb1d222 with identifier: NY87258
2026-01-29 06:28:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'orange', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c4 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c4', 'transmission': 'automatic', 'odometer': 69808, 'odometer_reading_unit': 'km', 'registration_date': '2022-01-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ny87258', 'expiration_date': '2026-01-29t16:26:13z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'rodez', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 130, 'id': '1f221a03-3d09-5067-87bf-9172aeb1d222', 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'citroen c4', 'sanitized_make': 'citroen', 'odometer_in_km': 69808}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': 130,
     'category': None,
     'color': 'orange',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:26:13z',
     'fuel_type': 'petrol',
     'id': '1f221a03-3d09-5067-87bf-9172aeb1d222',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ny87258',
     'listing': 'auction',
     'location': 'rodez',
     'make': 'citroen',
     'make_model': 'citroen c4',
     'model': 'c4',
     'odometer': 69808,
     'odometer_in_km': 69808,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-01-27',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c4 1.2 puretech shine',
     'transmission': 'automatic',
     'trim': 'shine',
     'year': 2022}
2026-01-29 06:28:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 1f221a03-3d09-5067-87bf-9172aeb1d222 spider: auto1.fr
2026-01-29 06:28:16 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 1f221a03-3d09-5067-87bf-9172aeb1d222 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'orange', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c4 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c4', 'transmission': 'automatic', 'odometer': 69808, 'odometer_reading_unit': 'km', 'registration_date': '2022-01-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ny87258', 'expiration_date': '2026-01-29t16:26:13z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'rodez', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 130, 'id': '1f221a03-3d09-5067-87bf-9172aeb1d222', 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'citroen c4', 'sanitized_make': 'citroen', 'odometer_in_km': 69808}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': 130,
     'category': None,
     'color': 'orange',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:26:13z',
     'fuel_type': 'petrol',
     'id': '1f221a03-3d09-5067-87bf-9172aeb1d222',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ny87258',
     'listing': 'auction',
     'location': 'rodez',
     'make': 'citroen',
     'make_model': 'citroen c4',
     'model': 'c4',
     'odometer': 69808,
     'odometer_in_km': 69808,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-01-27',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c4 1.2 puretech shine',
     'transmission': 'automatic',
     'trim': 'shine',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:26:13Z',
 'fuel_type': 'petrol',
 'id': '1f221a03-3d09-5067-87bf-9172aeb1d222',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY87258',
 'listing': 'auction',
 'location': 'Rodez',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 69808,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 1.2 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2022}
2026-01-29 06:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NY87258%27 HTTP/1.1" 200 None
2026-01-29 06:28:16 [auto1.fr] INFO: Saving data for NY87258: {'auction_closing_time': 1769703973.0, 'created_time': 1768928524.002857, 'last_price_update_time': 1769668096.141464}
2026-01-29 06:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NY87258') HTTP/1.1" 204 0
2026-01-29 06:28:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AV64539/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:28:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:28:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CB42594/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:28:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:28:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZD21574> (referer: https://www.auto1.com/v1/car-details-view/ZD21574/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:28:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:28:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WJ79089/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:28:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:28:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 451fd692-32f1-5887-b45c-62f5848af3a7 with identifier: ZD21574
2026-01-29 06:28:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 451fd692-32f1-5887-b45c-62f5848af3a7 with scrape type 2
2026-01-29 06:28:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 451fd692-32f1-5887-b45c-62f5848af3a7 with scrape type 2
2026-01-29 06:28:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 451fd692-32f1-5887-b45c-62f5848af3a7, identifier: ZD21574
2026-01-29 06:28:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 451fd692-32f1-5887-b45c-62f5848af3a7 with identifier: ZD21574
2026-01-29 06:28:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 451fd692-32f1-5887-b45c-62f5848af3a7 with identifier: ZD21574
2026-01-29 06:28:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 451fd692-32f1-5887-b45c-62f5848af3a7 with identifier: ZD21574 to the API
2026-01-29 06:28:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:28:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:28:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZD21574>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 165,
 'expiration_date': '2026-01-29T16:00:07Z',
 'fuel_type': 'petrol',
 'id': '451fd692-32f1-5887-b45c-62f5848af3a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD21574',
 'listing': 'auction',
 'location': 'FR, Villenoy',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 115346,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 THP GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2017}
2026-01-29 06:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZD21574%27 HTTP/1.1" 200 None
2026-01-29 06:28:18 [auto1.fr] INFO: Saving data for ZD21574: {'auction_closing_time': 1769702407.0, 'created_time': 1769015552.880705, 'last_price_update_time': 1769668098.619664}
2026-01-29 06:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZD21574') HTTP/1.1" 204 0
2026-01-29 06:28:19 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 265.086(s), this was the 2nd time calling it.
2026-01-29 06:28:19 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.621831248024904 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:28:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-01-29 06:28:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AH80283> (referer: https://www.auto1.com/v1/car-details-view/AH80283/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:28:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:28:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4b97162-834d-5e09-8453-4f0e2a521386 with identifier: AH80283
2026-01-29 06:28:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4b97162-834d-5e09-8453-4f0e2a521386 with scrape type 2
2026-01-29 06:28:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4b97162-834d-5e09-8453-4f0e2a521386 with scrape type 2
2026-01-29 06:28:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d4b97162-834d-5e09-8453-4f0e2a521386, identifier: AH80283
2026-01-29 06:28:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d4b97162-834d-5e09-8453-4f0e2a521386 with identifier: AH80283
2026-01-29 06:28:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d4b97162-834d-5e09-8453-4f0e2a521386 with identifier: AH80283
2026-01-29 06:28:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 e-thp feline', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 62316, 'odometer_reading_unit': 'km', 'registration_date': '2017-03-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ah80283', 'expiration_date': '2026-01-29t16:28:40z', 'origin_country_code': 'fr', 'trim': 'feline', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, boulogne-billancourt', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 112, 'id': 'd4b97162-834d-5e09-8453-4f0e2a521386', 'current_year_diff': 9, 'age_in_months': 106, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 62316}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 106,
     'auction_title': '',
     'c_o_2_emission_value': 112,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:28:40z',
     'fuel_type': 'petrol',
     'id': 'd4b97162-834d-5e09-8453-4f0e2a521386',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ah80283',
     'listing': 'auction',
     'location': 'fr, boulogne-billancourt',
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 62316,
     'odometer_in_km': 62316,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-03-27',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 1.2 e-thp feline',
     'transmission': 'automatic',
     'trim': 'feline',
     'year': 2017}
2026-01-29 06:28:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: d4b97162-834d-5e09-8453-4f0e2a521386 spider: auto1.fr
2026-01-29 06:28:21 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: d4b97162-834d-5e09-8453-4f0e2a521386 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 e-thp feline', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 62316, 'odometer_reading_unit': 'km', 'registration_date': '2017-03-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ah80283', 'expiration_date': '2026-01-29t16:28:40z', 'origin_country_code': 'fr', 'trim': 'feline', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, boulogne-billancourt', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 112, 'id': 'd4b97162-834d-5e09-8453-4f0e2a521386', 'current_year_diff': 9, 'age_in_months': 106, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 62316}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 106,
     'auction_title': '',
     'c_o_2_emission_value': 112,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:28:40z',
     'fuel_type': 'petrol',
     'id': 'd4b97162-834d-5e09-8453-4f0e2a521386',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ah80283',
     'listing': 'auction',
     'location': 'fr, boulogne-billancourt',
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 62316,
     'odometer_in_km': 62316,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-03-27',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 1.2 e-thp feline',
     'transmission': 'automatic',
     'trim': 'feline',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:28:40Z',
 'fuel_type': 'petrol',
 'id': 'd4b97162-834d-5e09-8453-4f0e2a521386',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH80283',
 'listing': 'auction',
 'location': 'FR, Boulogne-Billancourt',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 62316,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Feline',
 'transmission': 'automatic',
 'trim': 'Feline',
 'year': 2017}
2026-01-29 06:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AH80283%27 HTTP/1.1" 200 None
2026-01-29 06:28:21 [auto1.fr] INFO: Saving data for AH80283: {'auction_closing_time': 1769704120.0, 'created_time': 1769534068.350088, 'last_price_update_time': 1769668101.156315}
2026-01-29 06:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AH80283') HTTP/1.1" 204 0
2026-01-29 06:28:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XR36503> (referer: https://www.auto1.com/v1/car-details-view/XR36503/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:28:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:28:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94147e88-7b12-5292-854a-c838131b484f with identifier: XR36503
2026-01-29 06:28:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94147e88-7b12-5292-854a-c838131b484f with scrape type 2
2026-01-29 06:28:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94147e88-7b12-5292-854a-c838131b484f with scrape type 2
2026-01-29 06:28:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 94147e88-7b12-5292-854a-c838131b484f, identifier: XR36503
2026-01-29 06:28:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 94147e88-7b12-5292-854a-c838131b484f with identifier: XR36503
2026-01-29 06:28:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 94147e88-7b12-5292-854a-c838131b484f with identifier: XR36503
2026-01-29 06:28:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech urban move', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 55639, 'odometer_reading_unit': 'km', 'registration_date': '2017-12-18', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xr36503', 'expiration_date': '2026-01-29t16:06:53z', 'origin_country_code': 'fr', 'trim': 'urban move', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 68, 'doors_number': 3, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marckolsheim', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 108, 'id': '94147e88-7b12-5292-854a-c838131b484f', 'current_year_diff': 9, 'age_in_months': 97, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 55639}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 97,
     'auction_title': '',
     'c_o_2_emission_value': 108,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 3,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 68,
     'expiration_date': '2026-01-29t16:06:53z',
     'fuel_type': 'petrol',
     'id': '94147e88-7b12-5292-854a-c838131b484f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xr36503',
     'listing': 'auction',
     'location': 'fr, marckolsheim',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 55639,
     'odometer_in_km': 55639,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-12-18',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech urban move',
     'transmission': 'manual',
     'trim': 'urban move',
     'year': 2017}
2026-01-29 06:28:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 94147e88-7b12-5292-854a-c838131b484f spider: auto1.fr
2026-01-29 06:28:22 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 94147e88-7b12-5292-854a-c838131b484f due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech urban move', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 55639, 'odometer_reading_unit': 'km', 'registration_date': '2017-12-18', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xr36503', 'expiration_date': '2026-01-29t16:06:53z', 'origin_country_code': 'fr', 'trim': 'urban move', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 68, 'doors_number': 3, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marckolsheim', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 108, 'id': '94147e88-7b12-5292-854a-c838131b484f', 'current_year_diff': 9, 'age_in_months': 97, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 55639}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 97,
     'auction_title': '',
     'c_o_2_emission_value': 108,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 3,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 68,
     'expiration_date': '2026-01-29t16:06:53z',
     'fuel_type': 'petrol',
     'id': '94147e88-7b12-5292-854a-c838131b484f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xr36503',
     'listing': 'auction',
     'location': 'fr, marckolsheim',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 55639,
     'odometer_in_km': 55639,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-12-18',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech urban move',
     'transmission': 'manual',
     'trim': 'urban move',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 68,
 'expiration_date': '2026-01-29T16:06:53Z',
 'fuel_type': 'petrol',
 'id': '94147e88-7b12-5292-854a-c838131b484f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR36503',
 'listing': 'auction',
 'location': 'FR, Marckolsheim',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 55639,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Urban Move',
 'transmission': 'manual',
 'trim': 'Urban Move',
 'year': 2017}
2026-01-29 06:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XR36503%27 HTTP/1.1" 200 None
2026-01-29 06:28:22 [auto1.fr] INFO: Saving data for XR36503: {'auction_closing_time': 1769702813.0, 'created_time': 1768238840.521562, 'last_price_update_time': 1769668102.798426}
2026-01-29 06:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:28:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XR36503') HTTP/1.1" 204 0
2026-01-29 06:28:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JD17568/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:28:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:28:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-01-29 06:28:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FU48055/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:28:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:28:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JV55371> (referer: https://www.auto1.com/v1/car-details-view/JV55371/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:28:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:28:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f60d3215-071a-5940-b2a5-bc9f74016984 with identifier: JV55371
2026-01-29 06:28:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f60d3215-071a-5940-b2a5-bc9f74016984 with scrape type 2
2026-01-29 06:28:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f60d3215-071a-5940-b2a5-bc9f74016984 with scrape type 2
2026-01-29 06:28:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f60d3215-071a-5940-b2a5-bc9f74016984, identifier: JV55371
2026-01-29 06:28:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f60d3215-071a-5940-b2a5-bc9f74016984 with identifier: JV55371
2026-01-29 06:28:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f60d3215-071a-5940-b2a5-bc9f74016984 with identifier: JV55371
2026-01-29 06:28:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f60d3215-071a-5940-b2a5-bc9f74016984 with identifier: JV55371 to the API
2026-01-29 06:28:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:28:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:28:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JV55371>
{'auction_title': '',
 'c_o_2_emission_value': 49,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 225,
 'expiration_date': '2026-01-29T16:31:29Z',
 'fuel_type': 'hybrid',
 'id': 'f60d3215-071a-5940-b2a5-bc9f74016984',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV55371',
 'listing': 'auction',
 'location': 'FR, Allennes-les-Marais',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 95376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman Cooper S E Hybrid ALL4 Chili',
 'transmission': 'automatic',
 'trim': 'ALL4 Chili',
 'year': 2017}
2026-01-29 06:28:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:28:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JV55371%27 HTTP/1.1" 200 None
2026-01-29 06:28:28 [auto1.fr] INFO: Saving data for JV55371: {'auction_closing_time': 1769704289.0, 'created_time': 1768065224.459942, 'last_price_update_time': 1769668108.744392}
2026-01-29 06:28:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:28:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JV55371') HTTP/1.1" 204 0
2026-01-29 06:28:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BT54766> (referer: https://www.auto1.com/v1/car-details-view/BT54766/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:28:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:28:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69095fde-259f-547a-b9cf-c805fa92b96d with identifier: BT54766
2026-01-29 06:28:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69095fde-259f-547a-b9cf-c805fa92b96d with scrape type 2
2026-01-29 06:28:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69095fde-259f-547a-b9cf-c805fa92b96d with scrape type 2
2026-01-29 06:28:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 69095fde-259f-547a-b9cf-c805fa92b96d, identifier: BT54766
2026-01-29 06:28:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 69095fde-259f-547a-b9cf-c805fa92b96d with identifier: BT54766
2026-01-29 06:28:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 69095fde-259f-547a-b9cf-c805fa92b96d with identifier: BT54766
2026-01-29 06:28:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 153933 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    153933
2026-01-29 06:28:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 69095fde-259f-547a-b9cf-c805fa92b96d spider: auto1.fr
2026-01-29 06:28:41 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 69095fde-259f-547a-b9cf-c805fa92b96d due to rule: high_mileage_for_country.json, error: 153933 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    153933
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:53:57Z',
 'fuel_type': 'petrol',
 'id': '69095fde-259f-547a-b9cf-c805fa92b96d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT54766',
 'listing': 'auction',
 'location': 'FR, Houecourt',
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 153933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Stonic 1.0 TGDI Design',
 'transmission': 'manual',
 'trim': 'Design',
 'year': 2018}
2026-01-29 06:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BT54766%27 HTTP/1.1" 200 None
2026-01-29 06:28:41 [auto1.fr] INFO: Saving data for BT54766: {'auction_closing_time': 1769705637.0, 'created_time': 1769534728.824972, 'last_price_update_time': 1769668121.467843}
2026-01-29 06:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BT54766') HTTP/1.1" 204 0
2026-01-29 06:28:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB21555/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:28:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:28:45 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 267.097(s), this was the 2nd time calling it.
2026-01-29 06:28:45 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.099841796402275 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:28:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-01-29 06:28:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JG57622> (referer: https://www.auto1.com/v1/car-details-view/JG57622/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:28:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:28:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a32d2b22-4759-5813-883a-8d319daad26b with identifier: JG57622
2026-01-29 06:28:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a32d2b22-4759-5813-883a-8d319daad26b with scrape type 2
2026-01-29 06:28:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a32d2b22-4759-5813-883a-8d319daad26b with scrape type 2
2026-01-29 06:28:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a32d2b22-4759-5813-883a-8d319daad26b, identifier: JG57622
2026-01-29 06:28:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a32d2b22-4759-5813-883a-8d319daad26b with identifier: JG57622
2026-01-29 06:28:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a32d2b22-4759-5813-883a-8d319daad26b with identifier: JG57622
2026-01-29 06:28:52 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 97636, 'odometer_reading_unit': 'km', 'registration_date': '2018-01-25', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jg57622', 'expiration_date': '2026-01-29t16:44:39z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, houecourt', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 120, 'id': 'a32d2b22-4759-5813-883a-8d319daad26b', 'current_year_diff': 8, 'age_in_months': 96, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 97636}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 96,
     'auction_title': '',
     'c_o_2_emission_value': 120,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:44:39z',
     'fuel_type': 'petrol',
     'id': 'a32d2b22-4759-5813-883a-8d319daad26b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jg57622',
     'listing': 'auction',
     'location': 'fr, houecourt',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 97636,
     'odometer_in_km': 97636,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-01-25',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 puretech allure',
     'transmission': 'automatic',
     'trim': 'allure',
     'year': 2018}
2026-01-29 06:28:52 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: a32d2b22-4759-5813-883a-8d319daad26b spider: auto1.fr
2026-01-29 06:28:52 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: a32d2b22-4759-5813-883a-8d319daad26b due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 97636, 'odometer_reading_unit': 'km', 'registration_date': '2018-01-25', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jg57622', 'expiration_date': '2026-01-29t16:44:39z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, houecourt', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 120, 'id': 'a32d2b22-4759-5813-883a-8d319daad26b', 'current_year_diff': 8, 'age_in_months': 96, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 97636}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 96,
     'auction_title': '',
     'c_o_2_emission_value': 120,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:44:39z',
     'fuel_type': 'petrol',
     'id': 'a32d2b22-4759-5813-883a-8d319daad26b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/jg57622',
     'listing': 'auction',
     'location': 'fr, houecourt',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 97636,
     'odometer_in_km': 97636,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-01-25',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 puretech allure',
     'transmission': 'automatic',
     'trim': 'allure',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:44:39Z',
 'fuel_type': 'petrol',
 'id': 'a32d2b22-4759-5813-883a-8d319daad26b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG57622',
 'listing': 'auction',
 'location': 'FR, Houecourt',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 97636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2018}
2026-01-29 06:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG57622%27 HTTP/1.1" 200 None
2026-01-29 06:28:52 [auto1.fr] INFO: Saving data for JG57622: {'auction_closing_time': 1769705079.0, 'created_time': 1769534128.190596, 'last_price_update_time': 1769668132.992419}
2026-01-29 06:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JG57622') HTTP/1.1" 204 0
2026-01-29 06:28:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CB42594> (referer: https://www.auto1.com/v1/car-details-view/CB42594/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:28:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:28:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 529ba3f5-ed67-551e-ac41-f266023e4503 with identifier: CB42594
2026-01-29 06:28:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 529ba3f5-ed67-551e-ac41-f266023e4503 with scrape type 2
2026-01-29 06:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 529ba3f5-ed67-551e-ac41-f266023e4503 with scrape type 2
2026-01-29 06:28:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 529ba3f5-ed67-551e-ac41-f266023e4503, identifier: CB42594
2026-01-29 06:28:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 529ba3f5-ed67-551e-ac41-f266023e4503 with identifier: CB42594
2026-01-29 06:28:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 529ba3f5-ed67-551e-ac41-f266023e4503 with identifier: CB42594
2026-01-29 06:28:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'automatic', 'odometer': 59116, 'odometer_reading_unit': 'km', 'registration_date': '2023-05-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cb42594', 'expiration_date': '2026-01-29t16:37:03z', 'origin_country_code': 'fr', 'trim': 'elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, montigny-le-bretonneux', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '529ba3f5-ed67-551e-ac41-f266023e4503', 'current_year_diff': 3, 'age_in_months': 32, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 59116}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 32,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:37:03z',
     'fuel_type': 'petrol',
     'id': '529ba3f5-ed67-551e-ac41-f266023e4503',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cb42594',
     'listing': 'auction',
     'location': 'fr, montigny-le-bretonneux',
     'make': 'opel',
     'make_model': 'opel crossland x',
     'model': 'crossland x',
     'odometer': 59116,
     'odometer_in_km': 59116,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-05-29',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel crossland x 1.2 turbo elegance',
     'transmission': 'automatic',
     'trim': 'elegance',
     'year': 2023}
2026-01-29 06:28:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 529ba3f5-ed67-551e-ac41-f266023e4503 spider: auto1.fr
2026-01-29 06:28:56 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 529ba3f5-ed67-551e-ac41-f266023e4503 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'opel crossland x 1.2 turbo elegance', 'price': 0, 'currency': 'eur', 'make': 'opel', 'model': 'crossland x', 'transmission': 'automatic', 'odometer': 59116, 'odometer_reading_unit': 'km', 'registration_date': '2023-05-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cb42594', 'expiration_date': '2026-01-29t16:37:03z', 'origin_country_code': 'fr', 'trim': 'elegance', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, montigny-le-bretonneux', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '529ba3f5-ed67-551e-ac41-f266023e4503', 'current_year_diff': 3, 'age_in_months': 32, 'make_model': 'opel crossland x', 'sanitized_make': 'opel', 'odometer_in_km': 59116}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 32,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:37:03z',
     'fuel_type': 'petrol',
     'id': '529ba3f5-ed67-551e-ac41-f266023e4503',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cb42594',
     'listing': 'auction',
     'location': 'fr, montigny-le-bretonneux',
     'make': 'opel',
     'make_model': 'opel crossland x',
     'model': 'crossland x',
     'odometer': 59116,
     'odometer_in_km': 59116,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-05-29',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel crossland x 1.2 turbo elegance',
     'transmission': 'automatic',
     'trim': 'elegance',
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:37:03Z',
 'fuel_type': 'petrol',
 'id': '529ba3f5-ed67-551e-ac41-f266023e4503',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB42594',
 'listing': 'auction',
 'location': 'FR, MONTIGNY-LE-BRETONNEUX',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 59116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-05-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2023}
2026-01-29 06:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CB42594%27 HTTP/1.1" 200 None
2026-01-29 06:28:56 [auto1.fr] INFO: Saving data for CB42594: {'auction_closing_time': 1769704623.0, 'created_time': 1769449551.212144, 'last_price_update_time': 1769668136.17094}
2026-01-29 06:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CB42594') HTTP/1.1" 204 0
2026-01-29 06:29:08 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.312(s), this was the 1st time calling it.
2026-01-29 06:29:08 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.1048749740501975 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:29:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XK43933/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:29:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:29:12 [scrapy.extensions.logstats] INFO: Crawled 1279 pages (at 16 pages/min), scraped 283 items (at 2 items/min)
2026-01-29 06:29:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MY19591/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:29:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:29:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:29:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FM34234> (referer: https://www.auto1.com/v1/car-details-view/FM34234/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:29:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:29:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e8fca7e-25c3-56b2-9cba-23316b4e3389 with identifier: FM34234
2026-01-29 06:29:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e8fca7e-25c3-56b2-9cba-23316b4e3389 with scrape type 2
2026-01-29 06:29:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e8fca7e-25c3-56b2-9cba-23316b4e3389 with scrape type 2
2026-01-29 06:29:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0e8fca7e-25c3-56b2-9cba-23316b4e3389, identifier: FM34234
2026-01-29 06:29:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0e8fca7e-25c3-56b2-9cba-23316b4e3389 with identifier: FM34234
2026-01-29 06:29:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0e8fca7e-25c3-56b2-9cba-23316b4e3389 with identifier: FM34234
2026-01-29 06:29:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'sprinter' containing 'sprinter'
2026-01-29 06:29:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 0e8fca7e-25c3-56b2-9cba-23316b4e3389 spider: auto1.fr
2026-01-29 06:29:16 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 0e8fca7e-25c3-56b2-9cba-23316b4e3389 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'sprinter' containing 'sprinter'
{'auction_title': '',
 'c_o_2_emission_value': 241,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 114,
 'expiration_date': '2026-01-29T16:11:44Z',
 'fuel_type': 'diesel',
 'id': '0e8fca7e-25c3-56b2-9cba-23316b4e3389',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM34234',
 'listing': 'auction',
 'location': 'FR, Peyrolles-en-Provence',
 'make': 'Mercedes-Benz',
 'model': 'Sprinter',
 'odometer': 66644,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-18',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Mercedes-Benz Sprinter 311 CDI RWD L2',
 'transmission': 'manual',
 'trim': 'RWD L2',
 'year': 2020}
2026-01-29 06:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FM34234%27 HTTP/1.1" 200 None
2026-01-29 06:29:16 [auto1.fr] INFO: Saving data for FM34234: {'auction_closing_time': 1769703104.0, 'created_time': 1769187954.462984, 'last_price_update_time': 1769668156.883864}
2026-01-29 06:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FM34234') HTTP/1.1" 204 0
2026-01-29 06:29:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UL44230> (referer: https://www.auto1.com/v1/car-details-view/UL44230/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:29:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:29:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b0368db-aec8-5b40-af6a-91d77138d5ec with identifier: UL44230
2026-01-29 06:29:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b0368db-aec8-5b40-af6a-91d77138d5ec with scrape type 2
2026-01-29 06:29:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b0368db-aec8-5b40-af6a-91d77138d5ec with scrape type 2
2026-01-29 06:29:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7b0368db-aec8-5b40-af6a-91d77138d5ec, identifier: UL44230
2026-01-29 06:29:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7b0368db-aec8-5b40-af6a-91d77138d5ec with identifier: UL44230
2026-01-29 06:29:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7b0368db-aec8-5b40-af6a-91d77138d5ec with identifier: UL44230
2026-01-29 06:29:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech active pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 21885, 'odometer_reading_unit': 'km', 'registration_date': '2022-11-21', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ul44230', 'expiration_date': '2026-01-29t16:50:54z', 'origin_country_code': 'fr', 'trim': 'active pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 119, 'id': '7b0368db-aec8-5b40-af6a-91d77138d5ec', 'current_year_diff': 4, 'age_in_months': 38, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 21885}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 38,
     'auction_title': '',
     'c_o_2_emission_value': 119,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 75,
     'expiration_date': '2026-01-29t16:50:54z',
     'fuel_type': 'petrol',
     'id': '7b0368db-aec8-5b40-af6a-91d77138d5ec',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ul44230',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 21885,
     'odometer_in_km': 21885,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-11-21',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech active pack',
     'transmission': 'manual',
     'trim': 'active pack',
     'year': 2022}
2026-01-29 06:29:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 7b0368db-aec8-5b40-af6a-91d77138d5ec spider: auto1.fr
2026-01-29 06:29:57 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 7b0368db-aec8-5b40-af6a-91d77138d5ec due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech active pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 21885, 'odometer_reading_unit': 'km', 'registration_date': '2022-11-21', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ul44230', 'expiration_date': '2026-01-29t16:50:54z', 'origin_country_code': 'fr', 'trim': 'active pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, loyettes', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 119, 'id': '7b0368db-aec8-5b40-af6a-91d77138d5ec', 'current_year_diff': 4, 'age_in_months': 38, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 21885}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 38,
     'auction_title': '',
     'c_o_2_emission_value': 119,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 75,
     'expiration_date': '2026-01-29t16:50:54z',
     'fuel_type': 'petrol',
     'id': '7b0368db-aec8-5b40-af6a-91d77138d5ec',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ul44230',
     'listing': 'auction',
     'location': 'fr, loyettes',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 21885,
     'odometer_in_km': 21885,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-11-21',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech active pack',
     'transmission': 'manual',
     'trim': 'active pack',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:50:54Z',
 'fuel_type': 'petrol',
 'id': '7b0368db-aec8-5b40-af6a-91d77138d5ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL44230',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 21885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Active Pack',
 'transmission': 'manual',
 'trim': 'Active Pack',
 'year': 2022}
2026-01-29 06:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL44230%27 HTTP/1.1" 200 None
2026-01-29 06:29:57 [auto1.fr] INFO: Saving data for UL44230: {'auction_closing_time': 1769705454.0, 'created_time': 1769015741.147367, 'last_price_update_time': 1769668197.343461}
2026-01-29 06:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UL44230') HTTP/1.1" 204 0
2026-01-29 06:30:12 [scrapy.extensions.logstats] INFO: Crawled 1282 pages (at 3 pages/min), scraped 283 items (at 0 items/min)
2026-01-29 06:30:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VE62610/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:30:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:30:28 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.583(s), this was the 1st time calling it.
2026-01-29 06:30:28 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.054968054093664 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:30:32 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.791(s), this was the 1st time calling it.
2026-01-29 06:30:32 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.338029662564291 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:30:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:30:34 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.624(s), this was the 1st time calling it.
2026-01-29 06:30:34 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.548278952658524 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:30:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:30:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:30:50 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.545(s), this was the 1st time calling it.
2026-01-29 06:30:50 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.971387045720869 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:30:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:30:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AV64539> (referer: https://www.auto1.com/v1/car-details-view/AV64539/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:30:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:30:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae19a88b-1cff-565a-9fdc-ea454ee10717 with identifier: AV64539
2026-01-29 06:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae19a88b-1cff-565a-9fdc-ea454ee10717 with scrape type 2
2026-01-29 06:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae19a88b-1cff-565a-9fdc-ea454ee10717 with scrape type 2
2026-01-29 06:30:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ae19a88b-1cff-565a-9fdc-ea454ee10717, identifier: AV64539
2026-01-29 06:30:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ae19a88b-1cff-565a-9fdc-ea454ee10717 with identifier: AV64539
2026-01-29 06:30:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ae19a88b-1cff-565a-9fdc-ea454ee10717 with identifier: AV64539
2026-01-29 06:30:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ae19a88b-1cff-565a-9fdc-ea454ee10717 with identifier: AV64539 to the API
2026-01-29 06:30:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:30:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:30:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AV64539>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 160,
 'expiration_date': '2026-01-29T16:13:48Z',
 'fuel_type': 'diesel',
 'id': 'ae19a88b-1cff-565a-9fdc-ea454ee10717',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV64539',
 'listing': 'auction',
 'location': 'FR, Villenoy',
 'make': 'Renault',
 'model': 'Talisman',
 'odometer': 122824,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Talisman 1.6 dCi Energy Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2017}
2026-01-29 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV64539%27 HTTP/1.1" 200 None
2026-01-29 06:30:57 [auto1.fr] INFO: Saving data for AV64539: {'auction_closing_time': 1769703228.0, 'created_time': 1768842486.100579, 'last_price_update_time': 1769668257.550407}
2026-01-29 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AV64539') HTTP/1.1" 204 0
2026-01-29 06:31:06 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.196(s), this was the 1st time calling it.
2026-01-29 06:31:06 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.514686524679229 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:31:12 [scrapy.extensions.logstats] INFO: Crawled 1284 pages (at 2 pages/min), scraped 284 items (at 1 items/min)
2026-01-29 06:31:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:31:27 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.959(s), this was the 1st time calling it.
2026-01-29 06:31:27 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.1711159104736835 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:31:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JD17568> (referer: https://www.auto1.com/v1/car-details-view/JD17568/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:31:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb262317-3953-5ebf-b6a1-6736f39181bc with identifier: JD17568
2026-01-29 06:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb262317-3953-5ebf-b6a1-6736f39181bc with scrape type 2
2026-01-29 06:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb262317-3953-5ebf-b6a1-6736f39181bc with scrape type 2
2026-01-29 06:31:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: eb262317-3953-5ebf-b6a1-6736f39181bc, identifier: JD17568
2026-01-29 06:31:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: eb262317-3953-5ebf-b6a1-6736f39181bc with identifier: JD17568
2026-01-29 06:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: eb262317-3953-5ebf-b6a1-6736f39181bc with identifier: JD17568
2026-01-29 06:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 155311 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    155311
2026-01-29 06:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: eb262317-3953-5ebf-b6a1-6736f39181bc spider: auto1.fr
2026-01-29 06:31:33 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: eb262317-3953-5ebf-b6a1-6736f39181bc due to rule: high_mileage_for_country.json, error: 155311 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    155311
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 194,
 'expiration_date': '2026-01-29T16:18:40Z',
 'fuel_type': 'diesel',
 'id': 'eb262317-3953-5ebf-b6a1-6736f39181bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD17568',
 'listing': 'auction',
 'location': 'FR, Biarritz',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 155311,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic Launch Edition AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic Launch Edition AMG Line',
 'year': 2019}
2026-01-29 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD17568%27 HTTP/1.1" 200 None
2026-01-29 06:31:33 [auto1.fr] INFO: Saving data for JD17568: {'auction_closing_time': 1769703520.0, 'created_time': 1769534686.265675, 'last_price_update_time': 1769668293.270529}
2026-01-29 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JD17568') HTTP/1.1" 204 0
2026-01-29 06:32:06 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.410(s), this was the 1st time calling it.
2026-01-29 06:32:06 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.121567001530821 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:32:12 [scrapy.extensions.logstats] INFO: Crawled 1285 pages (at 1 pages/min), scraped 284 items (at 0 items/min)
2026-01-29 06:32:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WJ79089> (referer: https://www.auto1.com/v1/car-details-view/WJ79089/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:32:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:32:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 008d0f82-6910-5161-ba8f-5212d50d457b with identifier: WJ79089
2026-01-29 06:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 008d0f82-6910-5161-ba8f-5212d50d457b with scrape type 2
2026-01-29 06:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 008d0f82-6910-5161-ba8f-5212d50d457b with scrape type 2
2026-01-29 06:32:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 008d0f82-6910-5161-ba8f-5212d50d457b, identifier: WJ79089
2026-01-29 06:32:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 008d0f82-6910-5161-ba8f-5212d50d457b with identifier: WJ79089
2026-01-29 06:32:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 008d0f82-6910-5161-ba8f-5212d50d457b with identifier: WJ79089
2026-01-29 06:32:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 008d0f82-6910-5161-ba8f-5212d50d457b with identifier: WJ79089 to the API
2026-01-29 06:32:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:32:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:32:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WJ79089>
{'auction_title': '',
 'c_o_2_emission_value': 34,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 218,
 'expiration_date': '2026-01-29T16:00:49Z',
 'fuel_type': 'hybrid',
 'id': '008d0f82-6910-5161-ba8f-5212d50d457b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ79089',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 104115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 250e AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-01-29 06:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WJ79089%27 HTTP/1.1" 200 None
2026-01-29 06:32:21 [auto1.fr] INFO: Saving data for WJ79089: {'auction_closing_time': 1769702449.0, 'created_time': 1767632642.460314, 'last_price_update_time': 1769668341.214976}
2026-01-29 06:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WJ79089') HTTP/1.1" 204 0
2026-01-29 06:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FU48055> (referer: https://www.auto1.com/v1/car-details-view/FU48055/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:32:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:32:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3248f77-6599-5642-a90e-e78fe3bceed0 with identifier: FU48055
2026-01-29 06:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3248f77-6599-5642-a90e-e78fe3bceed0 with scrape type 2
2026-01-29 06:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3248f77-6599-5642-a90e-e78fe3bceed0 with scrape type 2
2026-01-29 06:32:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a3248f77-6599-5642-a90e-e78fe3bceed0, identifier: FU48055
2026-01-29 06:32:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a3248f77-6599-5642-a90e-e78fe3bceed0 with identifier: FU48055
2026-01-29 06:32:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a3248f77-6599-5642-a90e-e78fe3bceed0 with identifier: FU48055
2026-01-29 06:32:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 e-thp allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'manual', 'odometer': 75989, 'odometer_reading_unit': 'km', 'registration_date': '2017-12-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fu48055', 'expiration_date': '2026-01-29t16:10:44z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, tarnos', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 99, 'id': 'a3248f77-6599-5642-a90e-e78fe3bceed0', 'current_year_diff': 9, 'age_in_months': 97, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 75989}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 97,
     'auction_title': '',
     'c_o_2_emission_value': 99,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:10:44z',
     'fuel_type': 'petrol',
     'id': 'a3248f77-6599-5642-a90e-e78fe3bceed0',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fu48055',
     'listing': 'auction',
     'location': 'fr, tarnos',
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 75989,
     'odometer_in_km': 75989,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-12-27',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 1.2 e-thp allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2017}
2026-01-29 06:32:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: a3248f77-6599-5642-a90e-e78fe3bceed0 spider: auto1.fr
2026-01-29 06:32:23 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: a3248f77-6599-5642-a90e-e78fe3bceed0 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 e-thp allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'manual', 'odometer': 75989, 'odometer_reading_unit': 'km', 'registration_date': '2017-12-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fu48055', 'expiration_date': '2026-01-29t16:10:44z', 'origin_country_code': 'fr', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, tarnos', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 99, 'id': 'a3248f77-6599-5642-a90e-e78fe3bceed0', 'current_year_diff': 9, 'age_in_months': 97, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 75989}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 97,
     'auction_title': '',
     'c_o_2_emission_value': 99,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:10:44z',
     'fuel_type': 'petrol',
     'id': 'a3248f77-6599-5642-a90e-e78fe3bceed0',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fu48055',
     'listing': 'auction',
     'location': 'fr, tarnos',
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 75989,
     'odometer_in_km': 75989,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-12-27',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 1.2 e-thp allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:10:44Z',
 'fuel_type': 'petrol',
 'id': 'a3248f77-6599-5642-a90e-e78fe3bceed0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU48055',
 'listing': 'auction',
 'location': 'FR, TARNOS',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 75989,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2017}
2026-01-29 06:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FU48055%27 HTTP/1.1" 200 None
2026-01-29 06:32:23 [auto1.fr] INFO: Saving data for FU48055: {'auction_closing_time': 1769703044.0, 'created_time': 1769534001.002819, 'last_price_update_time': 1769668343.877421}
2026-01-29 06:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FU48055') HTTP/1.1" 204 0
2026-01-29 06:32:30 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.248(s), this was the 1st time calling it.
2026-01-29 06:32:30 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.410634549957805 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:32:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:32:45 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 267.795(s), this was the 2nd time calling it.
2026-01-29 06:32:45 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.844041513191467 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:32:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NK01367/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:32:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:32:47 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 264.959(s), this was the 2nd time calling it.
2026-01-29 06:32:47 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 8.480424384279384 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:32:47 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 263.745(s), this was the 2nd time calling it.
2026-01-29 06:32:47 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.145879833485001 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:32:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-01-29 06:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XK43933> (referer: https://www.auto1.com/v1/car-details-view/XK43933/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:32:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:32:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a4c2335-0a12-5018-9a0d-4d72d6b01805 with identifier: XK43933
2026-01-29 06:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a4c2335-0a12-5018-9a0d-4d72d6b01805 with scrape type 2
2026-01-29 06:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a4c2335-0a12-5018-9a0d-4d72d6b01805 with scrape type 2
2026-01-29 06:32:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1a4c2335-0a12-5018-9a0d-4d72d6b01805, identifier: XK43933
2026-01-29 06:32:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1a4c2335-0a12-5018-9a0d-4d72d6b01805 with identifier: XK43933
2026-01-29 06:32:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1a4c2335-0a12-5018-9a0d-4d72d6b01805 with identifier: XK43933
2026-01-29 06:32:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1a4c2335-0a12-5018-9a0d-4d72d6b01805 with identifier: XK43933 to the API
2026-01-29 06:32:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:32:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:32:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XK43933>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 143,
 'expiration_date': '2026-01-29T16:37:53Z',
 'fuel_type': 'hybrid',
 'id': '1a4c2335-0a12-5018-9a0d-4d72d6b01805',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK43933',
 'listing': 'auction',
 'location': 'FR, Marly-la-ville',
 'make': 'Renault',
 'model': 'Arkana',
 'odometer': 79689,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-09-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Arkana 1.6 Hybrid E-Tech Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2021}
2026-01-29 06:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XK43933%27 HTTP/1.1" 200 None
2026-01-29 06:32:53 [auto1.fr] INFO: Saving data for XK43933: {'auction_closing_time': 1769704673.0, 'created_time': 1769580109.25366, 'last_price_update_time': 1769668373.04399}
2026-01-29 06:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XK43933') HTTP/1.1" 204 0
2026-01-29 06:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:32:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:32:54 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: ZP55214
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP55214%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for ZP55214: 0
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: MD84258
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MD84258%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for MD84258: 0
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: VE14391
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VE14391%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for VE14391: 2
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: FB97001
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB97001%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for FB97001: 2
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: RX40882
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RX40882%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for RX40882: 0
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: EW10494
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW10494%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for EW10494: 0
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: CG21798
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CG21798%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for CG21798: 2
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: VD30513
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VD30513%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for VD30513: 0
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: SS57670
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SS57670%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for SS57670: 2
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: ZC47136
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZC47136%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for ZC47136: 2
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: ZZ72888
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZZ72888%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for ZZ72888: 0
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: YU87702
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YU87702%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for YU87702: 2
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: HN66278
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HN66278%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for HN66278: 2
2026-01-29 06:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MB50785/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: UL51467
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL51467%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for UL51467: 2
2026-01-29 06:32:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: GS64176
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GS64176%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for GS64176: 2
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: RN56338
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RN56338%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for RN56338: 0
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: ZK79374
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZK79374%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for ZK79374: 0
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: UE75229
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UE75229%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for UE75229: 0
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: EM50157
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EM50157%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for EM50157: 0
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: WV21754
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WV21754%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for WV21754: 0
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: YV95495
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YV95495%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for YV95495: 0
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: WH02356
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WH02356%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for WH02356: 0
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: DP78401
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DP78401%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for DP78401: 0
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: SD36042
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SD36042%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for SD36042: 0
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: VZ97126
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VZ97126%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for VZ97126: 0
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: CZ72850
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CZ72850%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for CZ72850: 0
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: LM98221
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LM98221%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for LM98221: 0
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: PB86157
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PB86157%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for PB86157: 0
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: ED45724
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ED45724%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for ED45724: 0
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: TX31836
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TX31836%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for TX31836: 0
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: WC17201
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WC17201%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for WC17201: 0
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: SZ92729
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SZ92729%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for SZ92729: 0
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: EM39114
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EM39114%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for EM39114: 0
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: FB75908
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB75908%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for FB75908: 0
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: JC19185
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JC19185%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for JC19185: 0
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: TD37160
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TD37160%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for TD37160: 0
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: PV07284
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PV07284%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for PV07284: 0
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: NZ83514
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NZ83514%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for NZ83514: 0
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: VD57038
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VD57038%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for VD57038: 0
2026-01-29 06:32:54 [auto1.fr] INFO: Found listing with ID: PE21846
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PE21846%27 HTTP/1.1" 200 None
2026-01-29 06:32:54 [auto1.fr] INFO: Scrape type for PE21846: 0
2026-01-29 06:32:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-01-29 06:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VE62610> (referer: https://www.auto1.com/v1/car-details-view/VE62610/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:32:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:32:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aee8e83e-2ba6-525e-a30e-ed9a044004e0 with identifier: VE62610
2026-01-29 06:32:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aee8e83e-2ba6-525e-a30e-ed9a044004e0 with scrape type 2
2026-01-29 06:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aee8e83e-2ba6-525e-a30e-ed9a044004e0 with scrape type 2
2026-01-29 06:32:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: aee8e83e-2ba6-525e-a30e-ed9a044004e0, identifier: VE62610
2026-01-29 06:32:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: aee8e83e-2ba6-525e-a30e-ed9a044004e0 with identifier: VE62610
2026-01-29 06:32:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: aee8e83e-2ba6-525e-a30e-ed9a044004e0 with identifier: VE62610
2026-01-29 06:32:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: aee8e83e-2ba6-525e-a30e-ed9a044004e0 with identifier: VE62610 to the API
2026-01-29 06:32:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:32:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:32:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VE62610>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:47:23Z',
 'fuel_type': 'petrol',
 'id': 'aee8e83e-2ba6-525e-a30e-ed9a044004e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE62610',
 'listing': 'auction',
 'location': 'FR, Saint-Maximin',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 94886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 35 TFSI Mild-Hybrid ACT advanced',
 'transmission': 'automatic',
 'trim': 'ACT advanced',
 'year': 2019}
2026-01-29 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VE62610%27 HTTP/1.1" 200 None
2026-01-29 06:32:55 [auto1.fr] INFO: Saving data for VE62610: {'auction_closing_time': 1769705243.0, 'created_time': 1769534684.613717, 'last_price_update_time': 1769668375.925954}
2026-01-29 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VE62610') HTTP/1.1" 204 0
2026-01-29 06:32:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-01-29 06:33:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NK01367> (referer: https://www.auto1.com/v1/car-details-view/NK01367/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:33:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:33:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2050ea3-9a93-5210-befb-9b442dea3d7a with identifier: NK01367
2026-01-29 06:33:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2050ea3-9a93-5210-befb-9b442dea3d7a with scrape type 2
2026-01-29 06:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2050ea3-9a93-5210-befb-9b442dea3d7a with scrape type 2
2026-01-29 06:33:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b2050ea3-9a93-5210-befb-9b442dea3d7a, identifier: NK01367
2026-01-29 06:33:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b2050ea3-9a93-5210-befb-9b442dea3d7a with identifier: NK01367
2026-01-29 06:33:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b2050ea3-9a93-5210-befb-9b442dea3d7a with identifier: NK01367
2026-01-29 06:33:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech active', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 96890, 'odometer_reading_unit': 'km', 'registration_date': '2020-02-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nk01367', 'expiration_date': '2026-01-29t16:04:34z', 'origin_country_code': 'fr', 'trim': 'active', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 102, 'id': 'b2050ea3-9a93-5210-befb-9b442dea3d7a', 'current_year_diff': 6, 'age_in_months': 71, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 96890}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 71,
     'auction_title': '',
     'c_o_2_emission_value': 102,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:04:34z',
     'fuel_type': 'petrol',
     'id': 'b2050ea3-9a93-5210-befb-9b442dea3d7a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nk01367',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 96890,
     'odometer_in_km': 96890,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-02-27',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech active',
     'transmission': 'manual',
     'trim': 'active',
     'year': 2020}
2026-01-29 06:33:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: b2050ea3-9a93-5210-befb-9b442dea3d7a spider: auto1.fr
2026-01-29 06:33:02 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: b2050ea3-9a93-5210-befb-9b442dea3d7a due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech active', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 96890, 'odometer_reading_unit': 'km', 'registration_date': '2020-02-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nk01367', 'expiration_date': '2026-01-29t16:04:34z', 'origin_country_code': 'fr', 'trim': 'active', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 102, 'id': 'b2050ea3-9a93-5210-befb-9b442dea3d7a', 'current_year_diff': 6, 'age_in_months': 71, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 96890}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 71,
     'auction_title': '',
     'c_o_2_emission_value': 102,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:04:34z',
     'fuel_type': 'petrol',
     'id': 'b2050ea3-9a93-5210-befb-9b442dea3d7a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nk01367',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 96890,
     'odometer_in_km': 96890,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-02-27',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech active',
     'transmission': 'manual',
     'trim': 'active',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:04:34Z',
 'fuel_type': 'petrol',
 'id': 'b2050ea3-9a93-5210-befb-9b442dea3d7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK01367',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 96890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2020}
2026-01-29 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK01367%27 HTTP/1.1" 200 None
2026-01-29 06:33:02 [auto1.fr] INFO: Saving data for NK01367: {'auction_closing_time': 1769702674.0, 'created_time': 1768896066.625641, 'last_price_update_time': 1769668382.534044}
2026-01-29 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NK01367') HTTP/1.1" 204 0
2026-01-29 06:33:07 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.764(s), this was the 1st time calling it.
2026-01-29 06:33:07 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.575392330813873 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:33:12 [scrapy.extensions.logstats] INFO: Crawled 1293 pages (at 8 pages/min), scraped 287 items (at 3 items/min)
2026-01-29 06:33:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SC26887/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:33:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:33:42 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.728(s), this was the 1st time calling it.
2026-01-29 06:33:42 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.56153831609546 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:33:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB21555> (referer: https://www.auto1.com/v1/car-details-view/JB21555/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:33:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:33:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01ffc8c5-e4b0-5c36-ac0f-d5e445c5bad6 with identifier: JB21555
2026-01-29 06:33:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01ffc8c5-e4b0-5c36-ac0f-d5e445c5bad6 with scrape type 2
2026-01-29 06:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01ffc8c5-e4b0-5c36-ac0f-d5e445c5bad6 with scrape type 2
2026-01-29 06:33:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 01ffc8c5-e4b0-5c36-ac0f-d5e445c5bad6, identifier: JB21555
2026-01-29 06:33:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 01ffc8c5-e4b0-5c36-ac0f-d5e445c5bad6 with identifier: JB21555
2026-01-29 06:33:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 01ffc8c5-e4b0-5c36-ac0f-d5e445c5bad6 with identifier: JB21555
2026-01-29 06:33:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 01ffc8c5-e4b0-5c36-ac0f-d5e445c5bad6 with identifier: JB21555 to the API
2026-01-29 06:33:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:33:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:33:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JB21555>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:41:59Z',
 'fuel_type': 'diesel',
 'id': '01ffc8c5-e4b0-5c36-ac0f-d5e445c5bad6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB21555',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 71840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-09',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Ford Grand C-Max 1.5 TDCi Trend',
 'transmission': 'automatic',
 'trim': 'Trend',
 'year': 2019}
2026-01-29 06:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JB21555%27 HTTP/1.1" 200 None
2026-01-29 06:33:52 [auto1.fr] INFO: Saving data for JB21555: {'auction_closing_time': 1769704919.0, 'created_time': 1769068865.323741, 'last_price_update_time': 1769668432.06898}
2026-01-29 06:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JB21555') HTTP/1.1" 204 0
2026-01-29 06:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:34:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:34:00 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:34:00 [auto1.fr] INFO: Found listing with ID: PP60675
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PP60675%27 HTTP/1.1" 200 None
2026-01-29 06:34:00 [auto1.fr] INFO: Scrape type for PP60675: 0
2026-01-29 06:34:00 [auto1.fr] INFO: Found listing with ID: EY24204
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EY24204%27 HTTP/1.1" 200 None
2026-01-29 06:34:00 [auto1.fr] INFO: Scrape type for EY24204: 0
2026-01-29 06:34:00 [auto1.fr] INFO: Found listing with ID: PJ39237
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PJ39237%27 HTTP/1.1" 200 None
2026-01-29 06:34:00 [auto1.fr] INFO: Scrape type for PJ39237: 0
2026-01-29 06:34:00 [auto1.fr] INFO: Found listing with ID: ET36118
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ET36118%27 HTTP/1.1" 200 None
2026-01-29 06:34:00 [auto1.fr] INFO: Scrape type for ET36118: 0
2026-01-29 06:34:00 [auto1.fr] INFO: Found listing with ID: AP30057
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AP30057%27 HTTP/1.1" 200 None
2026-01-29 06:34:00 [auto1.fr] INFO: Scrape type for AP30057: 0
2026-01-29 06:34:00 [auto1.fr] INFO: Found listing with ID: EB24544
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EB24544%27 HTTP/1.1" 200 None
2026-01-29 06:34:00 [auto1.fr] INFO: Scrape type for EB24544: 0
2026-01-29 06:34:00 [auto1.fr] INFO: Found listing with ID: NM64607
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NM64607%27 HTTP/1.1" 200 None
2026-01-29 06:34:00 [auto1.fr] INFO: Scrape type for NM64607: 0
2026-01-29 06:34:00 [auto1.fr] INFO: Found listing with ID: HY39705
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HY39705%27 HTTP/1.1" 200 None
2026-01-29 06:34:00 [auto1.fr] INFO: Scrape type for HY39705: 0
2026-01-29 06:34:00 [auto1.fr] INFO: Found listing with ID: VL42264
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL42264%27 HTTP/1.1" 200 None
2026-01-29 06:34:00 [auto1.fr] INFO: Scrape type for VL42264: 0
2026-01-29 06:34:00 [auto1.fr] INFO: Found listing with ID: PV54344
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PV54344%27 HTTP/1.1" 200 None
2026-01-29 06:34:00 [auto1.fr] INFO: Scrape type for PV54344: 0
2026-01-29 06:34:00 [auto1.fr] INFO: Found listing with ID: DS26597
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS26597%27 HTTP/1.1" 200 None
2026-01-29 06:34:00 [auto1.fr] INFO: Scrape type for DS26597: 0
2026-01-29 06:34:00 [auto1.fr] INFO: Found listing with ID: EA30453
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EA30453%27 HTTP/1.1" 200 None
2026-01-29 06:34:00 [auto1.fr] INFO: Scrape type for EA30453: 0
2026-01-29 06:34:00 [auto1.fr] INFO: Found listing with ID: AT42169
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AT42169%27 HTTP/1.1" 200 None
2026-01-29 06:34:00 [auto1.fr] INFO: Scrape type for AT42169: 0
2026-01-29 06:34:00 [auto1.fr] INFO: Found listing with ID: CX52337
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CX52337%27 HTTP/1.1" 200 None
2026-01-29 06:34:00 [auto1.fr] INFO: Scrape type for CX52337: 0
2026-01-29 06:34:00 [auto1.fr] INFO: Found listing with ID: VG02516
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG02516%27 HTTP/1.1" 200 None
2026-01-29 06:34:00 [auto1.fr] INFO: Scrape type for VG02516: 0
2026-01-29 06:34:00 [auto1.fr] INFO: Found listing with ID: UC96977
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UC96977%27 HTTP/1.1" 200 None
2026-01-29 06:34:00 [auto1.fr] INFO: Scrape type for UC96977: 0
2026-01-29 06:34:00 [auto1.fr] INFO: Found listing with ID: HV01104
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HV01104%27 HTTP/1.1" 200 None
2026-01-29 06:34:00 [auto1.fr] INFO: Scrape type for HV01104: 0
2026-01-29 06:34:00 [auto1.fr] INFO: Found listing with ID: TC45256
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TC45256%27 HTTP/1.1" 200 None
2026-01-29 06:34:00 [auto1.fr] INFO: Scrape type for TC45256: 0
2026-01-29 06:34:00 [auto1.fr] INFO: Found listing with ID: MP24883
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP24883%27 HTTP/1.1" 200 None
2026-01-29 06:34:00 [auto1.fr] INFO: Scrape type for MP24883: 0
2026-01-29 06:34:00 [auto1.fr] INFO: Found listing with ID: YR06418
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YR06418%27 HTTP/1.1" 200 None
2026-01-29 06:34:00 [auto1.fr] INFO: Scrape type for YR06418: 0
2026-01-29 06:34:00 [auto1.fr] INFO: Found listing with ID: AD35094
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AD35094%27 HTTP/1.1" 200 None
2026-01-29 06:34:00 [auto1.fr] INFO: Scrape type for AD35094: 0
2026-01-29 06:34:00 [auto1.fr] INFO: Found listing with ID: WX42957
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WX42957%27 HTTP/1.1" 200 None
2026-01-29 06:34:00 [auto1.fr] INFO: Scrape type for WX42957: 0
2026-01-29 06:34:00 [auto1.fr] INFO: Found listing with ID: RE11067
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RE11067%27 HTTP/1.1" 200 None
2026-01-29 06:34:00 [auto1.fr] INFO: Scrape type for RE11067: 0
2026-01-29 06:34:00 [auto1.fr] INFO: Found listing with ID: ET74114
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ET74114%27 HTTP/1.1" 200 None
2026-01-29 06:34:00 [auto1.fr] INFO: Scrape type for ET74114: 0
2026-01-29 06:34:00 [auto1.fr] INFO: Found listing with ID: PX76861
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX76861%27 HTTP/1.1" 200 None
2026-01-29 06:34:00 [auto1.fr] INFO: Scrape type for PX76861: 0
2026-01-29 06:34:00 [auto1.fr] INFO: Found listing with ID: VC10323
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VC10323%27 HTTP/1.1" 200 None
2026-01-29 06:34:00 [auto1.fr] INFO: Scrape type for VC10323: 0
2026-01-29 06:34:00 [auto1.fr] INFO: Found listing with ID: UN72396
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN72396%27 HTTP/1.1" 200 None
2026-01-29 06:34:00 [auto1.fr] INFO: Scrape type for UN72396: 0
2026-01-29 06:34:00 [auto1.fr] INFO: Found listing with ID: PY80506
2026-01-29 06:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY80506%27 HTTP/1.1" 200 None
2026-01-29 06:34:01 [auto1.fr] INFO: Scrape type for PY80506: 0
2026-01-29 06:34:01 [auto1.fr] INFO: Found listing with ID: WB49988
2026-01-29 06:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB49988%27 HTTP/1.1" 200 None
2026-01-29 06:34:01 [auto1.fr] INFO: Scrape type for WB49988: 0
2026-01-29 06:34:01 [auto1.fr] INFO: Found listing with ID: KH43205
2026-01-29 06:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH43205%27 HTTP/1.1" 200 None
2026-01-29 06:34:01 [auto1.fr] INFO: Scrape type for KH43205: 0
2026-01-29 06:34:01 [auto1.fr] INFO: Found listing with ID: EA26262
2026-01-29 06:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EA26262%27 HTTP/1.1" 200 None
2026-01-29 06:34:01 [auto1.fr] INFO: Scrape type for EA26262: 0
2026-01-29 06:34:01 [auto1.fr] INFO: Found listing with ID: WZ80870
2026-01-29 06:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WZ80870%27 HTTP/1.1" 200 None
2026-01-29 06:34:01 [auto1.fr] INFO: Scrape type for WZ80870: 0
2026-01-29 06:34:01 [auto1.fr] INFO: Found listing with ID: SE92731
2026-01-29 06:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SE92731%27 HTTP/1.1" 200 None
2026-01-29 06:34:01 [auto1.fr] INFO: Scrape type for SE92731: 0
2026-01-29 06:34:01 [auto1.fr] INFO: Found listing with ID: ZF22737
2026-01-29 06:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZF22737%27 HTTP/1.1" 200 None
2026-01-29 06:34:01 [auto1.fr] INFO: Scrape type for ZF22737: 0
2026-01-29 06:34:01 [auto1.fr] INFO: Found listing with ID: AX13210
2026-01-29 06:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX13210%27 HTTP/1.1" 200 None
2026-01-29 06:34:01 [auto1.fr] INFO: Scrape type for AX13210: 0
2026-01-29 06:34:01 [auto1.fr] INFO: Found listing with ID: GM28344
2026-01-29 06:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GM28344%27 HTTP/1.1" 200 None
2026-01-29 06:34:01 [auto1.fr] INFO: Scrape type for GM28344: 0
2026-01-29 06:34:01 [auto1.fr] INFO: Found listing with ID: GU12273
2026-01-29 06:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU12273%27 HTTP/1.1" 200 None
2026-01-29 06:34:01 [auto1.fr] INFO: Scrape type for GU12273: 0
2026-01-29 06:34:01 [auto1.fr] INFO: Found listing with ID: BS11946
2026-01-29 06:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BS11946%27 HTTP/1.1" 200 None
2026-01-29 06:34:01 [auto1.fr] INFO: Scrape type for BS11946: 0
2026-01-29 06:34:01 [auto1.fr] INFO: Found listing with ID: FY19500
2026-01-29 06:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FY19500%27 HTTP/1.1" 200 None
2026-01-29 06:34:01 [auto1.fr] INFO: Scrape type for FY19500: 0
2026-01-29 06:34:01 [auto1.fr] INFO: Found listing with ID: UF60583
2026-01-29 06:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UF60583%27 HTTP/1.1" 200 None
2026-01-29 06:34:01 [auto1.fr] INFO: Scrape type for UF60583: 0
2026-01-29 06:34:12 [scrapy.extensions.logstats] INFO: Crawled 1296 pages (at 3 pages/min), scraped 288 items (at 1 items/min)
2026-01-29 06:34:33 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.354(s), this was the 1st time calling it.
2026-01-29 06:34:33 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.756877178818551 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:34:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SS57670/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:34:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZC47136/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:34:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YU87702/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:34:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:34:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:34:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HN66278/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:34:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:34:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KR14598/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:34:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MB50785> (referer: https://www.auto1.com/v1/car-details-view/MB50785/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:34:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:34:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71a39d50-8f2a-5347-8d42-9115aeb14685 with identifier: MB50785
2026-01-29 06:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71a39d50-8f2a-5347-8d42-9115aeb14685 with scrape type 2
2026-01-29 06:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71a39d50-8f2a-5347-8d42-9115aeb14685 with scrape type 2
2026-01-29 06:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 71a39d50-8f2a-5347-8d42-9115aeb14685, identifier: MB50785
2026-01-29 06:34:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 71a39d50-8f2a-5347-8d42-9115aeb14685 with identifier: MB50785
2026-01-29 06:34:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 71a39d50-8f2a-5347-8d42-9115aeb14685 with identifier: MB50785
2026-01-29 06:34:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech active pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 48136, 'odometer_reading_unit': 'km', 'registration_date': '2022-02-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mb50785', 'expiration_date': '2026-01-29t16:18:28z', 'origin_country_code': 'fr', 'trim': 'active pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, bassens', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '71a39d50-8f2a-5347-8d42-9115aeb14685', 'current_year_diff': 4, 'age_in_months': 47, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 48136}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 47,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 75,
     'expiration_date': '2026-01-29t16:18:28z',
     'fuel_type': 'petrol',
     'id': '71a39d50-8f2a-5347-8d42-9115aeb14685',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mb50785',
     'listing': 'auction',
     'location': 'fr, bassens',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 48136,
     'odometer_in_km': 48136,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-02-24',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech active pack',
     'transmission': 'manual',
     'trim': 'active pack',
     'year': 2022}
2026-01-29 06:34:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 71a39d50-8f2a-5347-8d42-9115aeb14685 spider: auto1.fr
2026-01-29 06:34:48 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 71a39d50-8f2a-5347-8d42-9115aeb14685 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech active pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 48136, 'odometer_reading_unit': 'km', 'registration_date': '2022-02-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mb50785', 'expiration_date': '2026-01-29t16:18:28z', 'origin_country_code': 'fr', 'trim': 'active pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'fr, bassens', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '71a39d50-8f2a-5347-8d42-9115aeb14685', 'current_year_diff': 4, 'age_in_months': 47, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 48136}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 47,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 75,
     'expiration_date': '2026-01-29t16:18:28z',
     'fuel_type': 'petrol',
     'id': '71a39d50-8f2a-5347-8d42-9115aeb14685',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mb50785',
     'listing': 'auction',
     'location': 'fr, bassens',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 48136,
     'odometer_in_km': 48136,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-02-24',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech active pack',
     'transmission': 'manual',
     'trim': 'active pack',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:18:28Z',
 'fuel_type': 'petrol',
 'id': '71a39d50-8f2a-5347-8d42-9115aeb14685',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB50785',
 'listing': 'auction',
 'location': 'FR, Bassens',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 48136,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Active Pack',
 'transmission': 'manual',
 'trim': 'Active Pack',
 'year': 2022}
2026-01-29 06:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MB50785%27 HTTP/1.1" 200 None
2026-01-29 06:34:48 [auto1.fr] INFO: Saving data for MB50785: {'auction_closing_time': 1769703508.0, 'created_time': 1768888945.996676, 'last_price_update_time': 1769668488.061824}
2026-01-29 06:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MB50785') HTTP/1.1" 204 0
2026-01-29 06:34:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GS64176/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:34:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:34:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UL51467/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:34:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:34:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SC26887> (referer: https://www.auto1.com/v1/car-details-view/SC26887/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:34:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:34:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e92e807-84ec-519a-b09c-077839d557b0 with identifier: SC26887
2026-01-29 06:34:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e92e807-84ec-519a-b09c-077839d557b0 with scrape type 2
2026-01-29 06:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e92e807-84ec-519a-b09c-077839d557b0 with scrape type 2
2026-01-29 06:34:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9e92e807-84ec-519a-b09c-077839d557b0, identifier: SC26887
2026-01-29 06:34:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9e92e807-84ec-519a-b09c-077839d557b0 with identifier: SC26887
2026-01-29 06:34:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9e92e807-84ec-519a-b09c-077839d557b0 with identifier: SC26887
2026-01-29 06:34:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9e92e807-84ec-519a-b09c-077839d557b0 with identifier: SC26887 to the API
2026-01-29 06:34:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:34:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:34:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SC26887>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 224,
 'expiration_date': '2026-01-29T16:23:23Z',
 'fuel_type': 'hybrid',
 'id': '9e92e807-84ec-519a-b09c-077839d557b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC26887',
 'listing': 'auction',
 'location': 'FR, Boé',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 128945,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Hybrid 225 GT',
 'transmission': 'automatic',
 'trim': '225 GT',
 'year': 2021}
2026-01-29 06:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SC26887%27 HTTP/1.1" 200 None
2026-01-29 06:34:54 [auto1.fr] INFO: Saving data for SC26887: {'auction_closing_time': 1769703803.0, 'created_time': 1769016346.549344, 'last_price_update_time': 1769668494.015288}
2026-01-29 06:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SC26887') HTTP/1.1" 204 0
2026-01-29 06:34:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:34:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:34:55 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: WT71752
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WT71752%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for WT71752: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: HZ59496
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HZ59496%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for HZ59496: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: VV53212
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV53212%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for VV53212: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: WD67616
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD67616%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for WD67616: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: VP51639
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VP51639%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for VP51639: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: BY85215
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BY85215%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for BY85215: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: XB88769
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB88769%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for XB88769: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: VU79079
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VU79079%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for VU79079: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: PK46785
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PK46785%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for PK46785: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: UJ73062
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UJ73062%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for UJ73062: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: AR36974
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AR36974%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for AR36974: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: LT65649
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LT65649%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for LT65649: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: UJ95485
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UJ95485%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for UJ95485: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: KH58146
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH58146%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for KH58146: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: TW20186
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TW20186%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for TW20186: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: SY84772
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SY84772%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for SY84772: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: FG74009
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FG74009%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for FG74009: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: RW00329
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RW00329%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for RW00329: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: XZ25466
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XZ25466%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for XZ25466: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: YJ27396
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YJ27396%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for YJ27396: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: VL77916
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL77916%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for VL77916: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: KN66088
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KN66088%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for KN66088: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: JX46819
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JX46819%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for JX46819: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: RA52397
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RA52397%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for RA52397: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: DX70763
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DX70763%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for DX70763: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: ZN71807
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN71807%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for ZN71807: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: YR87917
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YR87917%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for YR87917: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: RL88300
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RL88300%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for RL88300: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: WM72700
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM72700%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for WM72700: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: FV45595
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV45595%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for FV45595: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: PL46221
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PL46221%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for PL46221: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: GJ99298
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GJ99298%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for GJ99298: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: TY38052
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY38052%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for TY38052: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: ER46355
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER46355%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for ER46355: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: TP58779
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TP58779%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for TP58779: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: ZK80971
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZK80971%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for ZK80971: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: VG06254
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG06254%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for VG06254: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: YH43717
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YH43717%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for YH43717: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: LT21428
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LT21428%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for LT21428: 0
2026-01-29 06:34:55 [auto1.fr] INFO: Found listing with ID: YB92412
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YB92412%27 HTTP/1.1" 200 None
2026-01-29 06:34:55 [auto1.fr] INFO: Scrape type for YB92412: 2
2026-01-29 06:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SS57670> (referer: https://www.auto1.com/v1/car-details-view/SS57670/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:34:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:34:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4eb2bb9c-8b49-5da8-bdc3-a266e8d7daae with identifier: SS57670
2026-01-29 06:34:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4eb2bb9c-8b49-5da8-bdc3-a266e8d7daae with scrape type 2
2026-01-29 06:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4eb2bb9c-8b49-5da8-bdc3-a266e8d7daae with scrape type 2
2026-01-29 06:34:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4eb2bb9c-8b49-5da8-bdc3-a266e8d7daae, identifier: SS57670
2026-01-29 06:34:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4eb2bb9c-8b49-5da8-bdc3-a266e8d7daae with identifier: SS57670
2026-01-29 06:34:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4eb2bb9c-8b49-5da8-bdc3-a266e8d7daae with identifier: SS57670
2026-01-29 06:34:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4eb2bb9c-8b49-5da8-bdc3-a266e8d7daae with identifier: SS57670 to the API
2026-01-29 06:34:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:34:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:34:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SS57670>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:02:51Z',
 'fuel_type': 'diesel',
 'id': '4eb2bb9c-8b49-5da8-bdc3-a266e8d7daae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS57670',
 'listing': 'auction',
 'location': 'FR, Villenoy',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 121294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-28',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 1.5 Blue-HDi Allure Business',
 'transmission': 'manual',
 'trim': 'Allure Business',
 'year': 2019}
2026-01-29 06:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SS57670%27 HTTP/1.1" 200 None
2026-01-29 06:34:56 [auto1.fr] INFO: Saving data for SS57670: {'auction_closing_time': 1769702571.0, 'created_time': 1765818156.25628, 'last_price_update_time': 1769668496.658762}
2026-01-29 06:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SS57670') HTTP/1.1" 204 0
2026-01-29 06:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZC47136> (referer: https://www.auto1.com/v1/car-details-view/ZC47136/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:34:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:34:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 746a45e1-51ff-55c9-b8a0-5660979bb2cd with identifier: ZC47136
2026-01-29 06:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 746a45e1-51ff-55c9-b8a0-5660979bb2cd with scrape type 2
2026-01-29 06:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 746a45e1-51ff-55c9-b8a0-5660979bb2cd with scrape type 2
2026-01-29 06:34:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 746a45e1-51ff-55c9-b8a0-5660979bb2cd, identifier: ZC47136
2026-01-29 06:34:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 746a45e1-51ff-55c9-b8a0-5660979bb2cd with identifier: ZC47136
2026-01-29 06:34:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 746a45e1-51ff-55c9-b8a0-5660979bb2cd with identifier: ZC47136
2026-01-29 06:34:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech like', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 75745, 'odometer_reading_unit': 'km', 'registration_date': '2021-05-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zc47136', 'expiration_date': '2026-01-29t16:44:10z', 'origin_country_code': 'fr', 'trim': 'like', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 119, 'id': '746a45e1-51ff-55c9-b8a0-5660979bb2cd', 'current_year_diff': 5, 'age_in_months': 56, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 75745}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 56,
     'auction_title': '',
     'c_o_2_emission_value': 119,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 75,
     'expiration_date': '2026-01-29t16:44:10z',
     'fuel_type': 'petrol',
     'id': '746a45e1-51ff-55c9-b8a0-5660979bb2cd',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zc47136',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 75745,
     'odometer_in_km': 75745,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-05-27',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech like',
     'transmission': 'manual',
     'trim': 'like',
     'year': 2021}
2026-01-29 06:34:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 746a45e1-51ff-55c9-b8a0-5660979bb2cd spider: auto1.fr
2026-01-29 06:34:57 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 746a45e1-51ff-55c9-b8a0-5660979bb2cd due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech like', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 75745, 'odometer_reading_unit': 'km', 'registration_date': '2021-05-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zc47136', 'expiration_date': '2026-01-29t16:44:10z', 'origin_country_code': 'fr', 'trim': 'like', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 75, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, chartres de bretagne', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 119, 'id': '746a45e1-51ff-55c9-b8a0-5660979bb2cd', 'current_year_diff': 5, 'age_in_months': 56, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 75745}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 56,
     'auction_title': '',
     'c_o_2_emission_value': 119,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 75,
     'expiration_date': '2026-01-29t16:44:10z',
     'fuel_type': 'petrol',
     'id': '746a45e1-51ff-55c9-b8a0-5660979bb2cd',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zc47136',
     'listing': 'auction',
     'location': 'fr, chartres de bretagne',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 75745,
     'odometer_in_km': 75745,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-05-27',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech like',
     'transmission': 'manual',
     'trim': 'like',
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:44:10Z',
 'fuel_type': 'petrol',
 'id': '746a45e1-51ff-55c9-b8a0-5660979bb2cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC47136',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 75745,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Like',
 'transmission': 'manual',
 'trim': 'Like',
 'year': 2021}
2026-01-29 06:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZC47136%27 HTTP/1.1" 200 None
2026-01-29 06:34:57 [auto1.fr] INFO: Saving data for ZC47136: {'auction_closing_time': 1769705050.0, 'created_time': 1768240270.750451, 'last_price_update_time': 1769668497.305032}
2026-01-29 06:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZC47136') HTTP/1.1" 204 0
2026-01-29 06:34:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YU87702> (referer: https://www.auto1.com/v1/car-details-view/YU87702/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:34:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:34:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f800f33-67e9-5e7e-b984-c28a6beeeff0 with identifier: YU87702
2026-01-29 06:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f800f33-67e9-5e7e-b984-c28a6beeeff0 with scrape type 2
2026-01-29 06:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f800f33-67e9-5e7e-b984-c28a6beeeff0 with scrape type 2
2026-01-29 06:34:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8f800f33-67e9-5e7e-b984-c28a6beeeff0, identifier: YU87702
2026-01-29 06:34:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8f800f33-67e9-5e7e-b984-c28a6beeeff0 with identifier: YU87702
2026-01-29 06:34:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8f800f33-67e9-5e7e-b984-c28a6beeeff0 with identifier: YU87702
2026-01-29 06:34:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8f800f33-67e9-5e7e-b984-c28a6beeeff0 with identifier: YU87702 to the API
2026-01-29 06:34:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:34:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:34:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YU87702>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '',
 'engine_horse_power': 170,
 'expiration_date': '2026-01-29T16:34:32Z',
 'fuel_type': 'electro',
 'id': '8f800f33-67e9-5e7e-b984-c28a6beeeff0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU87702',
 'listing': 'auction',
 'location': 'Chambray-Lès-Tours',
 'make': 'BMW',
 'model': 'i3',
 'odometer': 56214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-22',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW i3 i3',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-01-29 06:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YU87702%27 HTTP/1.1" 200 None
2026-01-29 06:34:58 [auto1.fr] INFO: Saving data for YU87702: {'auction_closing_time': 1769704472.0, 'created_time': 1769447603.484642, 'last_price_update_time': 1769668498.18508}
2026-01-29 06:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YU87702') HTTP/1.1" 204 0
2026-01-29 06:34:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HN66278> (referer: https://www.auto1.com/v1/car-details-view/HN66278/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:34:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:34:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60c4b1b5-d693-5288-b775-8383df025f75 with identifier: HN66278
2026-01-29 06:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60c4b1b5-d693-5288-b775-8383df025f75 with scrape type 2
2026-01-29 06:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60c4b1b5-d693-5288-b775-8383df025f75 with scrape type 2
2026-01-29 06:34:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 60c4b1b5-d693-5288-b775-8383df025f75, identifier: HN66278
2026-01-29 06:34:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 60c4b1b5-d693-5288-b775-8383df025f75 with identifier: HN66278
2026-01-29 06:34:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 60c4b1b5-d693-5288-b775-8383df025f75 with identifier: HN66278
2026-01-29 06:34:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 e-thp gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 148155, 'odometer_reading_unit': 'km', 'registration_date': '2017-04-05', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hn66278', 'expiration_date': '2026-01-29t16:18:18z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, beaucaire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 110, 'id': '60c4b1b5-d693-5288-b775-8383df025f75', 'current_year_diff': 9, 'age_in_months': 105, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 148155}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 105,
     'auction_title': '',
     'c_o_2_emission_value': 110,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:18:18z',
     'fuel_type': 'petrol',
     'id': '60c4b1b5-d693-5288-b775-8383df025f75',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hn66278',
     'listing': 'auction',
     'location': 'fr, beaucaire',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 148155,
     'odometer_in_km': 148155,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-04-05',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 e-thp gt line',
     'transmission': 'automatic',
     'trim': 'gt line',
     'year': 2017}
2026-01-29 06:34:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 60c4b1b5-d693-5288-b775-8383df025f75 spider: auto1.fr
2026-01-29 06:34:59 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 60c4b1b5-d693-5288-b775-8383df025f75 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 e-thp gt line', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 148155, 'odometer_reading_unit': 'km', 'registration_date': '2017-04-05', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hn66278', 'expiration_date': '2026-01-29t16:18:18z', 'origin_country_code': 'fr', 'trim': 'gt line', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, beaucaire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 110, 'id': '60c4b1b5-d693-5288-b775-8383df025f75', 'current_year_diff': 9, 'age_in_months': 105, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 148155}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 105,
     'auction_title': '',
     'c_o_2_emission_value': 110,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:18:18z',
     'fuel_type': 'petrol',
     'id': '60c4b1b5-d693-5288-b775-8383df025f75',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hn66278',
     'listing': 'auction',
     'location': 'fr, beaucaire',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 148155,
     'odometer_in_km': 148155,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-04-05',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 e-thp gt line',
     'transmission': 'automatic',
     'trim': 'gt line',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:18:18Z',
 'fuel_type': 'petrol',
 'id': '60c4b1b5-d693-5288-b775-8383df025f75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN66278',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 148155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 e-THP GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2017}
2026-01-29 06:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HN66278%27 HTTP/1.1" 200 None
2026-01-29 06:34:59 [auto1.fr] INFO: Saving data for HN66278: {'auction_closing_time': 1769703498.0, 'created_time': 1769493734.928253, 'last_price_update_time': 1769668499.637294}
2026-01-29 06:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HN66278') HTTP/1.1" 204 0
2026-01-29 06:34:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KR14598> (referer: https://www.auto1.com/v1/car-details-view/KR14598/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:34:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:34:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e279ae9b-766b-50a4-9382-8f4c31bc5ae1 with identifier: KR14598
2026-01-29 06:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e279ae9b-766b-50a4-9382-8f4c31bc5ae1 with scrape type 2
2026-01-29 06:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e279ae9b-766b-50a4-9382-8f4c31bc5ae1 with scrape type 2
2026-01-29 06:34:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e279ae9b-766b-50a4-9382-8f4c31bc5ae1, identifier: KR14598
2026-01-29 06:34:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e279ae9b-766b-50a4-9382-8f4c31bc5ae1 with identifier: KR14598
2026-01-29 06:34:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e279ae9b-766b-50a4-9382-8f4c31bc5ae1 with identifier: KR14598
2026-01-29 06:34:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e279ae9b-766b-50a4-9382-8f4c31bc5ae1 with identifier: KR14598 to the API
2026-01-29 06:34:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:35:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:35:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KR14598>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:49:08Z',
 'fuel_type': 'diesel',
 'id': 'e279ae9b-766b-50a4-9382-8f4c31bc5ae1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR14598',
 'listing': 'auction',
 'location': 'FR, Marseille',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 131668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2018}
2026-01-29 06:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KR14598%27 HTTP/1.1" 200 None
2026-01-29 06:35:00 [auto1.fr] INFO: Saving data for KR14598: {'auction_closing_time': 1769705348.0, 'created_time': 1768716083.492732, 'last_price_update_time': 1769668500.169986}
2026-01-29 06:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KR14598') HTTP/1.1" 204 0
2026-01-29 06:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CG21798/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:35:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:35:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GS64176> (referer: https://www.auto1.com/v1/car-details-view/GS64176/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:35:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:35:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edbc40a7-b054-5f99-8f13-3b87fd62557e with identifier: GS64176
2026-01-29 06:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edbc40a7-b054-5f99-8f13-3b87fd62557e with scrape type 2
2026-01-29 06:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item edbc40a7-b054-5f99-8f13-3b87fd62557e with scrape type 2
2026-01-29 06:35:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: edbc40a7-b054-5f99-8f13-3b87fd62557e, identifier: GS64176
2026-01-29 06:35:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: edbc40a7-b054-5f99-8f13-3b87fd62557e with identifier: GS64176
2026-01-29 06:35:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: edbc40a7-b054-5f99-8f13-3b87fd62557e with identifier: GS64176
2026-01-29 06:35:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'green', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech feel', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 99950, 'odometer_reading_unit': 'km', 'registration_date': '2017-10-16', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gs64176', 'expiration_date': '2026-01-29t16:12:40z', 'origin_country_code': 'fr', 'trim': 'feel', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, beaucaire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 103, 'id': 'edbc40a7-b054-5f99-8f13-3b87fd62557e', 'current_year_diff': 9, 'age_in_months': 99, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 99950}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 99,
     'auction_title': '',
     'c_o_2_emission_value': 103,
     'category': None,
     'color': 'green',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:12:40z',
     'fuel_type': 'petrol',
     'id': 'edbc40a7-b054-5f99-8f13-3b87fd62557e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gs64176',
     'listing': 'auction',
     'location': 'fr, beaucaire',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 99950,
     'odometer_in_km': 99950,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-10-16',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech feel',
     'transmission': 'manual',
     'trim': 'feel',
     'year': 2017}
2026-01-29 06:35:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: edbc40a7-b054-5f99-8f13-3b87fd62557e spider: auto1.fr
2026-01-29 06:35:01 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: edbc40a7-b054-5f99-8f13-3b87fd62557e due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'green', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech feel', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 99950, 'odometer_reading_unit': 'km', 'registration_date': '2017-10-16', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gs64176', 'expiration_date': '2026-01-29t16:12:40z', 'origin_country_code': 'fr', 'trim': 'feel', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, beaucaire', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 103, 'id': 'edbc40a7-b054-5f99-8f13-3b87fd62557e', 'current_year_diff': 9, 'age_in_months': 99, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 99950}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 99,
     'auction_title': '',
     'c_o_2_emission_value': 103,
     'category': None,
     'color': 'green',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:12:40z',
     'fuel_type': 'petrol',
     'id': 'edbc40a7-b054-5f99-8f13-3b87fd62557e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gs64176',
     'listing': 'auction',
     'location': 'fr, beaucaire',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 99950,
     'odometer_in_km': 99950,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-10-16',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech feel',
     'transmission': 'manual',
     'trim': 'feel',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:12:40Z',
 'fuel_type': 'petrol',
 'id': 'edbc40a7-b054-5f99-8f13-3b87fd62557e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS64176',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 99950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2017}
2026-01-29 06:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GS64176%27 HTTP/1.1" 200 None
2026-01-29 06:35:01 [auto1.fr] INFO: Saving data for GS64176: {'auction_closing_time': 1769703160.0, 'created_time': 1768992000.088514, 'last_price_update_time': 1769668501.442199}
2026-01-29 06:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GS64176') HTTP/1.1" 204 0
2026-01-29 06:35:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UL51467> (referer: https://www.auto1.com/v1/car-details-view/UL51467/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:35:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:35:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8547c799-7c61-5c7c-9db1-e41cc04e7067 with identifier: UL51467
2026-01-29 06:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8547c799-7c61-5c7c-9db1-e41cc04e7067 with scrape type 2
2026-01-29 06:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8547c799-7c61-5c7c-9db1-e41cc04e7067 with scrape type 2
2026-01-29 06:35:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8547c799-7c61-5c7c-9db1-e41cc04e7067, identifier: UL51467
2026-01-29 06:35:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8547c799-7c61-5c7c-9db1-e41cc04e7067 with identifier: UL51467
2026-01-29 06:35:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8547c799-7c61-5c7c-9db1-e41cc04e7067 with identifier: UL51467
2026-01-29 06:35:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8547c799-7c61-5c7c-9db1-e41cc04e7067 with identifier: UL51467 to the API
2026-01-29 06:35:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:35:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:35:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UL51467>
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 238,
 'expiration_date': '2026-01-29T16:52:53Z',
 'fuel_type': 'diesel',
 'id': '8547c799-7c61-5c7c-9db1-e41cc04e7067',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL51467',
 'listing': 'auction',
 'location': 'FR, TARNOS',
 'make': 'Ford',
 'model': 'Edge',
 'odometer': 121586,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Edge 2.0 TDCi EcoBlue ST-Line 4x4',
 'transmission': 'automatic',
 'trim': 'ST-Line 4x4',
 'year': 2019}
2026-01-29 06:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL51467%27 HTTP/1.1" 200 None
2026-01-29 06:35:01 [auto1.fr] INFO: Saving data for UL51467: {'auction_closing_time': 1769705573.0, 'created_time': 1769447597.43979, 'last_price_update_time': 1769668501.940155}
2026-01-29 06:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UL51467') HTTP/1.1" 204 0
2026-01-29 06:35:02 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.147(s), this was the 1st time calling it.
2026-01-29 06:35:02 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.694348004050755 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YB92412/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:35:02 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:35:02 [auto1.fr] INFO: Found listing with ID: WF71063
2026-01-29 06:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WF71063%27 HTTP/1.1" 200 None
2026-01-29 06:35:02 [auto1.fr] INFO: Scrape type for WF71063: 0
2026-01-29 06:35:02 [auto1.fr] INFO: Found listing with ID: DV58359
2026-01-29 06:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DV58359%27 HTTP/1.1" 200 None
2026-01-29 06:35:02 [auto1.fr] INFO: Scrape type for DV58359: 0
2026-01-29 06:35:02 [auto1.fr] INFO: Found listing with ID: XN28033
2026-01-29 06:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XN28033%27 HTTP/1.1" 200 None
2026-01-29 06:35:02 [auto1.fr] INFO: Scrape type for XN28033: 0
2026-01-29 06:35:02 [auto1.fr] INFO: Found listing with ID: JZ39686
2026-01-29 06:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JZ39686%27 HTTP/1.1" 200 None
2026-01-29 06:35:02 [auto1.fr] INFO: Scrape type for JZ39686: 0
2026-01-29 06:35:02 [auto1.fr] INFO: Found listing with ID: YR57026
2026-01-29 06:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YR57026%27 HTTP/1.1" 200 None
2026-01-29 06:35:02 [auto1.fr] INFO: Scrape type for YR57026: 0
2026-01-29 06:35:02 [auto1.fr] INFO: Found listing with ID: VS51600
2026-01-29 06:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS51600%27 HTTP/1.1" 200 None
2026-01-29 06:35:02 [auto1.fr] INFO: Scrape type for VS51600: 0
2026-01-29 06:35:02 [auto1.fr] INFO: Found listing with ID: ZY11558
2026-01-29 06:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZY11558%27 HTTP/1.1" 200 None
2026-01-29 06:35:02 [auto1.fr] INFO: Scrape type for ZY11558: 0
2026-01-29 06:35:02 [auto1.fr] INFO: Found listing with ID: FP16017
2026-01-29 06:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP16017%27 HTTP/1.1" 200 None
2026-01-29 06:35:02 [auto1.fr] INFO: Scrape type for FP16017: 0
2026-01-29 06:35:02 [auto1.fr] INFO: Found listing with ID: PR12150
2026-01-29 06:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR12150%27 HTTP/1.1" 200 None
2026-01-29 06:35:02 [auto1.fr] INFO: Scrape type for PR12150: 0
2026-01-29 06:35:02 [auto1.fr] INFO: Found listing with ID: AU75071
2026-01-29 06:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AU75071%27 HTTP/1.1" 200 None
2026-01-29 06:35:02 [auto1.fr] INFO: Scrape type for AU75071: 0
2026-01-29 06:35:02 [auto1.fr] INFO: Found listing with ID: NG48818
2026-01-29 06:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NG48818%27 HTTP/1.1" 200 None
2026-01-29 06:35:02 [auto1.fr] INFO: Scrape type for NG48818: 0
2026-01-29 06:35:02 [auto1.fr] INFO: Found listing with ID: ZS83537
2026-01-29 06:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZS83537%27 HTTP/1.1" 200 None
2026-01-29 06:35:02 [auto1.fr] INFO: Scrape type for ZS83537: 0
2026-01-29 06:35:02 [auto1.fr] INFO: Found listing with ID: ZG61653
2026-01-29 06:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG61653%27 HTTP/1.1" 200 None
2026-01-29 06:35:02 [auto1.fr] INFO: Scrape type for ZG61653: 0
2026-01-29 06:35:02 [auto1.fr] INFO: Found listing with ID: XZ03642
2026-01-29 06:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XZ03642%27 HTTP/1.1" 200 None
2026-01-29 06:35:03 [auto1.fr] INFO: Scrape type for XZ03642: 0
2026-01-29 06:35:03 [auto1.fr] INFO: Found listing with ID: YR92690
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YR92690%27 HTTP/1.1" 200 None
2026-01-29 06:35:03 [auto1.fr] INFO: Scrape type for YR92690: 0
2026-01-29 06:35:03 [auto1.fr] INFO: Found listing with ID: EL38935
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EL38935%27 HTTP/1.1" 200 None
2026-01-29 06:35:03 [auto1.fr] INFO: Scrape type for EL38935: 0
2026-01-29 06:35:03 [auto1.fr] INFO: Found listing with ID: NG19219
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NG19219%27 HTTP/1.1" 200 None
2026-01-29 06:35:03 [auto1.fr] INFO: Scrape type for NG19219: 0
2026-01-29 06:35:03 [auto1.fr] INFO: Found listing with ID: XS57335
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XS57335%27 HTTP/1.1" 200 None
2026-01-29 06:35:03 [auto1.fr] INFO: Scrape type for XS57335: 0
2026-01-29 06:35:03 [auto1.fr] INFO: Found listing with ID: HG52458
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HG52458%27 HTTP/1.1" 200 None
2026-01-29 06:35:03 [auto1.fr] INFO: Scrape type for HG52458: 0
2026-01-29 06:35:03 [auto1.fr] INFO: Found listing with ID: VP94690
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VP94690%27 HTTP/1.1" 200 None
2026-01-29 06:35:03 [auto1.fr] INFO: Scrape type for VP94690: 0
2026-01-29 06:35:03 [auto1.fr] INFO: Found listing with ID: TF33623
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TF33623%27 HTTP/1.1" 200 None
2026-01-29 06:35:03 [auto1.fr] INFO: Scrape type for TF33623: 0
2026-01-29 06:35:03 [auto1.fr] INFO: Found listing with ID: VJ67245
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VJ67245%27 HTTP/1.1" 200 None
2026-01-29 06:35:03 [auto1.fr] INFO: Scrape type for VJ67245: 0
2026-01-29 06:35:03 [auto1.fr] INFO: Found listing with ID: MN24260
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MN24260%27 HTTP/1.1" 200 None
2026-01-29 06:35:03 [auto1.fr] INFO: Scrape type for MN24260: 0
2026-01-29 06:35:03 [auto1.fr] INFO: Found listing with ID: JY49308
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JY49308%27 HTTP/1.1" 200 None
2026-01-29 06:35:03 [auto1.fr] INFO: Scrape type for JY49308: 0
2026-01-29 06:35:03 [auto1.fr] INFO: Found listing with ID: EL08433
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EL08433%27 HTTP/1.1" 200 None
2026-01-29 06:35:03 [auto1.fr] INFO: Scrape type for EL08433: 0
2026-01-29 06:35:03 [auto1.fr] INFO: Found listing with ID: XP65277
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XP65277%27 HTTP/1.1" 200 None
2026-01-29 06:35:03 [auto1.fr] INFO: Scrape type for XP65277: 0
2026-01-29 06:35:03 [auto1.fr] INFO: Found listing with ID: RV23991
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RV23991%27 HTTP/1.1" 200 None
2026-01-29 06:35:03 [auto1.fr] INFO: Scrape type for RV23991: 0
2026-01-29 06:35:03 [auto1.fr] INFO: Found listing with ID: ME64498
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ME64498%27 HTTP/1.1" 200 None
2026-01-29 06:35:03 [auto1.fr] INFO: Scrape type for ME64498: 0
2026-01-29 06:35:03 [auto1.fr] INFO: Found listing with ID: EF03264
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF03264%27 HTTP/1.1" 200 None
2026-01-29 06:35:03 [auto1.fr] INFO: Scrape type for EF03264: 0
2026-01-29 06:35:03 [auto1.fr] INFO: Found listing with ID: RC06341
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RC06341%27 HTTP/1.1" 200 None
2026-01-29 06:35:03 [auto1.fr] INFO: Scrape type for RC06341: 0
2026-01-29 06:35:03 [auto1.fr] INFO: Found listing with ID: YT07922
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YT07922%27 HTTP/1.1" 200 None
2026-01-29 06:35:03 [auto1.fr] INFO: Scrape type for YT07922: 0
2026-01-29 06:35:03 [auto1.fr] INFO: Found listing with ID: NT05803
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NT05803%27 HTTP/1.1" 200 None
2026-01-29 06:35:03 [auto1.fr] INFO: Scrape type for NT05803: 0
2026-01-29 06:35:03 [auto1.fr] INFO: Found listing with ID: VA34530
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VA34530%27 HTTP/1.1" 200 None
2026-01-29 06:35:03 [auto1.fr] INFO: Scrape type for VA34530: 0
2026-01-29 06:35:03 [auto1.fr] INFO: Found listing with ID: RN48031
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RN48031%27 HTTP/1.1" 200 None
2026-01-29 06:35:03 [auto1.fr] INFO: Scrape type for RN48031: 0
2026-01-29 06:35:03 [auto1.fr] INFO: Found listing with ID: VT81437
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VT81437%27 HTTP/1.1" 200 None
2026-01-29 06:35:03 [auto1.fr] INFO: Scrape type for VT81437: 0
2026-01-29 06:35:03 [auto1.fr] INFO: Found listing with ID: HJ44531
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HJ44531%27 HTTP/1.1" 200 None
2026-01-29 06:35:03 [auto1.fr] INFO: Scrape type for HJ44531: 0
2026-01-29 06:35:03 [auto1.fr] INFO: Found listing with ID: RE44455
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RE44455%27 HTTP/1.1" 200 None
2026-01-29 06:35:03 [auto1.fr] INFO: Scrape type for RE44455: 0
2026-01-29 06:35:03 [auto1.fr] INFO: Found listing with ID: WV95879
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WV95879%27 HTTP/1.1" 200 None
2026-01-29 06:35:03 [auto1.fr] INFO: Scrape type for WV95879: 0
2026-01-29 06:35:03 [auto1.fr] INFO: Found listing with ID: GL32714
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GL32714%27 HTTP/1.1" 200 None
2026-01-29 06:35:03 [auto1.fr] INFO: Scrape type for GL32714: 0
2026-01-29 06:35:03 [auto1.fr] INFO: Found listing with ID: GN67668
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN67668%27 HTTP/1.1" 200 None
2026-01-29 06:35:03 [auto1.fr] INFO: Scrape type for GN67668: 0
2026-01-29 06:35:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:35:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:35:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CG21798> (referer: https://www.auto1.com/v1/car-details-view/CG21798/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:35:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07fcb2b9-7735-50cd-a46e-9f5d3189911c with identifier: CG21798
2026-01-29 06:35:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07fcb2b9-7735-50cd-a46e-9f5d3189911c with scrape type 2
2026-01-29 06:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07fcb2b9-7735-50cd-a46e-9f5d3189911c with scrape type 2
2026-01-29 06:35:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 07fcb2b9-7735-50cd-a46e-9f5d3189911c, identifier: CG21798
2026-01-29 06:35:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 07fcb2b9-7735-50cd-a46e-9f5d3189911c with identifier: CG21798
2026-01-29 06:35:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 07fcb2b9-7735-50cd-a46e-9f5d3189911c with identifier: CG21798
2026-01-29 06:35:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 puretech allure pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 17466, 'odometer_reading_unit': 'km', 'registration_date': '2023-12-18', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cg21798', 'expiration_date': '2026-01-29t16:38:53z', 'origin_country_code': 'fr', 'trim': 'allure pack', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marly-la-ville', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 131, 'id': '07fcb2b9-7735-50cd-a46e-9f5d3189911c', 'current_year_diff': 3, 'age_in_months': 25, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 17466}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 25,
     'auction_title': '',
     'c_o_2_emission_value': 131,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:38:53z',
     'fuel_type': 'petrol',
     'id': '07fcb2b9-7735-50cd-a46e-9f5d3189911c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cg21798',
     'listing': 'auction',
     'location': 'fr, marly-la-ville',
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 17466,
     'odometer_in_km': 17466,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-12-18',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 1.2 puretech allure pack',
     'transmission': 'automatic',
     'trim': 'allure pack',
     'year': 2023}
2026-01-29 06:35:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 07fcb2b9-7735-50cd-a46e-9f5d3189911c spider: auto1.fr
2026-01-29 06:35:04 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 07fcb2b9-7735-50cd-a46e-9f5d3189911c due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 puretech allure pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 17466, 'odometer_reading_unit': 'km', 'registration_date': '2023-12-18', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cg21798', 'expiration_date': '2026-01-29t16:38:53z', 'origin_country_code': 'fr', 'trim': 'allure pack', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, marly-la-ville', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 131, 'id': '07fcb2b9-7735-50cd-a46e-9f5d3189911c', 'current_year_diff': 3, 'age_in_months': 25, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 17466}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 25,
     'auction_title': '',
     'c_o_2_emission_value': 131,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:38:53z',
     'fuel_type': 'petrol',
     'id': '07fcb2b9-7735-50cd-a46e-9f5d3189911c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cg21798',
     'listing': 'auction',
     'location': 'fr, marly-la-ville',
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 17466,
     'odometer_in_km': 17466,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-12-18',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 1.2 puretech allure pack',
     'transmission': 'automatic',
     'trim': 'allure pack',
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:38:53Z',
 'fuel_type': 'petrol',
 'id': '07fcb2b9-7735-50cd-a46e-9f5d3189911c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG21798',
 'listing': 'auction',
 'location': 'FR, Marly-la-ville',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 17466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.2 PureTech Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2023}
2026-01-29 06:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CG21798%27 HTTP/1.1" 200 None
2026-01-29 06:35:04 [auto1.fr] INFO: Saving data for CG21798: {'auction_closing_time': 1769704733.0, 'created_time': 1768644096.708584, 'last_price_update_time': 1769668504.624955}
2026-01-29 06:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CG21798') HTTP/1.1" 204 0
2026-01-29 06:35:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:35:04 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 401.164(s), this was the 3rd time calling it.
2026-01-29 06:35:04 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.3873308745329656 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:35:04 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:35:04 [auto1.fr] INFO: Found listing with ID: UR00772
2026-01-29 06:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UR00772%27 HTTP/1.1" 200 None
2026-01-29 06:35:04 [auto1.fr] INFO: Scrape type for UR00772: 0
2026-01-29 06:35:04 [auto1.fr] INFO: Found listing with ID: TN92840
2026-01-29 06:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TN92840%27 HTTP/1.1" 200 None
2026-01-29 06:35:04 [auto1.fr] INFO: Scrape type for TN92840: 0
2026-01-29 06:35:04 [auto1.fr] INFO: Found listing with ID: HU49594
2026-01-29 06:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HU49594%27 HTTP/1.1" 200 None
2026-01-29 06:35:04 [auto1.fr] INFO: Scrape type for HU49594: 0
2026-01-29 06:35:04 [auto1.fr] INFO: Found listing with ID: XY88854
2026-01-29 06:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XY88854%27 HTTP/1.1" 200 None
2026-01-29 06:35:04 [auto1.fr] INFO: Scrape type for XY88854: 0
2026-01-29 06:35:04 [auto1.fr] INFO: Found listing with ID: WD38956
2026-01-29 06:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD38956%27 HTTP/1.1" 200 None
2026-01-29 06:35:04 [auto1.fr] INFO: Scrape type for WD38956: 0
2026-01-29 06:35:04 [auto1.fr] INFO: Found listing with ID: US72018
2026-01-29 06:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27US72018%27 HTTP/1.1" 200 None
2026-01-29 06:35:04 [auto1.fr] INFO: Scrape type for US72018: 0
2026-01-29 06:35:04 [auto1.fr] INFO: Found listing with ID: XU30675
2026-01-29 06:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XU30675%27 HTTP/1.1" 200 None
2026-01-29 06:35:04 [auto1.fr] INFO: Scrape type for XU30675: 0
2026-01-29 06:35:04 [auto1.fr] INFO: Found listing with ID: RE69924
2026-01-29 06:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RE69924%27 HTTP/1.1" 200 None
2026-01-29 06:35:04 [auto1.fr] INFO: Scrape type for RE69924: 0
2026-01-29 06:35:04 [auto1.fr] INFO: Found listing with ID: SF71094
2026-01-29 06:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF71094%27 HTTP/1.1" 200 None
2026-01-29 06:35:04 [auto1.fr] INFO: Scrape type for SF71094: 0
2026-01-29 06:35:04 [auto1.fr] INFO: Found listing with ID: DZ64926
2026-01-29 06:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DZ64926%27 HTTP/1.1" 200 None
2026-01-29 06:35:04 [auto1.fr] INFO: Scrape type for DZ64926: 0
2026-01-29 06:35:04 [auto1.fr] INFO: Found listing with ID: XE10310
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XE10310%27 HTTP/1.1" 200 None
2026-01-29 06:35:05 [auto1.fr] INFO: Scrape type for XE10310: 0
2026-01-29 06:35:05 [auto1.fr] INFO: Found listing with ID: JU84400
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JU84400%27 HTTP/1.1" 200 None
2026-01-29 06:35:05 [auto1.fr] INFO: Scrape type for JU84400: 0
2026-01-29 06:35:05 [auto1.fr] INFO: Found listing with ID: SL96680
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL96680%27 HTTP/1.1" 200 None
2026-01-29 06:35:05 [auto1.fr] INFO: Scrape type for SL96680: 0
2026-01-29 06:35:05 [auto1.fr] INFO: Found listing with ID: KL04721
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KL04721%27 HTTP/1.1" 200 None
2026-01-29 06:35:05 [auto1.fr] INFO: Scrape type for KL04721: 0
2026-01-29 06:35:05 [auto1.fr] INFO: Found listing with ID: AA07696
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AA07696%27 HTTP/1.1" 200 None
2026-01-29 06:35:05 [auto1.fr] INFO: Scrape type for AA07696: 0
2026-01-29 06:35:05 [auto1.fr] INFO: Found listing with ID: KP75928
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KP75928%27 HTTP/1.1" 200 None
2026-01-29 06:35:05 [auto1.fr] INFO: Scrape type for KP75928: 0
2026-01-29 06:35:05 [auto1.fr] INFO: Found listing with ID: VW10881
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VW10881%27 HTTP/1.1" 200 None
2026-01-29 06:35:05 [auto1.fr] INFO: Scrape type for VW10881: 0
2026-01-29 06:35:05 [auto1.fr] INFO: Found listing with ID: SP44471
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SP44471%27 HTTP/1.1" 200 None
2026-01-29 06:35:05 [auto1.fr] INFO: Scrape type for SP44471: 0
2026-01-29 06:35:05 [auto1.fr] INFO: Found listing with ID: KW96630
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KW96630%27 HTTP/1.1" 200 None
2026-01-29 06:35:05 [auto1.fr] INFO: Scrape type for KW96630: 0
2026-01-29 06:35:05 [auto1.fr] INFO: Found listing with ID: JH84462
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JH84462%27 HTTP/1.1" 200 None
2026-01-29 06:35:05 [auto1.fr] INFO: Scrape type for JH84462: 0
2026-01-29 06:35:05 [auto1.fr] INFO: Found listing with ID: ND21579
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ND21579%27 HTTP/1.1" 200 None
2026-01-29 06:35:05 [auto1.fr] INFO: Scrape type for ND21579: 0
2026-01-29 06:35:05 [auto1.fr] INFO: Found listing with ID: GW51224
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GW51224%27 HTTP/1.1" 200 None
2026-01-29 06:35:05 [auto1.fr] INFO: Scrape type for GW51224: 0
2026-01-29 06:35:05 [auto1.fr] INFO: Found listing with ID: BB18706
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BB18706%27 HTTP/1.1" 200 None
2026-01-29 06:35:05 [auto1.fr] INFO: Scrape type for BB18706: 0
2026-01-29 06:35:05 [auto1.fr] INFO: Found listing with ID: ND55697
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ND55697%27 HTTP/1.1" 200 None
2026-01-29 06:35:05 [auto1.fr] INFO: Scrape type for ND55697: 0
2026-01-29 06:35:05 [auto1.fr] INFO: Found listing with ID: TF00270
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TF00270%27 HTTP/1.1" 200 None
2026-01-29 06:35:05 [auto1.fr] INFO: Scrape type for TF00270: 0
2026-01-29 06:35:05 [auto1.fr] INFO: Found listing with ID: AH57085
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AH57085%27 HTTP/1.1" 200 None
2026-01-29 06:35:05 [auto1.fr] INFO: Scrape type for AH57085: 0
2026-01-29 06:35:05 [auto1.fr] INFO: Found listing with ID: SJ73120
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SJ73120%27 HTTP/1.1" 200 None
2026-01-29 06:35:05 [auto1.fr] INFO: Scrape type for SJ73120: 0
2026-01-29 06:35:05 [auto1.fr] INFO: Found listing with ID: YX88922
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YX88922%27 HTTP/1.1" 200 None
2026-01-29 06:35:05 [auto1.fr] INFO: Scrape type for YX88922: 0
2026-01-29 06:35:05 [auto1.fr] INFO: Found listing with ID: HN30354
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HN30354%27 HTTP/1.1" 200 None
2026-01-29 06:35:05 [auto1.fr] INFO: Scrape type for HN30354: 0
2026-01-29 06:35:05 [auto1.fr] INFO: Found listing with ID: UY07756
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY07756%27 HTTP/1.1" 200 None
2026-01-29 06:35:05 [auto1.fr] INFO: Scrape type for UY07756: 0
2026-01-29 06:35:05 [auto1.fr] INFO: Found listing with ID: XN76219
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XN76219%27 HTTP/1.1" 200 None
2026-01-29 06:35:05 [auto1.fr] INFO: Scrape type for XN76219: 0
2026-01-29 06:35:05 [auto1.fr] INFO: Found listing with ID: KA98895
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KA98895%27 HTTP/1.1" 200 None
2026-01-29 06:35:05 [auto1.fr] INFO: Scrape type for KA98895: 0
2026-01-29 06:35:05 [auto1.fr] INFO: Found listing with ID: PY95158
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY95158%27 HTTP/1.1" 200 None
2026-01-29 06:35:05 [auto1.fr] INFO: Scrape type for PY95158: 0
2026-01-29 06:35:05 [auto1.fr] INFO: Found listing with ID: KK57678
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KK57678%27 HTTP/1.1" 200 None
2026-01-29 06:35:05 [auto1.fr] INFO: Scrape type for KK57678: 0
2026-01-29 06:35:05 [auto1.fr] INFO: Found listing with ID: RX30238
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RX30238%27 HTTP/1.1" 200 None
2026-01-29 06:35:05 [auto1.fr] INFO: Scrape type for RX30238: 0
2026-01-29 06:35:05 [auto1.fr] INFO: Found listing with ID: NS07361
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NS07361%27 HTTP/1.1" 200 None
2026-01-29 06:35:05 [auto1.fr] INFO: Scrape type for NS07361: 0
2026-01-29 06:35:05 [auto1.fr] INFO: Found listing with ID: KS16279
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KS16279%27 HTTP/1.1" 200 None
2026-01-29 06:35:05 [auto1.fr] INFO: Scrape type for KS16279: 0
2026-01-29 06:35:05 [auto1.fr] INFO: Found listing with ID: HH71345
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HH71345%27 HTTP/1.1" 200 None
2026-01-29 06:35:05 [auto1.fr] INFO: Scrape type for HH71345: 0
2026-01-29 06:35:05 [auto1.fr] INFO: Found listing with ID: GJ18444
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GJ18444%27 HTTP/1.1" 200 None
2026-01-29 06:35:05 [auto1.fr] INFO: Scrape type for GJ18444: 0
2026-01-29 06:35:05 [auto1.fr] INFO: Found listing with ID: XZ39185
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XZ39185%27 HTTP/1.1" 200 None
2026-01-29 06:35:05 [auto1.fr] INFO: Scrape type for XZ39185: 0
2026-01-29 06:35:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YB92412> (referer: https://www.auto1.com/v1/car-details-view/YB92412/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:35:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 931a580a-e3b5-5ad0-952d-34ad47d36261 with identifier: YB92412
2026-01-29 06:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 931a580a-e3b5-5ad0-952d-34ad47d36261 with scrape type 2
2026-01-29 06:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 931a580a-e3b5-5ad0-952d-34ad47d36261 with scrape type 2
2026-01-29 06:35:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 931a580a-e3b5-5ad0-952d-34ad47d36261, identifier: YB92412
2026-01-29 06:35:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 931a580a-e3b5-5ad0-952d-34ad47d36261 with identifier: YB92412
2026-01-29 06:35:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 931a580a-e3b5-5ad0-952d-34ad47d36261 with identifier: YB92412
2026-01-29 06:35:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c4 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c4', 'transmission': 'automatic', 'odometer': 31104, 'odometer_reading_unit': 'km', 'registration_date': '2022-03-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yb92412', 'expiration_date': '2026-01-29t16:03:51z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ambarès-et-lagrave', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 130, 'id': '931a580a-e3b5-5ad0-952d-34ad47d36261', 'current_year_diff': 4, 'age_in_months': 45, 'make_model': 'citroen c4', 'sanitized_make': 'citroen', 'odometer_in_km': 31104}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 45,
     'auction_title': '',
     'c_o_2_emission_value': 130,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:03:51z',
     'fuel_type': 'petrol',
     'id': '931a580a-e3b5-5ad0-952d-34ad47d36261',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yb92412',
     'listing': 'auction',
     'location': 'fr, ambarès-et-lagrave',
     'make': 'citroen',
     'make_model': 'citroen c4',
     'model': 'c4',
     'odometer': 31104,
     'odometer_in_km': 31104,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-03-30',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c4 1.2 puretech shine',
     'transmission': 'automatic',
     'trim': 'shine',
     'year': 2022}
2026-01-29 06:35:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 931a580a-e3b5-5ad0-952d-34ad47d36261 spider: auto1.fr
2026-01-29 06:35:05 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 931a580a-e3b5-5ad0-952d-34ad47d36261 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c4 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c4', 'transmission': 'automatic', 'odometer': 31104, 'odometer_reading_unit': 'km', 'registration_date': '2022-03-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yb92412', 'expiration_date': '2026-01-29t16:03:51z', 'origin_country_code': 'fr', 'trim': 'shine', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.2l', 'location': 'fr, ambarès-et-lagrave', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 130, 'id': '931a580a-e3b5-5ad0-952d-34ad47d36261', 'current_year_diff': 4, 'age_in_months': 45, 'make_model': 'citroen c4', 'sanitized_make': 'citroen', 'odometer_in_km': 31104}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 45,
     'auction_title': '',
     'c_o_2_emission_value': 130,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:03:51z',
     'fuel_type': 'petrol',
     'id': '931a580a-e3b5-5ad0-952d-34ad47d36261',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yb92412',
     'listing': 'auction',
     'location': 'fr, ambarès-et-lagrave',
     'make': 'citroen',
     'make_model': 'citroen c4',
     'model': 'c4',
     'odometer': 31104,
     'odometer_in_km': 31104,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'fr',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-03-30',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c4 1.2 puretech shine',
     'transmission': 'automatic',
     'trim': 'shine',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:03:51Z',
 'fuel_type': 'petrol',
 'id': '931a580a-e3b5-5ad0-952d-34ad47d36261',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB92412',
 'listing': 'auction',
 'location': 'FR, Ambarès-et-Lagrave',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 31104,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 1.2 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2022}
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YB92412%27 HTTP/1.1" 200 None
2026-01-29 06:35:05 [auto1.fr] INFO: Saving data for YB92412: {'auction_closing_time': 1769702631.0, 'created_time': 1769274227.573366, 'last_price_update_time': 1769668505.964813}
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YB92412') HTTP/1.1" 204 0
2026-01-29 06:35:06 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 404.223(s), this was the 3rd time calling it.
2026-01-29 06:35:06 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.10976959598176 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:35:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:35:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:35:09 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:35:09 [auto1.fr] INFO: Found listing with ID: HX38280
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HX38280%27 HTTP/1.1" 200 None
2026-01-29 06:35:09 [auto1.fr] INFO: Scrape type for HX38280: 0
2026-01-29 06:35:09 [auto1.fr] INFO: Found listing with ID: LG11399
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LG11399%27 HTTP/1.1" 200 None
2026-01-29 06:35:09 [auto1.fr] INFO: Scrape type for LG11399: 0
2026-01-29 06:35:09 [auto1.fr] INFO: Found listing with ID: XH90027
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XH90027%27 HTTP/1.1" 200 None
2026-01-29 06:35:09 [auto1.fr] INFO: Scrape type for XH90027: 0
2026-01-29 06:35:09 [auto1.fr] INFO: Found listing with ID: PZ09265
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PZ09265%27 HTTP/1.1" 200 None
2026-01-29 06:35:09 [auto1.fr] INFO: Scrape type for PZ09265: 0
2026-01-29 06:35:09 [auto1.fr] INFO: Found listing with ID: MW69660
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MW69660%27 HTTP/1.1" 200 None
2026-01-29 06:35:09 [auto1.fr] INFO: Scrape type for MW69660: 0
2026-01-29 06:35:09 [auto1.fr] INFO: Found listing with ID: EA59639
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EA59639%27 HTTP/1.1" 200 None
2026-01-29 06:35:09 [auto1.fr] INFO: Scrape type for EA59639: 0
2026-01-29 06:35:09 [auto1.fr] INFO: Found listing with ID: EE89524
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EE89524%27 HTTP/1.1" 200 None
2026-01-29 06:35:09 [auto1.fr] INFO: Scrape type for EE89524: 0
2026-01-29 06:35:09 [auto1.fr] INFO: Found listing with ID: CD88013
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CD88013%27 HTTP/1.1" 200 None
2026-01-29 06:35:09 [auto1.fr] INFO: Scrape type for CD88013: 0
2026-01-29 06:35:09 [auto1.fr] INFO: Found listing with ID: LK34783
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LK34783%27 HTTP/1.1" 200 None
2026-01-29 06:35:09 [auto1.fr] INFO: Scrape type for LK34783: 0
2026-01-29 06:35:09 [auto1.fr] INFO: Found listing with ID: VR40109
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VR40109%27 HTTP/1.1" 200 None
2026-01-29 06:35:09 [auto1.fr] INFO: Scrape type for VR40109: 0
2026-01-29 06:35:09 [auto1.fr] INFO: Found listing with ID: NL65861
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NL65861%27 HTTP/1.1" 200 None
2026-01-29 06:35:09 [auto1.fr] INFO: Scrape type for NL65861: 0
2026-01-29 06:35:09 [auto1.fr] INFO: Found listing with ID: PC71972
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PC71972%27 HTTP/1.1" 200 None
2026-01-29 06:35:09 [auto1.fr] INFO: Scrape type for PC71972: 0
2026-01-29 06:35:09 [auto1.fr] INFO: Found listing with ID: WH87929
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WH87929%27 HTTP/1.1" 200 None
2026-01-29 06:35:09 [auto1.fr] INFO: Scrape type for WH87929: 0
2026-01-29 06:35:09 [auto1.fr] INFO: Found listing with ID: XM68826
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XM68826%27 HTTP/1.1" 200 None
2026-01-29 06:35:09 [auto1.fr] INFO: Scrape type for XM68826: 0
2026-01-29 06:35:09 [auto1.fr] INFO: Found listing with ID: EP97293
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EP97293%27 HTTP/1.1" 200 None
2026-01-29 06:35:09 [auto1.fr] INFO: Scrape type for EP97293: 0
2026-01-29 06:35:09 [auto1.fr] INFO: Found listing with ID: ZX98249
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZX98249%27 HTTP/1.1" 200 None
2026-01-29 06:35:09 [auto1.fr] INFO: Scrape type for ZX98249: 0
2026-01-29 06:35:09 [auto1.fr] INFO: Found listing with ID: VH85329
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VH85329%27 HTTP/1.1" 200 None
2026-01-29 06:35:09 [auto1.fr] INFO: Scrape type for VH85329: 0
2026-01-29 06:35:09 [auto1.fr] INFO: Found listing with ID: FC45376
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FC45376%27 HTTP/1.1" 200 None
2026-01-29 06:35:09 [auto1.fr] INFO: Scrape type for FC45376: 0
2026-01-29 06:35:09 [auto1.fr] INFO: Found listing with ID: LS34091
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LS34091%27 HTTP/1.1" 200 None
2026-01-29 06:35:09 [auto1.fr] INFO: Scrape type for LS34091: 0
2026-01-29 06:35:09 [auto1.fr] INFO: Found listing with ID: LV81115
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LV81115%27 HTTP/1.1" 200 None
2026-01-29 06:35:09 [auto1.fr] INFO: Scrape type for LV81115: 0
2026-01-29 06:35:09 [auto1.fr] INFO: Found listing with ID: UJ56774
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UJ56774%27 HTTP/1.1" 200 None
2026-01-29 06:35:09 [auto1.fr] INFO: Scrape type for UJ56774: 0
2026-01-29 06:35:09 [auto1.fr] INFO: Found listing with ID: MJ57193
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MJ57193%27 HTTP/1.1" 200 None
2026-01-29 06:35:09 [auto1.fr] INFO: Scrape type for MJ57193: 0
2026-01-29 06:35:09 [auto1.fr] INFO: Found listing with ID: AC18080
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AC18080%27 HTTP/1.1" 200 None
2026-01-29 06:35:09 [auto1.fr] INFO: Scrape type for AC18080: 0
2026-01-29 06:35:09 [auto1.fr] INFO: Found listing with ID: KS86180
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KS86180%27 HTTP/1.1" 200 None
2026-01-29 06:35:09 [auto1.fr] INFO: Scrape type for KS86180: 1
2026-01-29 06:35:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:35:09 [auto1.fr] INFO: Found listing with ID: RR90329
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RR90329%27 HTTP/1.1" 200 None
2026-01-29 06:35:09 [auto1.fr] INFO: Scrape type for RR90329: 0
2026-01-29 06:35:09 [auto1.fr] INFO: Found listing with ID: FP89389
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP89389%27 HTTP/1.1" 200 None
2026-01-29 06:35:09 [auto1.fr] INFO: Scrape type for FP89389: 0
2026-01-29 06:35:09 [auto1.fr] INFO: Found listing with ID: HG44430
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HG44430%27 HTTP/1.1" 200 None
2026-01-29 06:35:09 [auto1.fr] INFO: Scrape type for HG44430: 0
2026-01-29 06:35:09 [auto1.fr] INFO: Found listing with ID: JD59277
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD59277%27 HTTP/1.1" 200 None
2026-01-29 06:35:09 [auto1.fr] INFO: Scrape type for JD59277: 0
2026-01-29 06:35:09 [auto1.fr] INFO: Found listing with ID: BZ77981
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BZ77981%27 HTTP/1.1" 200 None
2026-01-29 06:35:09 [auto1.fr] INFO: Scrape type for BZ77981: 0
2026-01-29 06:35:09 [auto1.fr] INFO: Found listing with ID: XF13342
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XF13342%27 HTTP/1.1" 200 None
2026-01-29 06:35:09 [auto1.fr] INFO: Scrape type for XF13342: 0
2026-01-29 06:35:09 [auto1.fr] INFO: Found listing with ID: DR55787
2026-01-29 06:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DR55787%27 HTTP/1.1" 200 None
2026-01-29 06:35:10 [auto1.fr] INFO: Scrape type for DR55787: 0
2026-01-29 06:35:10 [auto1.fr] INFO: Found listing with ID: JB33063
2026-01-29 06:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JB33063%27 HTTP/1.1" 200 None
2026-01-29 06:35:10 [auto1.fr] INFO: Scrape type for JB33063: 0
2026-01-29 06:35:10 [auto1.fr] INFO: Found listing with ID: WZ25174
2026-01-29 06:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WZ25174%27 HTTP/1.1" 200 None
2026-01-29 06:35:10 [auto1.fr] INFO: Scrape type for WZ25174: 0
2026-01-29 06:35:10 [auto1.fr] INFO: Found listing with ID: WM34990
2026-01-29 06:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM34990%27 HTTP/1.1" 200 None
2026-01-29 06:35:10 [auto1.fr] INFO: Scrape type for WM34990: 0
2026-01-29 06:35:10 [auto1.fr] INFO: Found listing with ID: FU07665
2026-01-29 06:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FU07665%27 HTTP/1.1" 200 None
2026-01-29 06:35:10 [auto1.fr] INFO: Scrape type for FU07665: 0
2026-01-29 06:35:10 [auto1.fr] INFO: Found listing with ID: BM31052
2026-01-29 06:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BM31052%27 HTTP/1.1" 200 None
2026-01-29 06:35:10 [auto1.fr] INFO: Scrape type for BM31052: 0
2026-01-29 06:35:10 [auto1.fr] INFO: Found listing with ID: LP64358
2026-01-29 06:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LP64358%27 HTTP/1.1" 200 None
2026-01-29 06:35:10 [auto1.fr] INFO: Scrape type for LP64358: 0
2026-01-29 06:35:10 [auto1.fr] INFO: Found listing with ID: SV81166
2026-01-29 06:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV81166%27 HTTP/1.1" 200 None
2026-01-29 06:35:10 [auto1.fr] INFO: Scrape type for SV81166: 0
2026-01-29 06:35:10 [auto1.fr] INFO: Found listing with ID: DE74551
2026-01-29 06:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DE74551%27 HTTP/1.1" 200 None
2026-01-29 06:35:10 [auto1.fr] INFO: Scrape type for DE74551: 0
2026-01-29 06:35:10 [auto1.fr] INFO: Found listing with ID: ZV68048
2026-01-29 06:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZV68048%27 HTTP/1.1" 200 None
2026-01-29 06:35:10 [auto1.fr] INFO: Scrape type for ZV68048: 0
2026-01-29 06:35:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:35:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 4th time calling it.
2026-01-29 06:35:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KS86180/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:35:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:35:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:35:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZE61894/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:35:11 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:35:11 [auto1.fr] INFO: Found listing with ID: DA13495
2026-01-29 06:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DA13495%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for DA13495: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: YE36063
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YE36063%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for YE36063: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: MM80264
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MM80264%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for MM80264: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: KW61460
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KW61460%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for KW61460: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: CR10076
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CR10076%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for CR10076: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: LJ85564
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ85564%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for LJ85564: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: XG34583
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XG34583%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for XG34583: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: WY94373
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WY94373%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for WY94373: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: RC60817
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RC60817%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for RC60817: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: KZ50383
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KZ50383%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for KZ50383: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: HF75602
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HF75602%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for HF75602: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: EY94186
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EY94186%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for EY94186: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: KZ71039
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KZ71039%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for KZ71039: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: VZ22910
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VZ22910%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for VZ22910: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: VN93875
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN93875%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for VN93875: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: SV70523
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV70523%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for SV70523: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: MR99499
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR99499%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for MR99499: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: JF93703
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JF93703%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for JF93703: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: DJ86227
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DJ86227%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for DJ86227: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: PT03595
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PT03595%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for PT03595: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: DW13120
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DW13120%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for DW13120: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: EK40472
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EK40472%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for EK40472: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: LV01596
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LV01596%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for LV01596: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: EY63393
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EY63393%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for EY63393: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: XT80653
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XT80653%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for XT80653: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: FF24140
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FF24140%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for FF24140: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: MP27814
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP27814%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for MP27814: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: TS80439
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TS80439%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for TS80439: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: UJ35100
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UJ35100%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for UJ35100: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: RB01384
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RB01384%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for RB01384: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: UY23255
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY23255%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for UY23255: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: RJ83785
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RJ83785%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for RJ83785: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: NW71845
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NW71845%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for NW71845: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: SC65105
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SC65105%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for SC65105: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: JD48878
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD48878%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for JD48878: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: UD41413
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UD41413%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for UD41413: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: HG33527
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HG33527%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for HG33527: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: FK09580
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FK09580%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for FK09580: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: KZ18752
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KZ18752%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for KZ18752: 0
2026-01-29 06:35:12 [auto1.fr] INFO: Found listing with ID: LN81846
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LN81846%27 HTTP/1.1" 200 None
2026-01-29 06:35:12 [auto1.fr] INFO: Scrape type for LN81846: 0
2026-01-29 06:35:12 [scrapy.extensions.logstats] INFO: Crawled 1323 pages (at 27 pages/min), scraped 293 items (at 5 items/min)
2026-01-29 06:35:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MY19591> (referer: https://www.auto1.com/v1/car-details-view/MY19591/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:35:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:35:12 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.587(s), this was the 1st time calling it.
2026-01-29 06:35:12 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.423079088202949 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:35:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9e0d3e4-3916-511c-bb39-df4e02565beb with identifier: MY19591
2026-01-29 06:35:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9e0d3e4-3916-511c-bb39-df4e02565beb with scrape type 2
2026-01-29 06:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9e0d3e4-3916-511c-bb39-df4e02565beb with scrape type 2
2026-01-29 06:35:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e9e0d3e4-3916-511c-bb39-df4e02565beb, identifier: MY19591
2026-01-29 06:35:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e9e0d3e4-3916-511c-bb39-df4e02565beb with identifier: MY19591
2026-01-29 06:35:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e9e0d3e4-3916-511c-bb39-df4e02565beb with identifier: MY19591
2026-01-29 06:35:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 197959 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    197959
2026-01-29 06:35:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: e9e0d3e4-3916-511c-bb39-df4e02565beb spider: auto1.fr
2026-01-29 06:35:13 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: e9e0d3e4-3916-511c-bb39-df4e02565beb due to rule: high_mileage_for_country.json, error: 197959 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    197959
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-01-29T16:41:26Z',
 'fuel_type': 'diesel',
 'id': 'e9e0d3e4-3916-511c-bb39-df4e02565beb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY19591',
 'listing': 'auction',
 'location': 'FR, La Seyne-sur-Mer',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 197959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-02',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 2.0 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2019}
2026-01-29 06:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MY19591%27 HTTP/1.1" 200 None
2026-01-29 06:35:13 [auto1.fr] INFO: Saving data for MY19591: {'auction_closing_time': 1769704886.0, 'created_time': 1768890127.388919, 'last_price_update_time': 1769668513.239739}
2026-01-29 06:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MY19591') HTTP/1.1" 204 0
2026-01-29 06:35:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 4th time calling it.
2026-01-29 06:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KS86180> (referer: https://www.auto1.com/v1/car-details-view/KS86180/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:35:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 113cb9f4-b570-5fc4-9741-96dbb2851e58 with identifier: KS86180
2026-01-29 06:35:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 113cb9f4-b570-5fc4-9741-96dbb2851e58 with scrape type 1
2026-01-29 06:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 113cb9f4-b570-5fc4-9741-96dbb2851e58
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fef%252F4cef5b7da467e7492d0eecf1267cfb8d%252Fpa%252FKS86180_d193b0653b645428c2bbe4af3bdf1e69.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_d193b0653b645428c2bbe4af3bdf1e69.jpg not downloaded yet
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fef%252F4cef5b7da467e7492d0eecf1267cfb8d%252Fpa%252FKS86180_65b7cb02c2380ecb0c8dd4df6305312a.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_65b7cb02c2380ecb0c8dd4df6305312a.jpg not downloaded yet
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fef%252F4cef5b7da467e7492d0eecf1267cfb8d%252Fpa%252FKS86180_1fd81a71b25dce3f7f70a4b1810b2710.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_1fd81a71b25dce3f7f70a4b1810b2710.jpg not downloaded yet
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fef%252F4cef5b7da467e7492d0eecf1267cfb8d%252Fpa%252FKS86180_98a18afa73b5d3fa7fceb4c9e9e06c42.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_98a18afa73b5d3fa7fceb4c9e9e06c42.jpg not downloaded yet
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fef%252F4cef5b7da467e7492d0eecf1267cfb8d%252Fpa%252FKS86180_bb3ce022850945c9e922e3d895550890.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_bb3ce022850945c9e922e3d895550890.jpg not downloaded yet
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fef%252F4cef5b7da467e7492d0eecf1267cfb8d%252Fpa%252FKS86180_449f906a15f48d03ad0037358bae3228.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_449f906a15f48d03ad0037358bae3228.jpg not downloaded yet
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fef%252F4cef5b7da467e7492d0eecf1267cfb8d%252Fpa%252FKS86180_371a05b7d7e5d69a633dfbdd568b9efb.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_371a05b7d7e5d69a633dfbdd568b9efb.jpg not downloaded yet
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fef%252F4cef5b7da467e7492d0eecf1267cfb8d%252Fpa%252FKS86180_8fe51e3434f283bad88eaf38c0cb5556.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_8fe51e3434f283bad88eaf38c0cb5556.jpg not downloaded yet
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fef%252F4cef5b7da467e7492d0eecf1267cfb8d%252Fpa%252FKS86180_c1ba54dd6c7b858378640586cd02fa09.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_c1ba54dd6c7b858378640586cd02fa09.jpg not downloaded yet
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fef%252F4cef5b7da467e7492d0eecf1267cfb8d%252Fpa%252FKS86180_463696f5b52e51e343e5d030de556b59.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_463696f5b52e51e343e5d030de556b59.jpg not downloaded yet
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fef%252F4cef5b7da467e7492d0eecf1267cfb8d%252Fpa%252FKS86180_b57ef983a2ae24aeb07056a5cef85f27.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_b57ef983a2ae24aeb07056a5cef85f27.jpg not downloaded yet
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fef%252F4cef5b7da467e7492d0eecf1267cfb8d%252Fpa%252FKS86180_640a26b6d36196e9acfab23eebbb5d90.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_640a26b6d36196e9acfab23eebbb5d90.jpg not downloaded yet
2026-01-29 06:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fef%252F4cef5b7da467e7492d0eecf1267cfb8d%252Fpa%252FKS86180_f4a613f0fcce39d4b1db4950578a2547.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_f4a613f0fcce39d4b1db4950578a2547.jpg not downloaded yet
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fef%252F4cef5b7da467e7492d0eecf1267cfb8d%252Fpa%252FKS86180_22a4331f5fa39fda909e3190f50ddf42.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_22a4331f5fa39fda909e3190f50ddf42.jpg not downloaded yet
2026-01-29 06:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_d193b0653b645428c2bbe4af3bdf1e69.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fef%252F4cef5b7da467e7492d0eecf1267cfb8d%252Fpa%252FKS86180_e3ecc50de76160b0060c3a06d76fd2b3.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_e3ecc50de76160b0060c3a06d76fd2b3.jpg not downloaded yet
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fef%252F4cef5b7da467e7492d0eecf1267cfb8d%252Fpa%252FKS86180_b2e8495399f3437464581ae3bbc67188.jpg%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_b2e8495399f3437464581ae3bbc67188.jpg not downloaded yet
2026-01-29 06:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZE61894> (referer: https://www.auto1.com/v1/car-details-view/ZE61894/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_c1ba54dd6c7b858378640586cd02fa09.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_65b7cb02c2380ecb0c8dd4df6305312a.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:35:14 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: XA38892
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XA38892%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for XA38892: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: MY31373
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MY31373%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for MY31373: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: ZJ83781
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZJ83781%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for ZJ83781: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: WP57442
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WP57442%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for WP57442: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: EL44408
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EL44408%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for EL44408: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: XF22317
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XF22317%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for XF22317: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: BH32659
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BH32659%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for BH32659: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: VL38152
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL38152%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for VL38152: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: YW85165
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YW85165%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for YW85165: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: NK03538
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK03538%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for NK03538: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: WX60162
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WX60162%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for WX60162: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: AH39211
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AH39211%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for AH39211: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: ZW89634
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZW89634%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for ZW89634: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: PV63990
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PV63990%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for PV63990: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: NE04890
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NE04890%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for NE04890: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: CX86827
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CX86827%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for CX86827: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: EK80297
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EK80297%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for EK80297: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: JR28426
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JR28426%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for JR28426: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: CP13523
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CP13523%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for CP13523: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: XZ73836
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XZ73836%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for XZ73836: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: AY46158
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AY46158%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for AY46158: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: YL47393
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YL47393%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for YL47393: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: UX87517
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UX87517%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for UX87517: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: BM00974
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BM00974%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for BM00974: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: FP81230
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP81230%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for FP81230: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: XW78046
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XW78046%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for XW78046: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: UP85080
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UP85080%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for UP85080: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: XK76571
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XK76571%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for XK76571: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: JC31662
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JC31662%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for JC31662: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: YC55459
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YC55459%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for YC55459: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: WG92034
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WG92034%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for WG92034: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: CN63835
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN63835%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for CN63835: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: LA97346
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LA97346%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for LA97346: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: AC11008
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AC11008%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for AC11008: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: GU41469
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU41469%27 HTTP/1.1" 200 None
2026-01-29 06:35:14 [auto1.fr] INFO: Scrape type for GU41469: 0
2026-01-29 06:35:14 [auto1.fr] INFO: Found listing with ID: DU79026
2026-01-29 06:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DU79026%27 HTTP/1.1" 200 None
2026-01-29 06:35:15 [auto1.fr] INFO: Scrape type for DU79026: 0
2026-01-29 06:35:15 [auto1.fr] INFO: Found listing with ID: AM74303
2026-01-29 06:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AM74303%27 HTTP/1.1" 200 None
2026-01-29 06:35:15 [auto1.fr] INFO: Scrape type for AM74303: 0
2026-01-29 06:35:15 [auto1.fr] INFO: Found listing with ID: UN51182
2026-01-29 06:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN51182%27 HTTP/1.1" 200 None
2026-01-29 06:35:15 [auto1.fr] INFO: Scrape type for UN51182: 0
2026-01-29 06:35:15 [auto1.fr] INFO: Found listing with ID: SV42549
2026-01-29 06:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV42549%27 HTTP/1.1" 200 None
2026-01-29 06:35:15 [auto1.fr] INFO: Scrape type for SV42549: 0
2026-01-29 06:35:15 [auto1.fr] INFO: Found listing with ID: EK33450
2026-01-29 06:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EK33450%27 HTTP/1.1" 200 None
2026-01-29 06:35:15 [auto1.fr] INFO: Scrape type for EK33450: 0
2026-01-29 06:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_463696f5b52e51e343e5d030de556b59.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_b57ef983a2ae24aeb07056a5cef85f27.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_449f906a15f48d03ad0037358bae3228.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_98a18afa73b5d3fa7fceb4c9e9e06c42.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_371a05b7d7e5d69a633dfbdd568b9efb.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_bb3ce022850945c9e922e3d895550890.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_1fd81a71b25dce3f7f70a4b1810b2710.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_8fe51e3434f283bad88eaf38c0cb5556.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UB86096> (referer: https://www.auto1.com/v1/car-details-view/UB86096/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:35:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:35:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:35:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:35:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:35:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f40c110>
2026-01-29 06:35:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:35:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:35:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:35:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:35:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_113cb9f4-b570-5fc4-9741-96dbb2851e58/113cb9f4-b570-5fc4-9741-96dbb2851e58_image_0.jpg HTTP/1.1" 201 0
2026-01-29 06:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fef%252F4cef5b7da467e7492d0eecf1267cfb8d%252Fpa%252FKS86180_d193b0653b645428c2bbe4af3bdf1e69.jpg') HTTP/1.1" 204 0
2026-01-29 06:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_d193b0653b645428c2bbe4af3bdf1e69.jpg saved to cache
2026-01-29 06:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 113cb9f4-b570-5fc4-9741-96dbb2851e58
2026-01-29 06:35:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02179513-17bf-5c57-9ecd-a1337e8ad7a6 with identifier: ZE61894
2026-01-29 06:35:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02179513-17bf-5c57-9ecd-a1337e8ad7a6 with scrape type 2
2026-01-29 06:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02179513-17bf-5c57-9ecd-a1337e8ad7a6 with scrape type 2
2026-01-29 06:35:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 02179513-17bf-5c57-9ecd-a1337e8ad7a6, identifier: ZE61894
2026-01-29 06:35:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:35:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:35:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:35:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e7c0f2ed0>
2026-01-29 06:35:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:35:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:35:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:35:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:35:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_113cb9f4-b570-5fc4-9741-96dbb2851e58/113cb9f4-b570-5fc4-9741-96dbb2851e58_image_8.jpg HTTP/1.1" 201 0
2026-01-29 06:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fef%252F4cef5b7da467e7492d0eecf1267cfb8d%252Fpa%252FKS86180_c1ba54dd6c7b858378640586cd02fa09.jpg') HTTP/1.1" 204 0
2026-01-29 06:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_c1ba54dd6c7b858378640586cd02fa09.jpg saved to cache
2026-01-29 06:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 113cb9f4-b570-5fc4-9741-96dbb2851e58
2026-01-29 06:35:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:35:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:35:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:35:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6fe807d0>
2026-01-29 06:35:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:35:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:35:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:35:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:35:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_113cb9f4-b570-5fc4-9741-96dbb2851e58/113cb9f4-b570-5fc4-9741-96dbb2851e58_image_1.jpg HTTP/1.1" 201 0
2026-01-29 06:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fef%252F4cef5b7da467e7492d0eecf1267cfb8d%252Fpa%252FKS86180_65b7cb02c2380ecb0c8dd4df6305312a.jpg') HTTP/1.1" 204 0
2026-01-29 06:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_65b7cb02c2380ecb0c8dd4df6305312a.jpg saved to cache
2026-01-29 06:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 113cb9f4-b570-5fc4-9741-96dbb2851e58
2026-01-29 06:35:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 02179513-17bf-5c57-9ecd-a1337e8ad7a6 with identifier: ZE61894
2026-01-29 06:35:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 02179513-17bf-5c57-9ecd-a1337e8ad7a6 with identifier: ZE61894
2026-01-29 06:35:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 02179513-17bf-5c57-9ecd-a1337e8ad7a6 with identifier: ZE61894 to the API
2026-01-29 06:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:35:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:35:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZE61894>
{'auction_title': '',
 'c_o_2_emission_value': 56,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 392,
 'expiration_date': '2026-01-29T16:29:54Z',
 'fuel_type': 'hybrid',
 'id': '02179513-17bf-5c57-9ecd-a1337e8ad7a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE61894',
 'listing': 'auction',
 'location': 'FR, Saint-Maximin',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 148893,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-05-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T8 Plug-in Hybrid Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2020}
2026-01-29 06:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZE61894%27 HTTP/1.1" 200 None
2026-01-29 06:35:16 [auto1.fr] INFO: Saving data for ZE61894: {'auction_closing_time': 1769704194.0, 'created_time': 1769533945.88972, 'last_price_update_time': 1769668516.885958}
2026-01-29 06:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZE61894') HTTP/1.1" 204 0
2026-01-29 06:35:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_640a26b6d36196e9acfab23eebbb5d90.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:35:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_f4a613f0fcce39d4b1db4950578a2547.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:35:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_22a4331f5fa39fda909e3190f50ddf42.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:35:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_b2e8495399f3437464581ae3bbc67188.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:35:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_e3ecc50de76160b0060c3a06d76fd2b3.jpg> (referer: https://www.auto1.com/)
2026-01-29 06:35:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:35:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:35:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:35:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6fe15f50>
2026-01-29 06:35:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:35:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:35:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:35:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:35:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_113cb9f4-b570-5fc4-9741-96dbb2851e58/113cb9f4-b570-5fc4-9741-96dbb2851e58_image_9.jpg HTTP/1.1" 201 0
2026-01-29 06:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fef%252F4cef5b7da467e7492d0eecf1267cfb8d%252Fpa%252FKS86180_463696f5b52e51e343e5d030de556b59.jpg') HTTP/1.1" 204 0
2026-01-29 06:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_463696f5b52e51e343e5d030de556b59.jpg saved to cache
2026-01-29 06:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 113cb9f4-b570-5fc4-9741-96dbb2851e58
2026-01-29 06:35:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:35:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:35:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:35:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff69090>
2026-01-29 06:35:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:35:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-29 06:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:35:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:35:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:35:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_113cb9f4-b570-5fc4-9741-96dbb2851e58/113cb9f4-b570-5fc4-9741-96dbb2851e58_image_10.jpg HTTP/1.1" 201 0
2026-01-29 06:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fef%252F4cef5b7da467e7492d0eecf1267cfb8d%252Fpa%252FKS86180_b57ef983a2ae24aeb07056a5cef85f27.jpg') HTTP/1.1" 204 0
2026-01-29 06:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_b57ef983a2ae24aeb07056a5cef85f27.jpg saved to cache
2026-01-29 06:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 113cb9f4-b570-5fc4-9741-96dbb2851e58
2026-01-29 06:35:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:35:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:35:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:35:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f3a8950>
2026-01-29 06:35:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:35:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:35:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:35:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:35:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_113cb9f4-b570-5fc4-9741-96dbb2851e58/113cb9f4-b570-5fc4-9741-96dbb2851e58_image_5.jpg HTTP/1.1" 201 0
2026-01-29 06:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fef%252F4cef5b7da467e7492d0eecf1267cfb8d%252Fpa%252FKS86180_449f906a15f48d03ad0037358bae3228.jpg') HTTP/1.1" 204 0
2026-01-29 06:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_449f906a15f48d03ad0037358bae3228.jpg saved to cache
2026-01-29 06:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 113cb9f4-b570-5fc4-9741-96dbb2851e58
2026-01-29 06:35:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:35:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:35:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:35:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6fe14790>
2026-01-29 06:35:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:35:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:35:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_113cb9f4-b570-5fc4-9741-96dbb2851e58/113cb9f4-b570-5fc4-9741-96dbb2851e58_image_3.jpg HTTP/1.1" 201 0
2026-01-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fef%252F4cef5b7da467e7492d0eecf1267cfb8d%252Fpa%252FKS86180_98a18afa73b5d3fa7fceb4c9e9e06c42.jpg') HTTP/1.1" 204 0
2026-01-29 06:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_98a18afa73b5d3fa7fceb4c9e9e06c42.jpg saved to cache
2026-01-29 06:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 113cb9f4-b570-5fc4-9741-96dbb2851e58
2026-01-29 06:35:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:35:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:35:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:35:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6fe60c10>
2026-01-29 06:35:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:35:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:35:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_113cb9f4-b570-5fc4-9741-96dbb2851e58/113cb9f4-b570-5fc4-9741-96dbb2851e58_image_6.jpg HTTP/1.1" 201 0
2026-01-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fef%252F4cef5b7da467e7492d0eecf1267cfb8d%252Fpa%252FKS86180_371a05b7d7e5d69a633dfbdd568b9efb.jpg') HTTP/1.1" 204 0
2026-01-29 06:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_371a05b7d7e5d69a633dfbdd568b9efb.jpg saved to cache
2026-01-29 06:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 113cb9f4-b570-5fc4-9741-96dbb2851e58
2026-01-29 06:35:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:35:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:35:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:35:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff6a790>
2026-01-29 06:35:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:35:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:35:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_113cb9f4-b570-5fc4-9741-96dbb2851e58/113cb9f4-b570-5fc4-9741-96dbb2851e58_image_4.jpg HTTP/1.1" 201 0
2026-01-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fef%252F4cef5b7da467e7492d0eecf1267cfb8d%252Fpa%252FKS86180_bb3ce022850945c9e922e3d895550890.jpg') HTTP/1.1" 204 0
2026-01-29 06:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_bb3ce022850945c9e922e3d895550890.jpg saved to cache
2026-01-29 06:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 113cb9f4-b570-5fc4-9741-96dbb2851e58
2026-01-29 06:35:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:35:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:35:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:35:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ffcaa50>
2026-01-29 06:35:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:35:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:35:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_113cb9f4-b570-5fc4-9741-96dbb2851e58/113cb9f4-b570-5fc4-9741-96dbb2851e58_image_2.jpg HTTP/1.1" 201 0
2026-01-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fef%252F4cef5b7da467e7492d0eecf1267cfb8d%252Fpa%252FKS86180_1fd81a71b25dce3f7f70a4b1810b2710.jpg') HTTP/1.1" 204 0
2026-01-29 06:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_1fd81a71b25dce3f7f70a4b1810b2710.jpg saved to cache
2026-01-29 06:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 113cb9f4-b570-5fc4-9741-96dbb2851e58
2026-01-29 06:35:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:35:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:35:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:35:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f4ba290>
2026-01-29 06:35:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:35:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:35:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_113cb9f4-b570-5fc4-9741-96dbb2851e58/113cb9f4-b570-5fc4-9741-96dbb2851e58_image_7.jpg HTTP/1.1" 201 0
2026-01-29 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fef%252F4cef5b7da467e7492d0eecf1267cfb8d%252Fpa%252FKS86180_8fe51e3434f283bad88eaf38c0cb5556.jpg') HTTP/1.1" 204 0
2026-01-29 06:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_8fe51e3434f283bad88eaf38c0cb5556.jpg saved to cache
2026-01-29 06:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 113cb9f4-b570-5fc4-9741-96dbb2851e58
2026-01-29 06:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52cfbbe0-39ab-5e5b-b7ef-deed57dd65c4 with identifier: UB86096
2026-01-29 06:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52cfbbe0-39ab-5e5b-b7ef-deed57dd65c4 with scrape type 2
2026-01-29 06:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52cfbbe0-39ab-5e5b-b7ef-deed57dd65c4 with scrape type 2
2026-01-29 06:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 52cfbbe0-39ab-5e5b-b7ef-deed57dd65c4, identifier: UB86096
2026-01-29 06:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 52cfbbe0-39ab-5e5b-b7ef-deed57dd65c4 with identifier: UB86096
2026-01-29 06:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 52cfbbe0-39ab-5e5b-b7ef-deed57dd65c4 with identifier: UB86096
2026-01-29 06:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 52cfbbe0-39ab-5e5b-b7ef-deed57dd65c4 with identifier: UB86096 to the API
2026-01-29 06:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UB86096>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:20:46Z',
 'fuel_type': 'petrol',
 'id': '52cfbbe0-39ab-5e5b-b7ef-deed57dd65c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB86096',
 'listing': 'auction',
 'location': 'FR, Beaucaire',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 84780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500X 1.4 Turbo City Cross',
 'transmission': 'automatic',
 'trim': 'City Cross',
 'year': 2018}
2026-01-29 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UB86096%27 HTTP/1.1" 200 None
2026-01-29 06:35:19 [auto1.fr] INFO: Saving data for UB86096: {'auction_closing_time': 1769703646.0, 'created_time': 1767028275.671574, 'last_price_update_time': 1769668519.548864}
2026-01-29 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UB86096') HTTP/1.1" 204 0
2026-01-29 06:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:35:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:35:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:35:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:35:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ffb2990>
2026-01-29 06:35:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:35:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:35:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_113cb9f4-b570-5fc4-9741-96dbb2851e58/113cb9f4-b570-5fc4-9741-96dbb2851e58_image_11.jpg HTTP/1.1" 201 0
2026-01-29 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fef%252F4cef5b7da467e7492d0eecf1267cfb8d%252Fpa%252FKS86180_640a26b6d36196e9acfab23eebbb5d90.jpg') HTTP/1.1" 204 0
2026-01-29 06:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_640a26b6d36196e9acfab23eebbb5d90.jpg saved to cache
2026-01-29 06:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 113cb9f4-b570-5fc4-9741-96dbb2851e58
2026-01-29 06:35:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:35:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:35:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:35:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6fe5c710>
2026-01-29 06:35:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:35:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-29 06:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:35:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_113cb9f4-b570-5fc4-9741-96dbb2851e58/113cb9f4-b570-5fc4-9741-96dbb2851e58_image_12.jpg HTTP/1.1" 201 0
2026-01-29 06:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fef%252F4cef5b7da467e7492d0eecf1267cfb8d%252Fpa%252FKS86180_f4a613f0fcce39d4b1db4950578a2547.jpg') HTTP/1.1" 204 0
2026-01-29 06:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_f4a613f0fcce39d4b1db4950578a2547.jpg saved to cache
2026-01-29 06:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 113cb9f4-b570-5fc4-9741-96dbb2851e58
2026-01-29 06:35:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:35:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:35:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:35:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff65750>
2026-01-29 06:35:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:35:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-29 06:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:35:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_113cb9f4-b570-5fc4-9741-96dbb2851e58/113cb9f4-b570-5fc4-9741-96dbb2851e58_image_13.jpg HTTP/1.1" 201 0
2026-01-29 06:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fef%252F4cef5b7da467e7492d0eecf1267cfb8d%252Fpa%252FKS86180_22a4331f5fa39fda909e3190f50ddf42.jpg') HTTP/1.1" 204 0
2026-01-29 06:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_22a4331f5fa39fda909e3190f50ddf42.jpg saved to cache
2026-01-29 06:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 113cb9f4-b570-5fc4-9741-96dbb2851e58
2026-01-29 06:35:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:35:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:35:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:35:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6ff80b90>
2026-01-29 06:35:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:35:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-29 06:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:35:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_113cb9f4-b570-5fc4-9741-96dbb2851e58/113cb9f4-b570-5fc4-9741-96dbb2851e58_image_15.jpg HTTP/1.1" 201 0
2026-01-29 06:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fef%252F4cef5b7da467e7492d0eecf1267cfb8d%252Fpa%252FKS86180_b2e8495399f3437464581ae3bbc67188.jpg') HTTP/1.1" 204 0
2026-01-29 06:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_b2e8495399f3437464581ae3bbc67188.jpg saved to cache
2026-01-29 06:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 113cb9f4-b570-5fc4-9741-96dbb2851e58
2026-01-29 06:35:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-29 06:35:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-29 06:35:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-29 06:35:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6f3f7510>
2026-01-29 06:35:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-29 06:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-29 06:35:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-29 06:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-29 06:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-29 06:35:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-29 06:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_113cb9f4-b570-5fc4-9741-96dbb2851e58/113cb9f4-b570-5fc4-9741-96dbb2851e58_image_14.jpg HTTP/1.1" 201 0
2026-01-29 06:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fef%252F4cef5b7da467e7492d0eecf1267cfb8d%252Fpa%252FKS86180_e3ecc50de76160b0060c3a06d76fd2b3.jpg') HTTP/1.1" 204 0
2026-01-29 06:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_e3ecc50de76160b0060c3a06d76fd2b3.jpg saved to cache
2026-01-29 06:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 113cb9f4-b570-5fc4-9741-96dbb2851e58
2026-01-29 06:35:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 113cb9f4-b570-5fc4-9741-96dbb2851e58, skipping ID generation
2026-01-29 06:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 113cb9f4-b570-5fc4-9741-96dbb2851e58 with scrape type 1
2026-01-29 06:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 113cb9f4-b570-5fc4-9741-96dbb2851e58 from tracking dictionaries
2026-01-29 06:35:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 113cb9f4-b570-5fc4-9741-96dbb2851e58 sending to next pipeline
2026-01-29 06:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 113cb9f4-b570-5fc4-9741-96dbb2851e58, identifier: KS86180
2026-01-29 06:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 113cb9f4-b570-5fc4-9741-96dbb2851e58 with identifier: KS86180
2026-01-29 06:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 113cb9f4-b570-5fc4-9741-96dbb2851e58 with identifier: KS86180
2026-01-29 06:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 113cb9f4-b570-5fc4-9741-96dbb2851e58 with identifier: KS86180 to the API
2026-01-29 06:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-29 06:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_e3ecc50de76160b0060c3a06d76fd2b3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:44:00Z',
 'fuel_type': 'diesel',
 'id': '113cb9f4-b570-5fc4-9741-96dbb2851e58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS86180',
 'listing': 'auction',
 'location': 'FR, Montévrain',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 125065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_113cb9f4-b570-5fc4-9741-96dbb2851e58/113cb9f4-b570-5fc4-9741-96dbb2851e58_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_d193b0653b645428c2bbe4af3bdf1e69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_113cb9f4-b570-5fc4-9741-96dbb2851e58/113cb9f4-b570-5fc4-9741-96dbb2851e58_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_65b7cb02c2380ecb0c8dd4df6305312a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_113cb9f4-b570-5fc4-9741-96dbb2851e58/113cb9f4-b570-5fc4-9741-96dbb2851e58_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_1fd81a71b25dce3f7f70a4b1810b2710.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_113cb9f4-b570-5fc4-9741-96dbb2851e58/113cb9f4-b570-5fc4-9741-96dbb2851e58_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53124,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_98a18afa73b5d3fa7fceb4c9e9e06c42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_113cb9f4-b570-5fc4-9741-96dbb2851e58/113cb9f4-b570-5fc4-9741-96dbb2851e58_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57539,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_bb3ce022850945c9e922e3d895550890.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_113cb9f4-b570-5fc4-9741-96dbb2851e58/113cb9f4-b570-5fc4-9741-96dbb2851e58_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_449f906a15f48d03ad0037358bae3228.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_113cb9f4-b570-5fc4-9741-96dbb2851e58/113cb9f4-b570-5fc4-9741-96dbb2851e58_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_371a05b7d7e5d69a633dfbdd568b9efb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_113cb9f4-b570-5fc4-9741-96dbb2851e58/113cb9f4-b570-5fc4-9741-96dbb2851e58_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_8fe51e3434f283bad88eaf38c0cb5556.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_113cb9f4-b570-5fc4-9741-96dbb2851e58/113cb9f4-b570-5fc4-9741-96dbb2851e58_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_c1ba54dd6c7b858378640586cd02fa09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_113cb9f4-b570-5fc4-9741-96dbb2851e58/113cb9f4-b570-5fc4-9741-96dbb2851e58_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_463696f5b52e51e343e5d030de556b59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_113cb9f4-b570-5fc4-9741-96dbb2851e58/113cb9f4-b570-5fc4-9741-96dbb2851e58_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_b57ef983a2ae24aeb07056a5cef85f27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_113cb9f4-b570-5fc4-9741-96dbb2851e58/113cb9f4-b570-5fc4-9741-96dbb2851e58_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_640a26b6d36196e9acfab23eebbb5d90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_113cb9f4-b570-5fc4-9741-96dbb2851e58/113cb9f4-b570-5fc4-9741-96dbb2851e58_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_f4a613f0fcce39d4b1db4950578a2547.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_113cb9f4-b570-5fc4-9741-96dbb2851e58/113cb9f4-b570-5fc4-9741-96dbb2851e58_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41862,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_22a4331f5fa39fda909e3190f50ddf42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_113cb9f4-b570-5fc4-9741-96dbb2851e58/113cb9f4-b570-5fc4-9741-96dbb2851e58_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_e3ecc50de76160b0060c3a06d76fd2b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_113cb9f4-b570-5fc4-9741-96dbb2851e58/113cb9f4-b570-5fc4-9741-96dbb2851e58_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/ef/4cef5b7da467e7492d0eecf1267cfb8d/pa/KS86180_b2e8495399f3437464581ae3bbc67188.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Tarraco 2.0 TDI Style Business',
 'transmission': 'manual',
 'trim': 'Style Business',
 'year': 2019}
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KS86180%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Saving data for KS86180: {'created_time': 1769668521.28621, 'last_price_update_time': 1769668521.28622, 'auction_closing_time': 1769705040.0}
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KS86180') HTTP/1.1" 204 0
2026-01-29 06:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:35:21 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: VH95693
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VH95693%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for VH95693: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: CM07645
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CM07645%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for CM07645: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: BS72923
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BS72923%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for BS72923: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: LT13336
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LT13336%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for LT13336: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: JF95375
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JF95375%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for JF95375: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: NU66542
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NU66542%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for NU66542: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: EW17962
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW17962%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for EW17962: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: TN33478
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TN33478%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for TN33478: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: HS40271
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HS40271%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for HS40271: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: MX37095
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MX37095%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for MX37095: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: UY28904
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY28904%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for UY28904: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: NN66074
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NN66074%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for NN66074: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: ZR96547
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZR96547%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for ZR96547: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: DY54398
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DY54398%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for DY54398: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: UM29577
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UM29577%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for UM29577: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: AZ46462
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AZ46462%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for AZ46462: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: EW27799
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW27799%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for EW27799: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: PD12775
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PD12775%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for PD12775: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: UH72294
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UH72294%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for UH72294: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: KH13643
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH13643%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for KH13643: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: UY60904
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY60904%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for UY60904: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: DR66532
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DR66532%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for DR66532: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: FK45009
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FK45009%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for FK45009: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: FC82058
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FC82058%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for FC82058: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: DS69215
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS69215%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for DS69215: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: AV65681
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV65681%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for AV65681: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: TB54834
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TB54834%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for TB54834: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: EH62320
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EH62320%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for EH62320: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: HR91351
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HR91351%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for HR91351: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: LX91502
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LX91502%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for LX91502: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: FB62752
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB62752%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for FB62752: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: HX90052
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HX90052%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for HX90052: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: VM47760
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VM47760%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for VM47760: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: ZL70934
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZL70934%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for ZL70934: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: RW63564
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RW63564%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for RW63564: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: CA63176
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA63176%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for CA63176: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: TC84755
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TC84755%27 HTTP/1.1" 200 None
2026-01-29 06:35:21 [auto1.fr] INFO: Scrape type for TC84755: 0
2026-01-29 06:35:21 [auto1.fr] INFO: Found listing with ID: TP38479
2026-01-29 06:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TP38479%27 HTTP/1.1" 200 None
2026-01-29 06:35:22 [auto1.fr] INFO: Scrape type for TP38479: 0
2026-01-29 06:35:22 [auto1.fr] INFO: Found listing with ID: BG77652
2026-01-29 06:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BG77652%27 HTTP/1.1" 200 None
2026-01-29 06:35:22 [auto1.fr] INFO: Scrape type for BG77652: 0
2026-01-29 06:35:22 [auto1.fr] INFO: Found listing with ID: SK69216
2026-01-29 06:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SK69216%27 HTTP/1.1" 200 None
2026-01-29 06:35:22 [auto1.fr] INFO: Scrape type for SK69216: 0
2026-01-29 06:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VE14391/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:35:23 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: WH17871
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WH17871%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for WH17871: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: VB07449
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VB07449%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for VB07449: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: CN38591
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN38591%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for CN38591: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: LF05392
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LF05392%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for LF05392: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: RK01485
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RK01485%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for RK01485: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: GU34210
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU34210%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for GU34210: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: PP53975
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PP53975%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for PP53975: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: LP38825
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LP38825%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for LP38825: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: MR01547
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR01547%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for MR01547: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: YS15102
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS15102%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for YS15102: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: FM36212
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FM36212%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for FM36212: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: AA51941
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AA51941%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for AA51941: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: XP35124
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XP35124%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for XP35124: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: XH97002
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XH97002%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for XH97002: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: JD87882
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD87882%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for JD87882: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: UN90268
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN90268%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for UN90268: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: AS85264
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AS85264%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for AS85264: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: FJ17647
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ17647%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for FJ17647: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: PX65540
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX65540%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for PX65540: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: TP34796
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TP34796%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for TP34796: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: AP47584
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AP47584%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for AP47584: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: JY89585
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JY89585%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for JY89585: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: XB32036
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB32036%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for XB32036: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: SB76672
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SB76672%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for SB76672: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: YW54122
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YW54122%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for YW54122: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: JX26970
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JX26970%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for JX26970: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: VR86188
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VR86188%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for VR86188: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: ZG09341
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG09341%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for ZG09341: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: WF89363
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WF89363%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for WF89363: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: DG37411
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DG37411%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for DG37411: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: KL29839
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KL29839%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for KL29839: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: VK55492
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VK55492%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for VK55492: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: TL61293
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TL61293%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for TL61293: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: KS75693
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KS75693%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for KS75693: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: ZB24070
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZB24070%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for ZB24070: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: RJ80286
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RJ80286%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for RJ80286: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: PC25135
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PC25135%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for PC25135: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: WT45602
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WT45602%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for WT45602: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: AH83568
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AH83568%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for AH83568: 0
2026-01-29 06:35:23 [auto1.fr] INFO: Found listing with ID: FM46505
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FM46505%27 HTTP/1.1" 200 None
2026-01-29 06:35:23 [auto1.fr] INFO: Scrape type for FM46505: 0
2026-01-29 06:35:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VE14391> (referer: https://www.auto1.com/v1/car-details-view/VE14391/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79744856-aa66-5653-80f9-988d3c157236 with identifier: VE14391
2026-01-29 06:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79744856-aa66-5653-80f9-988d3c157236 with scrape type 2
2026-01-29 06:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79744856-aa66-5653-80f9-988d3c157236 with scrape type 2
2026-01-29 06:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 79744856-aa66-5653-80f9-988d3c157236, identifier: VE14391
2026-01-29 06:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 79744856-aa66-5653-80f9-988d3c157236 with identifier: VE14391
2026-01-29 06:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 79744856-aa66-5653-80f9-988d3c157236 with identifier: VE14391
2026-01-29 06:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 164748 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164748
2026-01-29 06:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 79744856-aa66-5653-80f9-988d3c157236 spider: auto1.fr
2026-01-29 06:35:24 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 79744856-aa66-5653-80f9-988d3c157236 due to rule: high_mileage_for_country.json, error: 164748 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164748
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 194,
 'expiration_date': '2026-01-29T16:07:06Z',
 'fuel_type': 'diesel',
 'id': '79744856-aa66-5653-80f9-988d3c157236',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE14391',
 'listing': 'auction',
 'location': 'FR, Nanteuil-le-Haudouin',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 164748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic Launch Edition AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic Launch Edition AMG Line',
 'year': 2020}
2026-01-29 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VE14391%27 HTTP/1.1" 200 None
2026-01-29 06:35:24 [auto1.fr] INFO: Saving data for VE14391: {'auction_closing_time': 1769702826.0, 'created_time': 1769190355.183957, 'last_price_update_time': 1769668524.38315}
2026-01-29 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VE14391') HTTP/1.1" 204 0
2026-01-29 06:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:35:25 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: DV15715
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DV15715%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for DV15715: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: ES11937
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ES11937%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for ES11937: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: MK29781
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MK29781%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for MK29781: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: DW34775
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DW34775%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for DW34775: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: MK56946
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MK56946%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for MK56946: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: BG29662
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BG29662%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for BG29662: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: LX24086
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LX24086%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for LX24086: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: BM46004
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BM46004%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for BM46004: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: HT43976
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HT43976%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for HT43976: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: YL24928
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YL24928%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for YL24928: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: VL02976
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL02976%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for VL02976: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: VR57676
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VR57676%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for VR57676: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: DY96298
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DY96298%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for DY96298: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: JJ07002
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ07002%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for JJ07002: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: JW00237
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JW00237%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for JW00237: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: KF31273
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KF31273%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for KF31273: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: YJ72599
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YJ72599%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for YJ72599: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: CM41275
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CM41275%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for CM41275: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: TH97782
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TH97782%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for TH97782: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: JK48409
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JK48409%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for JK48409: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: JX43519
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JX43519%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for JX43519: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: YZ27152
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YZ27152%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for YZ27152: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: MX08769
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MX08769%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for MX08769: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: NT46153
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NT46153%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for NT46153: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: YJ53874
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YJ53874%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for YJ53874: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: ER48331
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER48331%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for ER48331: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: WH46469
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WH46469%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for WH46469: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: SD89556
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SD89556%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for SD89556: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: GN94518
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN94518%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for GN94518: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: BY39051
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BY39051%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for BY39051: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: VS33782
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS33782%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for VS33782: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: EB26316
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EB26316%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for EB26316: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: WD91498
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD91498%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for WD91498: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: AC35526
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AC35526%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for AC35526: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: HV55669
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HV55669%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for HV55669: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: PD13190
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PD13190%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for PD13190: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: NE51100
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NE51100%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for NE51100: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: TA58454
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA58454%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for TA58454: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: VG71674
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG71674%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for VG71674: 0
2026-01-29 06:35:25 [auto1.fr] INFO: Found listing with ID: GE41720
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GE41720%27 HTTP/1.1" 200 None
2026-01-29 06:35:25 [auto1.fr] INFO: Scrape type for GE41720: 0
2026-01-29 06:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:35:27 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: GE37094
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GE37094%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for GE37094: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: AJ51766
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AJ51766%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for AJ51766: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: LU25018
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LU25018%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for LU25018: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: TX14430
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TX14430%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for TX14430: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: MZ36500
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MZ36500%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for MZ36500: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: CY40977
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY40977%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for CY40977: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: AW11536
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW11536%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for AW11536: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: PH55853
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH55853%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for PH55853: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: YC76006
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YC76006%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for YC76006: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: MG44909
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG44909%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for MG44909: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: NR61128
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NR61128%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for NR61128: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: VD09967
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VD09967%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for VD09967: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: VL63699
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL63699%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for VL63699: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: SD60615
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SD60615%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for SD60615: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: JN30743
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JN30743%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for JN30743: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: NL05552
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NL05552%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for NL05552: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: VX08742
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX08742%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for VX08742: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: MT88865
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MT88865%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for MT88865: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: UG01432
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG01432%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for UG01432: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: NK49014
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK49014%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for NK49014: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: RM00765
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM00765%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for RM00765: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: HY25652
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HY25652%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for HY25652: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: SB14036
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SB14036%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for SB14036: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: TU55163
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU55163%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for TU55163: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: RC57881
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RC57881%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for RC57881: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: HT37765
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HT37765%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for HT37765: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: PS80966
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PS80966%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for PS80966: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: ZX21764
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZX21764%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for ZX21764: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: DU03626
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DU03626%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for DU03626: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: LN00651
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LN00651%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for LN00651: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: RV23368
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RV23368%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for RV23368: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: LF26749
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LF26749%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for LF26749: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: KU16016
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KU16016%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for KU16016: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: MV78102
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MV78102%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for MV78102: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: VD35956
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VD35956%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for VD35956: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: ZB26410
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZB26410%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for ZB26410: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: CF60678
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CF60678%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for CF60678: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: GT68103
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GT68103%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for GT68103: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: NE57198
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NE57198%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for NE57198: 0
2026-01-29 06:35:27 [auto1.fr] INFO: Found listing with ID: PF54589
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF54589%27 HTTP/1.1" 200 None
2026-01-29 06:35:27 [auto1.fr] INFO: Scrape type for PF54589: 0
2026-01-29 06:35:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:35:28 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:35:28 [auto1.fr] INFO: Found listing with ID: NH91254
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH91254%27 HTTP/1.1" 200 None
2026-01-29 06:35:28 [auto1.fr] INFO: Scrape type for NH91254: 0
2026-01-29 06:35:28 [auto1.fr] INFO: Found listing with ID: CL41101
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CL41101%27 HTTP/1.1" 200 None
2026-01-29 06:35:28 [auto1.fr] INFO: Scrape type for CL41101: 0
2026-01-29 06:35:28 [auto1.fr] INFO: Found listing with ID: EG09120
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EG09120%27 HTTP/1.1" 200 None
2026-01-29 06:35:28 [auto1.fr] INFO: Scrape type for EG09120: 0
2026-01-29 06:35:28 [auto1.fr] INFO: Found listing with ID: WV79747
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WV79747%27 HTTP/1.1" 200 None
2026-01-29 06:35:28 [auto1.fr] INFO: Scrape type for WV79747: 0
2026-01-29 06:35:28 [auto1.fr] INFO: Found listing with ID: VU29735
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VU29735%27 HTTP/1.1" 200 None
2026-01-29 06:35:28 [auto1.fr] INFO: Scrape type for VU29735: 0
2026-01-29 06:35:28 [auto1.fr] INFO: Found listing with ID: FJ48710
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ48710%27 HTTP/1.1" 200 None
2026-01-29 06:35:28 [auto1.fr] INFO: Scrape type for FJ48710: 0
2026-01-29 06:35:28 [auto1.fr] INFO: Found listing with ID: XS61976
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XS61976%27 HTTP/1.1" 200 None
2026-01-29 06:35:28 [auto1.fr] INFO: Scrape type for XS61976: 0
2026-01-29 06:35:28 [auto1.fr] INFO: Found listing with ID: YR21863
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YR21863%27 HTTP/1.1" 200 None
2026-01-29 06:35:28 [auto1.fr] INFO: Scrape type for YR21863: 0
2026-01-29 06:35:28 [auto1.fr] INFO: Found listing with ID: WA70990
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WA70990%27 HTTP/1.1" 200 None
2026-01-29 06:35:28 [auto1.fr] INFO: Scrape type for WA70990: 0
2026-01-29 06:35:28 [auto1.fr] INFO: Found listing with ID: KK58978
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KK58978%27 HTTP/1.1" 200 None
2026-01-29 06:35:28 [auto1.fr] INFO: Scrape type for KK58978: 0
2026-01-29 06:35:28 [auto1.fr] INFO: Found listing with ID: HB74151
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HB74151%27 HTTP/1.1" 200 None
2026-01-29 06:35:28 [auto1.fr] INFO: Scrape type for HB74151: 0
2026-01-29 06:35:28 [auto1.fr] INFO: Found listing with ID: UR93515
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UR93515%27 HTTP/1.1" 200 None
2026-01-29 06:35:28 [auto1.fr] INFO: Scrape type for UR93515: 0
2026-01-29 06:35:28 [auto1.fr] INFO: Found listing with ID: WF92822
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WF92822%27 HTTP/1.1" 200 None
2026-01-29 06:35:28 [auto1.fr] INFO: Scrape type for WF92822: 0
2026-01-29 06:35:28 [auto1.fr] INFO: Found listing with ID: JA38159
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA38159%27 HTTP/1.1" 200 None
2026-01-29 06:35:28 [auto1.fr] INFO: Scrape type for JA38159: 0
2026-01-29 06:35:28 [auto1.fr] INFO: Found listing with ID: EK93825
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EK93825%27 HTTP/1.1" 200 None
2026-01-29 06:35:28 [auto1.fr] INFO: Scrape type for EK93825: 0
2026-01-29 06:35:28 [auto1.fr] INFO: Found listing with ID: YN55277
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YN55277%27 HTTP/1.1" 200 None
2026-01-29 06:35:28 [auto1.fr] INFO: Scrape type for YN55277: 0
2026-01-29 06:35:28 [auto1.fr] INFO: Found listing with ID: NS46617
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NS46617%27 HTTP/1.1" 200 None
2026-01-29 06:35:28 [auto1.fr] INFO: Scrape type for NS46617: 0
2026-01-29 06:35:28 [auto1.fr] INFO: Found listing with ID: NG22672
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NG22672%27 HTTP/1.1" 200 None
2026-01-29 06:35:28 [auto1.fr] INFO: Scrape type for NG22672: 0
2026-01-29 06:35:28 [auto1.fr] INFO: Found listing with ID: DA12130
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DA12130%27 HTTP/1.1" 200 None
2026-01-29 06:35:28 [auto1.fr] INFO: Scrape type for DA12130: 0
2026-01-29 06:35:28 [auto1.fr] INFO: Found listing with ID: FR17724
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FR17724%27 HTTP/1.1" 200 None
2026-01-29 06:35:29 [auto1.fr] INFO: Scrape type for FR17724: 0
2026-01-29 06:35:29 [auto1.fr] INFO: Found listing with ID: SU72670
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SU72670%27 HTTP/1.1" 200 None
2026-01-29 06:35:29 [auto1.fr] INFO: Scrape type for SU72670: 0
2026-01-29 06:35:29 [auto1.fr] INFO: Found listing with ID: UA66317
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UA66317%27 HTTP/1.1" 200 None
2026-01-29 06:35:29 [auto1.fr] INFO: Scrape type for UA66317: 0
2026-01-29 06:35:29 [auto1.fr] INFO: Found listing with ID: KN09669
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KN09669%27 HTTP/1.1" 200 None
2026-01-29 06:35:29 [auto1.fr] INFO: Scrape type for KN09669: 0
2026-01-29 06:35:29 [auto1.fr] INFO: Found listing with ID: EC56032
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EC56032%27 HTTP/1.1" 200 None
2026-01-29 06:35:29 [auto1.fr] INFO: Scrape type for EC56032: 0
2026-01-29 06:35:29 [auto1.fr] INFO: Found listing with ID: SY07488
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SY07488%27 HTTP/1.1" 200 None
2026-01-29 06:35:29 [auto1.fr] INFO: Scrape type for SY07488: 0
2026-01-29 06:35:29 [auto1.fr] INFO: Found listing with ID: JK31167
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JK31167%27 HTTP/1.1" 200 None
2026-01-29 06:35:29 [auto1.fr] INFO: Scrape type for JK31167: 0
2026-01-29 06:35:29 [auto1.fr] INFO: Found listing with ID: YB14557
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YB14557%27 HTTP/1.1" 200 None
2026-01-29 06:35:29 [auto1.fr] INFO: Scrape type for YB14557: 0
2026-01-29 06:35:29 [auto1.fr] INFO: Found listing with ID: WW48096
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WW48096%27 HTTP/1.1" 200 None
2026-01-29 06:35:29 [auto1.fr] INFO: Scrape type for WW48096: 0
2026-01-29 06:35:29 [auto1.fr] INFO: Found listing with ID: LY52199
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LY52199%27 HTTP/1.1" 200 None
2026-01-29 06:35:29 [auto1.fr] INFO: Scrape type for LY52199: 0
2026-01-29 06:35:29 [auto1.fr] INFO: Found listing with ID: CU00048
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CU00048%27 HTTP/1.1" 200 None
2026-01-29 06:35:29 [auto1.fr] INFO: Scrape type for CU00048: 0
2026-01-29 06:35:29 [auto1.fr] INFO: Found listing with ID: SF31026
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF31026%27 HTTP/1.1" 200 None
2026-01-29 06:35:29 [auto1.fr] INFO: Scrape type for SF31026: 0
2026-01-29 06:35:29 [auto1.fr] INFO: Found listing with ID: TK58493
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TK58493%27 HTTP/1.1" 200 None
2026-01-29 06:35:29 [auto1.fr] INFO: Scrape type for TK58493: 0
2026-01-29 06:35:29 [auto1.fr] INFO: Found listing with ID: TR97595
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TR97595%27 HTTP/1.1" 200 None
2026-01-29 06:35:29 [auto1.fr] INFO: Scrape type for TR97595: 0
2026-01-29 06:35:29 [auto1.fr] INFO: Found listing with ID: JT31670
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JT31670%27 HTTP/1.1" 200 None
2026-01-29 06:35:29 [auto1.fr] INFO: Scrape type for JT31670: 0
2026-01-29 06:35:29 [auto1.fr] INFO: Found listing with ID: TW19996
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TW19996%27 HTTP/1.1" 200 None
2026-01-29 06:35:29 [auto1.fr] INFO: Scrape type for TW19996: 0
2026-01-29 06:35:29 [auto1.fr] INFO: Found listing with ID: ZH13637
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZH13637%27 HTTP/1.1" 200 None
2026-01-29 06:35:29 [auto1.fr] INFO: Scrape type for ZH13637: 0
2026-01-29 06:35:29 [auto1.fr] INFO: Found listing with ID: HA48489
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HA48489%27 HTTP/1.1" 200 None
2026-01-29 06:35:29 [auto1.fr] INFO: Scrape type for HA48489: 0
2026-01-29 06:35:29 [auto1.fr] INFO: Found listing with ID: MM96453
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MM96453%27 HTTP/1.1" 200 None
2026-01-29 06:35:29 [auto1.fr] INFO: Scrape type for MM96453: 0
2026-01-29 06:35:29 [auto1.fr] INFO: Found listing with ID: YU47350
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YU47350%27 HTTP/1.1" 200 None
2026-01-29 06:35:29 [auto1.fr] INFO: Scrape type for YU47350: 0
2026-01-29 06:35:29 [auto1.fr] INFO: Found listing with ID: LN48629
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LN48629%27 HTTP/1.1" 200 None
2026-01-29 06:35:29 [auto1.fr] INFO: Scrape type for LN48629: 0
2026-01-29 06:35:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:35:30 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: ZK60522
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZK60522%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for ZK60522: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: PD83362
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PD83362%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for PD83362: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: XN94206
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XN94206%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for XN94206: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: PJ74823
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PJ74823%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for PJ74823: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: GY38265
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GY38265%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for GY38265: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: CJ11142
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CJ11142%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for CJ11142: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: TE61861
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TE61861%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for TE61861: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: SC79097
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SC79097%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for SC79097: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: CE30855
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CE30855%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for CE30855: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: WZ31623
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WZ31623%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for WZ31623: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: MG55590
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG55590%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for MG55590: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: UL54266
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL54266%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for UL54266: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: HY37780
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HY37780%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for HY37780: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: AK91850
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AK91850%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for AK91850: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: RS10219
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RS10219%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for RS10219: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: LR05155
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LR05155%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for LR05155: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: AS49452
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AS49452%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for AS49452: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: XE43588
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XE43588%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for XE43588: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: CS26694
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CS26694%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for CS26694: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: DZ36334
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DZ36334%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for DZ36334: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: CM44271
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CM44271%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for CM44271: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: RU98413
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RU98413%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for RU98413: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: RK81522
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RK81522%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for RK81522: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: WX85238
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WX85238%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for WX85238: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: PH42965
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH42965%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for PH42965: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: NU94349
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NU94349%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for NU94349: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: JJ13352
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ13352%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for JJ13352: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: LR77559
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LR77559%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for LR77559: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: RF13997
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RF13997%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for RF13997: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: WG90809
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WG90809%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for WG90809: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: RG39008
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG39008%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for RG39008: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: CJ63806
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CJ63806%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for CJ63806: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: BM19016
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BM19016%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for BM19016: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: BA29718
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BA29718%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for BA29718: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: TM01350
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TM01350%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for TM01350: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: TK45773
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TK45773%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for TK45773: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: NX44200
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NX44200%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for NX44200: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: YE98496
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YE98496%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for YE98496: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: HC05498
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC05498%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for HC05498: 0
2026-01-29 06:35:30 [auto1.fr] INFO: Found listing with ID: CC01240
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CC01240%27 HTTP/1.1" 200 None
2026-01-29 06:35:30 [auto1.fr] INFO: Scrape type for CC01240: 0
2026-01-29 06:35:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:35:31 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:35:31 [auto1.fr] INFO: Found listing with ID: ZA84690
2026-01-29 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZA84690%27 HTTP/1.1" 200 None
2026-01-29 06:35:31 [auto1.fr] INFO: Scrape type for ZA84690: 0
2026-01-29 06:35:31 [auto1.fr] INFO: Found listing with ID: PR17089
2026-01-29 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR17089%27 HTTP/1.1" 200 None
2026-01-29 06:35:31 [auto1.fr] INFO: Scrape type for PR17089: 0
2026-01-29 06:35:31 [auto1.fr] INFO: Found listing with ID: JL88653
2026-01-29 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JL88653%27 HTTP/1.1" 200 None
2026-01-29 06:35:31 [auto1.fr] INFO: Scrape type for JL88653: 0
2026-01-29 06:35:31 [auto1.fr] INFO: Found listing with ID: YL35136
2026-01-29 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YL35136%27 HTTP/1.1" 200 None
2026-01-29 06:35:31 [auto1.fr] INFO: Scrape type for YL35136: 0
2026-01-29 06:35:31 [auto1.fr] INFO: Found listing with ID: YT10349
2026-01-29 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YT10349%27 HTTP/1.1" 200 None
2026-01-29 06:35:31 [auto1.fr] INFO: Scrape type for YT10349: 0
2026-01-29 06:35:31 [auto1.fr] INFO: Found listing with ID: MX25101
2026-01-29 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MX25101%27 HTTP/1.1" 200 None
2026-01-29 06:35:31 [auto1.fr] INFO: Scrape type for MX25101: 0
2026-01-29 06:35:31 [auto1.fr] INFO: Found listing with ID: MB45147
2026-01-29 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MB45147%27 HTTP/1.1" 200 None
2026-01-29 06:35:31 [auto1.fr] INFO: Scrape type for MB45147: 0
2026-01-29 06:35:31 [auto1.fr] INFO: Found listing with ID: XH44289
2026-01-29 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XH44289%27 HTTP/1.1" 200 None
2026-01-29 06:35:31 [auto1.fr] INFO: Scrape type for XH44289: 0
2026-01-29 06:35:31 [auto1.fr] INFO: Found listing with ID: YJ63735
2026-01-29 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YJ63735%27 HTTP/1.1" 200 None
2026-01-29 06:35:31 [auto1.fr] INFO: Scrape type for YJ63735: 0
2026-01-29 06:35:31 [auto1.fr] INFO: Found listing with ID: CT10521
2026-01-29 06:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CT10521%27 HTTP/1.1" 200 None
2026-01-29 06:35:32 [auto1.fr] INFO: Scrape type for CT10521: 0
2026-01-29 06:35:32 [auto1.fr] INFO: Found listing with ID: HD56410
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HD56410%27 HTTP/1.1" 200 None
2026-01-29 06:35:32 [auto1.fr] INFO: Scrape type for HD56410: 0
2026-01-29 06:35:32 [auto1.fr] INFO: Found listing with ID: SJ79954
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SJ79954%27 HTTP/1.1" 200 None
2026-01-29 06:35:32 [auto1.fr] INFO: Scrape type for SJ79954: 0
2026-01-29 06:35:32 [auto1.fr] INFO: Found listing with ID: KT22723
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KT22723%27 HTTP/1.1" 200 None
2026-01-29 06:35:32 [auto1.fr] INFO: Scrape type for KT22723: 0
2026-01-29 06:35:32 [auto1.fr] INFO: Found listing with ID: CW25887
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CW25887%27 HTTP/1.1" 200 None
2026-01-29 06:35:32 [auto1.fr] INFO: Scrape type for CW25887: 0
2026-01-29 06:35:32 [auto1.fr] INFO: Found listing with ID: NJ79441
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NJ79441%27 HTTP/1.1" 200 None
2026-01-29 06:35:32 [auto1.fr] INFO: Scrape type for NJ79441: 0
2026-01-29 06:35:32 [auto1.fr] INFO: Found listing with ID: FH08481
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FH08481%27 HTTP/1.1" 200 None
2026-01-29 06:35:32 [auto1.fr] INFO: Scrape type for FH08481: 0
2026-01-29 06:35:32 [auto1.fr] INFO: Found listing with ID: GV26111
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GV26111%27 HTTP/1.1" 200 None
2026-01-29 06:35:32 [auto1.fr] INFO: Scrape type for GV26111: 0
2026-01-29 06:35:32 [auto1.fr] INFO: Found listing with ID: CN38707
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN38707%27 HTTP/1.1" 200 None
2026-01-29 06:35:32 [auto1.fr] INFO: Scrape type for CN38707: 0
2026-01-29 06:35:32 [auto1.fr] INFO: Found listing with ID: EP50201
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EP50201%27 HTTP/1.1" 200 None
2026-01-29 06:35:32 [auto1.fr] INFO: Scrape type for EP50201: 0
2026-01-29 06:35:32 [auto1.fr] INFO: Found listing with ID: EF25469
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF25469%27 HTTP/1.1" 200 None
2026-01-29 06:35:32 [auto1.fr] INFO: Scrape type for EF25469: 0
2026-01-29 06:35:32 [auto1.fr] INFO: Found listing with ID: LH26805
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LH26805%27 HTTP/1.1" 200 None
2026-01-29 06:35:32 [auto1.fr] INFO: Scrape type for LH26805: 0
2026-01-29 06:35:32 [auto1.fr] INFO: Found listing with ID: YL67945
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YL67945%27 HTTP/1.1" 200 None
2026-01-29 06:35:32 [auto1.fr] INFO: Scrape type for YL67945: 0
2026-01-29 06:35:32 [auto1.fr] INFO: Found listing with ID: BE02141
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BE02141%27 HTTP/1.1" 200 None
2026-01-29 06:35:32 [auto1.fr] INFO: Scrape type for BE02141: 0
2026-01-29 06:35:32 [auto1.fr] INFO: Found listing with ID: JZ52676
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JZ52676%27 HTTP/1.1" 200 None
2026-01-29 06:35:32 [auto1.fr] INFO: Scrape type for JZ52676: 0
2026-01-29 06:35:32 [auto1.fr] INFO: Found listing with ID: PB94614
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PB94614%27 HTTP/1.1" 200 None
2026-01-29 06:35:32 [auto1.fr] INFO: Scrape type for PB94614: 0
2026-01-29 06:35:32 [auto1.fr] INFO: Found listing with ID: XX63880
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XX63880%27 HTTP/1.1" 200 None
2026-01-29 06:35:32 [auto1.fr] INFO: Scrape type for XX63880: 0
2026-01-29 06:35:32 [auto1.fr] INFO: Found listing with ID: JE82571
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JE82571%27 HTTP/1.1" 200 None
2026-01-29 06:35:32 [auto1.fr] INFO: Scrape type for JE82571: 0
2026-01-29 06:35:32 [auto1.fr] INFO: Found listing with ID: AV09597
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV09597%27 HTTP/1.1" 200 None
2026-01-29 06:35:32 [auto1.fr] INFO: Scrape type for AV09597: 0
2026-01-29 06:35:32 [auto1.fr] INFO: Found listing with ID: JS21893
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JS21893%27 HTTP/1.1" 200 None
2026-01-29 06:35:32 [auto1.fr] INFO: Scrape type for JS21893: 0
2026-01-29 06:35:32 [auto1.fr] INFO: Found listing with ID: TE61983
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TE61983%27 HTTP/1.1" 200 None
2026-01-29 06:35:32 [auto1.fr] INFO: Scrape type for TE61983: 0
2026-01-29 06:35:32 [auto1.fr] INFO: Found listing with ID: VR97534
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VR97534%27 HTTP/1.1" 200 None
2026-01-29 06:35:32 [auto1.fr] INFO: Scrape type for VR97534: 0
2026-01-29 06:35:32 [auto1.fr] INFO: Found listing with ID: DM10706
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DM10706%27 HTTP/1.1" 200 None
2026-01-29 06:35:32 [auto1.fr] INFO: Scrape type for DM10706: 0
2026-01-29 06:35:32 [auto1.fr] INFO: Found listing with ID: UD11371
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UD11371%27 HTTP/1.1" 200 None
2026-01-29 06:35:32 [auto1.fr] INFO: Scrape type for UD11371: 0
2026-01-29 06:35:32 [auto1.fr] INFO: Found listing with ID: SF95659
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF95659%27 HTTP/1.1" 200 None
2026-01-29 06:35:32 [auto1.fr] INFO: Scrape type for SF95659: 0
2026-01-29 06:35:32 [auto1.fr] INFO: Found listing with ID: SS99149
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SS99149%27 HTTP/1.1" 200 None
2026-01-29 06:35:32 [auto1.fr] INFO: Scrape type for SS99149: 0
2026-01-29 06:35:32 [auto1.fr] INFO: Found listing with ID: FY55518
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FY55518%27 HTTP/1.1" 200 None
2026-01-29 06:35:32 [auto1.fr] INFO: Scrape type for FY55518: 0
2026-01-29 06:35:32 [auto1.fr] INFO: Found listing with ID: YW37335
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YW37335%27 HTTP/1.1" 200 None
2026-01-29 06:35:32 [auto1.fr] INFO: Scrape type for YW37335: 0
2026-01-29 06:35:32 [auto1.fr] INFO: Found listing with ID: MF05883
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MF05883%27 HTTP/1.1" 200 None
2026-01-29 06:35:32 [auto1.fr] INFO: Scrape type for MF05883: 0
2026-01-29 06:35:32 [auto1.fr] INFO: Found listing with ID: TK58476
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TK58476%27 HTTP/1.1" 200 None
2026-01-29 06:35:32 [auto1.fr] INFO: Scrape type for TK58476: 0
2026-01-29 06:35:32 [auto1.fr] INFO: Found listing with ID: ZH11270
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZH11270%27 HTTP/1.1" 200 None
2026-01-29 06:35:32 [auto1.fr] INFO: Scrape type for ZH11270: 0
2026-01-29 06:35:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:35:33 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.319(s), this was the 1st time calling it.
2026-01-29 06:35:33 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.878467572010315 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-29 06:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:35:33 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:35:33 [auto1.fr] INFO: Found listing with ID: EH32832
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EH32832%27 HTTP/1.1" 200 None
2026-01-29 06:35:33 [auto1.fr] INFO: Scrape type for EH32832: 0
2026-01-29 06:35:33 [auto1.fr] INFO: Found listing with ID: XG65311
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XG65311%27 HTTP/1.1" 200 None
2026-01-29 06:35:33 [auto1.fr] INFO: Scrape type for XG65311: 0
2026-01-29 06:35:33 [auto1.fr] INFO: Found listing with ID: AB00760
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AB00760%27 HTTP/1.1" 200 None
2026-01-29 06:35:33 [auto1.fr] INFO: Scrape type for AB00760: 0
2026-01-29 06:35:33 [auto1.fr] INFO: Found listing with ID: BU70218
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BU70218%27 HTTP/1.1" 200 None
2026-01-29 06:35:33 [auto1.fr] INFO: Scrape type for BU70218: 0
2026-01-29 06:35:33 [auto1.fr] INFO: Found listing with ID: NG21543
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NG21543%27 HTTP/1.1" 200 None
2026-01-29 06:35:33 [auto1.fr] INFO: Scrape type for NG21543: 0
2026-01-29 06:35:33 [auto1.fr] INFO: Found listing with ID: DT43958
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DT43958%27 HTTP/1.1" 200 None
2026-01-29 06:35:33 [auto1.fr] INFO: Scrape type for DT43958: 0
2026-01-29 06:35:33 [auto1.fr] INFO: Found listing with ID: PD08696
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PD08696%27 HTTP/1.1" 200 None
2026-01-29 06:35:33 [auto1.fr] INFO: Scrape type for PD08696: 0
2026-01-29 06:35:33 [auto1.fr] INFO: Found listing with ID: ZG15906
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG15906%27 HTTP/1.1" 200 None
2026-01-29 06:35:33 [auto1.fr] INFO: Scrape type for ZG15906: 0
2026-01-29 06:35:33 [auto1.fr] INFO: Found listing with ID: MG09186
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG09186%27 HTTP/1.1" 200 None
2026-01-29 06:35:33 [auto1.fr] INFO: Scrape type for MG09186: 0
2026-01-29 06:35:33 [auto1.fr] INFO: Found listing with ID: LN23359
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LN23359%27 HTTP/1.1" 200 None
2026-01-29 06:35:33 [auto1.fr] INFO: Scrape type for LN23359: 0
2026-01-29 06:35:33 [auto1.fr] INFO: Found listing with ID: VY72753
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VY72753%27 HTTP/1.1" 200 None
2026-01-29 06:35:33 [auto1.fr] INFO: Scrape type for VY72753: 0
2026-01-29 06:35:33 [auto1.fr] INFO: Found listing with ID: GR77286
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GR77286%27 HTTP/1.1" 200 None
2026-01-29 06:35:33 [auto1.fr] INFO: Scrape type for GR77286: 0
2026-01-29 06:35:33 [auto1.fr] INFO: Found listing with ID: WY76097
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WY76097%27 HTTP/1.1" 200 None
2026-01-29 06:35:33 [auto1.fr] INFO: Scrape type for WY76097: 0
2026-01-29 06:35:33 [auto1.fr] INFO: Found listing with ID: YF49092
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YF49092%27 HTTP/1.1" 200 None
2026-01-29 06:35:33 [auto1.fr] INFO: Scrape type for YF49092: 0
2026-01-29 06:35:33 [auto1.fr] INFO: Found listing with ID: CF01852
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CF01852%27 HTTP/1.1" 200 None
2026-01-29 06:35:33 [auto1.fr] INFO: Scrape type for CF01852: 0
2026-01-29 06:35:33 [auto1.fr] INFO: Found listing with ID: EA56171
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EA56171%27 HTTP/1.1" 200 None
2026-01-29 06:35:33 [auto1.fr] INFO: Scrape type for EA56171: 0
2026-01-29 06:35:33 [auto1.fr] INFO: Found listing with ID: PD57737
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PD57737%27 HTTP/1.1" 200 None
2026-01-29 06:35:33 [auto1.fr] INFO: Scrape type for PD57737: 0
2026-01-29 06:35:33 [auto1.fr] INFO: Found listing with ID: YP90946
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP90946%27 HTTP/1.1" 200 None
2026-01-29 06:35:33 [auto1.fr] INFO: Scrape type for YP90946: 0
2026-01-29 06:35:33 [auto1.fr] INFO: Found listing with ID: RS12337
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RS12337%27 HTTP/1.1" 200 None
2026-01-29 06:35:33 [auto1.fr] INFO: Scrape type for RS12337: 0
2026-01-29 06:35:33 [auto1.fr] INFO: Found listing with ID: WS99031
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WS99031%27 HTTP/1.1" 200 None
2026-01-29 06:35:33 [auto1.fr] INFO: Scrape type for WS99031: 0
2026-01-29 06:35:33 [auto1.fr] INFO: Found listing with ID: FL69088
2026-01-29 06:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FL69088%27 HTTP/1.1" 200 None
2026-01-29 06:35:34 [auto1.fr] INFO: Scrape type for FL69088: 0
2026-01-29 06:35:34 [auto1.fr] INFO: Found listing with ID: YZ30566
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YZ30566%27 HTTP/1.1" 200 None
2026-01-29 06:35:34 [auto1.fr] INFO: Scrape type for YZ30566: 0
2026-01-29 06:35:34 [auto1.fr] INFO: Found listing with ID: UL56391
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL56391%27 HTTP/1.1" 200 None
2026-01-29 06:35:34 [auto1.fr] INFO: Scrape type for UL56391: 0
2026-01-29 06:35:34 [auto1.fr] INFO: Found listing with ID: DG94353
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DG94353%27 HTTP/1.1" 200 None
2026-01-29 06:35:34 [auto1.fr] INFO: Scrape type for DG94353: 0
2026-01-29 06:35:34 [auto1.fr] INFO: Found listing with ID: BL14843
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BL14843%27 HTTP/1.1" 200 None
2026-01-29 06:35:34 [auto1.fr] INFO: Scrape type for BL14843: 0
2026-01-29 06:35:34 [auto1.fr] INFO: Found listing with ID: ZR63641
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZR63641%27 HTTP/1.1" 200 None
2026-01-29 06:35:34 [auto1.fr] INFO: Scrape type for ZR63641: 0
2026-01-29 06:35:34 [auto1.fr] INFO: Found listing with ID: UW46790
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UW46790%27 HTTP/1.1" 200 None
2026-01-29 06:35:34 [auto1.fr] INFO: Scrape type for UW46790: 0
2026-01-29 06:35:34 [auto1.fr] INFO: Found listing with ID: MJ91130
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MJ91130%27 HTTP/1.1" 200 None
2026-01-29 06:35:34 [auto1.fr] INFO: Scrape type for MJ91130: 0
2026-01-29 06:35:34 [auto1.fr] INFO: Found listing with ID: MS72468
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MS72468%27 HTTP/1.1" 200 None
2026-01-29 06:35:34 [auto1.fr] INFO: Scrape type for MS72468: 0
2026-01-29 06:35:34 [auto1.fr] INFO: Found listing with ID: DN79223
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DN79223%27 HTTP/1.1" 200 None
2026-01-29 06:35:34 [auto1.fr] INFO: Scrape type for DN79223: 0
2026-01-29 06:35:34 [auto1.fr] INFO: Found listing with ID: EV59149
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EV59149%27 HTTP/1.1" 200 None
2026-01-29 06:35:34 [auto1.fr] INFO: Scrape type for EV59149: 0
2026-01-29 06:35:34 [auto1.fr] INFO: Found listing with ID: SH08983
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SH08983%27 HTTP/1.1" 200 None
2026-01-29 06:35:34 [auto1.fr] INFO: Scrape type for SH08983: 0
2026-01-29 06:35:34 [auto1.fr] INFO: Found listing with ID: WD81986
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD81986%27 HTTP/1.1" 200 None
2026-01-29 06:35:34 [auto1.fr] INFO: Scrape type for WD81986: 0
2026-01-29 06:35:34 [auto1.fr] INFO: Found listing with ID: SR39775
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SR39775%27 HTTP/1.1" 200 None
2026-01-29 06:35:34 [auto1.fr] INFO: Scrape type for SR39775: 0
2026-01-29 06:35:34 [auto1.fr] INFO: Found listing with ID: FF52802
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FF52802%27 HTTP/1.1" 200 None
2026-01-29 06:35:34 [auto1.fr] INFO: Scrape type for FF52802: 0
2026-01-29 06:35:34 [auto1.fr] INFO: Found listing with ID: DY03380
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DY03380%27 HTTP/1.1" 200 None
2026-01-29 06:35:34 [auto1.fr] INFO: Scrape type for DY03380: 0
2026-01-29 06:35:34 [auto1.fr] INFO: Found listing with ID: GV80383
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GV80383%27 HTTP/1.1" 200 None
2026-01-29 06:35:34 [auto1.fr] INFO: Scrape type for GV80383: 0
2026-01-29 06:35:34 [auto1.fr] INFO: Found listing with ID: RC15740
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RC15740%27 HTTP/1.1" 200 None
2026-01-29 06:35:34 [auto1.fr] INFO: Scrape type for RC15740: 0
2026-01-29 06:35:34 [auto1.fr] INFO: Found listing with ID: XK14868
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XK14868%27 HTTP/1.1" 200 None
2026-01-29 06:35:34 [auto1.fr] INFO: Scrape type for XK14868: 0
2026-01-29 06:35:34 [auto1.fr] INFO: Found listing with ID: AG04901
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AG04901%27 HTTP/1.1" 200 None
2026-01-29 06:35:34 [auto1.fr] INFO: Scrape type for AG04901: 0
2026-01-29 06:35:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:35:35 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:35:35 [auto1.fr] INFO: Found listing with ID: DL46937
2026-01-29 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DL46937%27 HTTP/1.1" 200 None
2026-01-29 06:35:35 [auto1.fr] INFO: Scrape type for DL46937: 0
2026-01-29 06:35:35 [auto1.fr] INFO: Found listing with ID: TM00147
2026-01-29 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TM00147%27 HTTP/1.1" 200 None
2026-01-29 06:35:35 [auto1.fr] INFO: Scrape type for TM00147: 0
2026-01-29 06:35:35 [auto1.fr] INFO: Found listing with ID: ER74782
2026-01-29 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER74782%27 HTTP/1.1" 200 None
2026-01-29 06:35:35 [auto1.fr] INFO: Scrape type for ER74782: 0
2026-01-29 06:35:35 [auto1.fr] INFO: Found listing with ID: GW39050
2026-01-29 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GW39050%27 HTTP/1.1" 200 None
2026-01-29 06:35:35 [auto1.fr] INFO: Scrape type for GW39050: 0
2026-01-29 06:35:35 [auto1.fr] INFO: Found listing with ID: AL01988
2026-01-29 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AL01988%27 HTTP/1.1" 200 None
2026-01-29 06:35:35 [auto1.fr] INFO: Scrape type for AL01988: 0
2026-01-29 06:35:35 [auto1.fr] INFO: Found listing with ID: LD66775
2026-01-29 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LD66775%27 HTTP/1.1" 200 None
2026-01-29 06:35:35 [auto1.fr] INFO: Scrape type for LD66775: 0
2026-01-29 06:35:35 [auto1.fr] INFO: Found listing with ID: UM70576
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UM70576%27 HTTP/1.1" 200 None
2026-01-29 06:35:36 [auto1.fr] INFO: Scrape type for UM70576: 0
2026-01-29 06:35:36 [auto1.fr] INFO: Found listing with ID: LV95331
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LV95331%27 HTTP/1.1" 200 None
2026-01-29 06:35:36 [auto1.fr] INFO: Scrape type for LV95331: 0
2026-01-29 06:35:36 [auto1.fr] INFO: Found listing with ID: BL46322
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BL46322%27 HTTP/1.1" 200 None
2026-01-29 06:35:36 [auto1.fr] INFO: Scrape type for BL46322: 0
2026-01-29 06:35:36 [auto1.fr] INFO: Found listing with ID: KN85348
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KN85348%27 HTTP/1.1" 200 None
2026-01-29 06:35:36 [auto1.fr] INFO: Scrape type for KN85348: 0
2026-01-29 06:35:36 [auto1.fr] INFO: Found listing with ID: ED32866
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ED32866%27 HTTP/1.1" 200 None
2026-01-29 06:35:36 [auto1.fr] INFO: Scrape type for ED32866: 0
2026-01-29 06:35:36 [auto1.fr] INFO: Found listing with ID: HK10345
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK10345%27 HTTP/1.1" 200 None
2026-01-29 06:35:36 [auto1.fr] INFO: Scrape type for HK10345: 0
2026-01-29 06:35:36 [auto1.fr] INFO: Found listing with ID: MB51865
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MB51865%27 HTTP/1.1" 200 None
2026-01-29 06:35:36 [auto1.fr] INFO: Scrape type for MB51865: 0
2026-01-29 06:35:36 [auto1.fr] INFO: Found listing with ID: EZ19454
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EZ19454%27 HTTP/1.1" 200 None
2026-01-29 06:35:36 [auto1.fr] INFO: Scrape type for EZ19454: 0
2026-01-29 06:35:36 [auto1.fr] INFO: Found listing with ID: HD88303
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HD88303%27 HTTP/1.1" 200 None
2026-01-29 06:35:36 [auto1.fr] INFO: Scrape type for HD88303: 0
2026-01-29 06:35:36 [auto1.fr] INFO: Found listing with ID: XZ63695
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XZ63695%27 HTTP/1.1" 200 None
2026-01-29 06:35:36 [auto1.fr] INFO: Scrape type for XZ63695: 0
2026-01-29 06:35:36 [auto1.fr] INFO: Found listing with ID: LS46304
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LS46304%27 HTTP/1.1" 200 None
2026-01-29 06:35:36 [auto1.fr] INFO: Scrape type for LS46304: 0
2026-01-29 06:35:36 [auto1.fr] INFO: Found listing with ID: NA52061
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NA52061%27 HTTP/1.1" 200 None
2026-01-29 06:35:36 [auto1.fr] INFO: Scrape type for NA52061: 0
2026-01-29 06:35:36 [auto1.fr] INFO: Found listing with ID: VR21540
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VR21540%27 HTTP/1.1" 200 None
2026-01-29 06:35:36 [auto1.fr] INFO: Scrape type for VR21540: 0
2026-01-29 06:35:36 [auto1.fr] INFO: Found listing with ID: FK28104
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FK28104%27 HTTP/1.1" 200 None
2026-01-29 06:35:36 [auto1.fr] INFO: Scrape type for FK28104: 0
2026-01-29 06:35:36 [auto1.fr] INFO: Found listing with ID: YU43538
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YU43538%27 HTTP/1.1" 200 None
2026-01-29 06:35:36 [auto1.fr] INFO: Scrape type for YU43538: 0
2026-01-29 06:35:36 [auto1.fr] INFO: Found listing with ID: FB30897
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB30897%27 HTTP/1.1" 200 None
2026-01-29 06:35:36 [auto1.fr] INFO: Scrape type for FB30897: 0
2026-01-29 06:35:36 [auto1.fr] INFO: Found listing with ID: PC39679
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PC39679%27 HTTP/1.1" 200 None
2026-01-29 06:35:36 [auto1.fr] INFO: Scrape type for PC39679: 0
2026-01-29 06:35:36 [auto1.fr] INFO: Found listing with ID: BL70291
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BL70291%27 HTTP/1.1" 200 None
2026-01-29 06:35:36 [auto1.fr] INFO: Scrape type for BL70291: 0
2026-01-29 06:35:36 [auto1.fr] INFO: Found listing with ID: CR19976
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CR19976%27 HTTP/1.1" 200 None
2026-01-29 06:35:36 [auto1.fr] INFO: Scrape type for CR19976: 0
2026-01-29 06:35:36 [auto1.fr] INFO: Found listing with ID: FU42022
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FU42022%27 HTTP/1.1" 200 None
2026-01-29 06:35:36 [auto1.fr] INFO: Scrape type for FU42022: 0
2026-01-29 06:35:36 [auto1.fr] INFO: Found listing with ID: UL88861
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL88861%27 HTTP/1.1" 200 None
2026-01-29 06:35:36 [auto1.fr] INFO: Scrape type for UL88861: 0
2026-01-29 06:35:36 [auto1.fr] INFO: Found listing with ID: VY29646
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VY29646%27 HTTP/1.1" 200 None
2026-01-29 06:35:36 [auto1.fr] INFO: Scrape type for VY29646: 0
2026-01-29 06:35:36 [auto1.fr] INFO: Found listing with ID: NY92218
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NY92218%27 HTTP/1.1" 200 None
2026-01-29 06:35:36 [auto1.fr] INFO: Scrape type for NY92218: 0
2026-01-29 06:35:36 [auto1.fr] INFO: Found listing with ID: BW40642
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BW40642%27 HTTP/1.1" 200 None
2026-01-29 06:35:36 [auto1.fr] INFO: Scrape type for BW40642: 0
2026-01-29 06:35:36 [auto1.fr] INFO: Found listing with ID: FS02102
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FS02102%27 HTTP/1.1" 200 None
2026-01-29 06:35:36 [auto1.fr] INFO: Scrape type for FS02102: 0
2026-01-29 06:35:36 [auto1.fr] INFO: Found listing with ID: PM14158
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PM14158%27 HTTP/1.1" 200 None
2026-01-29 06:35:36 [auto1.fr] INFO: Scrape type for PM14158: 0
2026-01-29 06:35:36 [auto1.fr] INFO: Found listing with ID: FX94390
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX94390%27 HTTP/1.1" 200 None
2026-01-29 06:35:36 [auto1.fr] INFO: Scrape type for FX94390: 0
2026-01-29 06:35:36 [auto1.fr] INFO: Found listing with ID: KN31145
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KN31145%27 HTTP/1.1" 200 None
2026-01-29 06:35:36 [auto1.fr] INFO: Scrape type for KN31145: 0
2026-01-29 06:35:36 [auto1.fr] INFO: Found listing with ID: EL76416
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EL76416%27 HTTP/1.1" 200 None
2026-01-29 06:35:36 [auto1.fr] INFO: Scrape type for EL76416: 0
2026-01-29 06:35:36 [auto1.fr] INFO: Found listing with ID: HD97530
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HD97530%27 HTTP/1.1" 200 None
2026-01-29 06:35:36 [auto1.fr] INFO: Scrape type for HD97530: 0
2026-01-29 06:35:36 [auto1.fr] INFO: Found listing with ID: HK02342
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK02342%27 HTTP/1.1" 200 None
2026-01-29 06:35:36 [auto1.fr] INFO: Scrape type for HK02342: 0
2026-01-29 06:35:36 [auto1.fr] INFO: Found listing with ID: TK99445
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TK99445%27 HTTP/1.1" 200 None
2026-01-29 06:35:36 [auto1.fr] INFO: Scrape type for TK99445: 0
2026-01-29 06:35:36 [auto1.fr] INFO: Found listing with ID: HZ61005
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HZ61005%27 HTTP/1.1" 200 None
2026-01-29 06:35:36 [auto1.fr] INFO: Scrape type for HZ61005: 0
2026-01-29 06:35:36 [auto1.fr] INFO: Found listing with ID: UW21832
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UW21832%27 HTTP/1.1" 200 None
2026-01-29 06:35:36 [auto1.fr] INFO: Scrape type for UW21832: 0
2026-01-29 06:35:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:35:37 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:35:37 [auto1.fr] INFO: Found listing with ID: KU40725
2026-01-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KU40725%27 HTTP/1.1" 200 None
2026-01-29 06:35:37 [auto1.fr] INFO: Scrape type for KU40725: 0
2026-01-29 06:35:37 [auto1.fr] INFO: Found listing with ID: YU63934
2026-01-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YU63934%27 HTTP/1.1" 200 None
2026-01-29 06:35:37 [auto1.fr] INFO: Scrape type for YU63934: 0
2026-01-29 06:35:37 [auto1.fr] INFO: Found listing with ID: UT50341
2026-01-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT50341%27 HTTP/1.1" 200 None
2026-01-29 06:35:37 [auto1.fr] INFO: Scrape type for UT50341: 0
2026-01-29 06:35:37 [auto1.fr] INFO: Found listing with ID: UN83109
2026-01-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN83109%27 HTTP/1.1" 200 None
2026-01-29 06:35:37 [auto1.fr] INFO: Scrape type for UN83109: 0
2026-01-29 06:35:37 [auto1.fr] INFO: Found listing with ID: AJ89372
2026-01-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AJ89372%27 HTTP/1.1" 200 None
2026-01-29 06:35:37 [auto1.fr] INFO: Scrape type for AJ89372: 0
2026-01-29 06:35:37 [auto1.fr] INFO: Found listing with ID: PA74539
2026-01-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PA74539%27 HTTP/1.1" 200 None
2026-01-29 06:35:37 [auto1.fr] INFO: Scrape type for PA74539: 0
2026-01-29 06:35:37 [auto1.fr] INFO: Found listing with ID: MF87280
2026-01-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MF87280%27 HTTP/1.1" 200 None
2026-01-29 06:35:37 [auto1.fr] INFO: Scrape type for MF87280: 0
2026-01-29 06:35:37 [auto1.fr] INFO: Found listing with ID: BK46201
2026-01-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BK46201%27 HTTP/1.1" 200 None
2026-01-29 06:35:37 [auto1.fr] INFO: Scrape type for BK46201: 0
2026-01-29 06:35:37 [auto1.fr] INFO: Found listing with ID: HJ36772
2026-01-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HJ36772%27 HTTP/1.1" 200 None
2026-01-29 06:35:37 [auto1.fr] INFO: Scrape type for HJ36772: 0
2026-01-29 06:35:37 [auto1.fr] INFO: Found listing with ID: XF87015
2026-01-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XF87015%27 HTTP/1.1" 200 None
2026-01-29 06:35:37 [auto1.fr] INFO: Scrape type for XF87015: 0
2026-01-29 06:35:37 [auto1.fr] INFO: Found listing with ID: WD73456
2026-01-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD73456%27 HTTP/1.1" 200 None
2026-01-29 06:35:37 [auto1.fr] INFO: Scrape type for WD73456: 0
2026-01-29 06:35:37 [auto1.fr] INFO: Found listing with ID: SN34035
2026-01-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SN34035%27 HTTP/1.1" 200 None
2026-01-29 06:35:37 [auto1.fr] INFO: Scrape type for SN34035: 0
2026-01-29 06:35:37 [auto1.fr] INFO: Found listing with ID: BW41217
2026-01-29 06:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BW41217%27 HTTP/1.1" 200 None
2026-01-29 06:35:38 [auto1.fr] INFO: Scrape type for BW41217: 0
2026-01-29 06:35:38 [auto1.fr] INFO: Found listing with ID: KR78569
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KR78569%27 HTTP/1.1" 200 None
2026-01-29 06:35:38 [auto1.fr] INFO: Scrape type for KR78569: 0
2026-01-29 06:35:38 [auto1.fr] INFO: Found listing with ID: TA66067
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA66067%27 HTTP/1.1" 200 None
2026-01-29 06:35:38 [auto1.fr] INFO: Scrape type for TA66067: 0
2026-01-29 06:35:38 [auto1.fr] INFO: Found listing with ID: PH12339
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH12339%27 HTTP/1.1" 200 None
2026-01-29 06:35:38 [auto1.fr] INFO: Scrape type for PH12339: 0
2026-01-29 06:35:38 [auto1.fr] INFO: Found listing with ID: TB32473
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TB32473%27 HTTP/1.1" 200 None
2026-01-29 06:35:38 [auto1.fr] INFO: Scrape type for TB32473: 0
2026-01-29 06:35:38 [auto1.fr] INFO: Found listing with ID: NH68162
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH68162%27 HTTP/1.1" 200 None
2026-01-29 06:35:38 [auto1.fr] INFO: Scrape type for NH68162: 0
2026-01-29 06:35:38 [auto1.fr] INFO: Found listing with ID: MT82876
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MT82876%27 HTTP/1.1" 200 None
2026-01-29 06:35:38 [auto1.fr] INFO: Scrape type for MT82876: 0
2026-01-29 06:35:38 [auto1.fr] INFO: Found listing with ID: RK49686
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RK49686%27 HTTP/1.1" 200 None
2026-01-29 06:35:38 [auto1.fr] INFO: Scrape type for RK49686: 0
2026-01-29 06:35:38 [auto1.fr] INFO: Found listing with ID: TK30011
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TK30011%27 HTTP/1.1" 200 None
2026-01-29 06:35:38 [auto1.fr] INFO: Scrape type for TK30011: 0
2026-01-29 06:35:38 [auto1.fr] INFO: Found listing with ID: BV50338
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BV50338%27 HTTP/1.1" 200 None
2026-01-29 06:35:38 [auto1.fr] INFO: Scrape type for BV50338: 0
2026-01-29 06:35:38 [auto1.fr] INFO: Found listing with ID: CP39971
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CP39971%27 HTTP/1.1" 200 None
2026-01-29 06:35:38 [auto1.fr] INFO: Scrape type for CP39971: 0
2026-01-29 06:35:38 [auto1.fr] INFO: Found listing with ID: ZM38533
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZM38533%27 HTTP/1.1" 200 None
2026-01-29 06:35:38 [auto1.fr] INFO: Scrape type for ZM38533: 0
2026-01-29 06:35:38 [auto1.fr] INFO: Found listing with ID: MX75824
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MX75824%27 HTTP/1.1" 200 None
2026-01-29 06:35:38 [auto1.fr] INFO: Scrape type for MX75824: 0
2026-01-29 06:35:38 [auto1.fr] INFO: Found listing with ID: PG27434
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PG27434%27 HTTP/1.1" 200 None
2026-01-29 06:35:38 [auto1.fr] INFO: Scrape type for PG27434: 0
2026-01-29 06:35:38 [auto1.fr] INFO: Found listing with ID: VX72533
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX72533%27 HTTP/1.1" 200 None
2026-01-29 06:35:38 [auto1.fr] INFO: Scrape type for VX72533: 0
2026-01-29 06:35:38 [auto1.fr] INFO: Found listing with ID: TM52456
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TM52456%27 HTTP/1.1" 200 None
2026-01-29 06:35:38 [auto1.fr] INFO: Scrape type for TM52456: 0
2026-01-29 06:35:38 [auto1.fr] INFO: Found listing with ID: PG61561
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PG61561%27 HTTP/1.1" 200 None
2026-01-29 06:35:38 [auto1.fr] INFO: Scrape type for PG61561: 0
2026-01-29 06:35:38 [auto1.fr] INFO: Found listing with ID: TT85102
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TT85102%27 HTTP/1.1" 200 None
2026-01-29 06:35:38 [auto1.fr] INFO: Scrape type for TT85102: 0
2026-01-29 06:35:38 [auto1.fr] INFO: Found listing with ID: RF71869
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RF71869%27 HTTP/1.1" 200 None
2026-01-29 06:35:38 [auto1.fr] INFO: Scrape type for RF71869: 0
2026-01-29 06:35:38 [auto1.fr] INFO: Found listing with ID: LT67098
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LT67098%27 HTTP/1.1" 200 None
2026-01-29 06:35:38 [auto1.fr] INFO: Scrape type for LT67098: 0
2026-01-29 06:35:38 [auto1.fr] INFO: Found listing with ID: SF59609
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF59609%27 HTTP/1.1" 200 None
2026-01-29 06:35:38 [auto1.fr] INFO: Scrape type for SF59609: 0
2026-01-29 06:35:38 [auto1.fr] INFO: Found listing with ID: BY46765
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BY46765%27 HTTP/1.1" 200 None
2026-01-29 06:35:38 [auto1.fr] INFO: Scrape type for BY46765: 0
2026-01-29 06:35:38 [auto1.fr] INFO: Found listing with ID: NY83950
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NY83950%27 HTTP/1.1" 200 None
2026-01-29 06:35:38 [auto1.fr] INFO: Scrape type for NY83950: 0
2026-01-29 06:35:38 [auto1.fr] INFO: Found listing with ID: TR79275
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TR79275%27 HTTP/1.1" 200 None
2026-01-29 06:35:38 [auto1.fr] INFO: Scrape type for TR79275: 0
2026-01-29 06:35:38 [auto1.fr] INFO: Found listing with ID: HZ48598
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HZ48598%27 HTTP/1.1" 200 None
2026-01-29 06:35:38 [auto1.fr] INFO: Scrape type for HZ48598: 0
2026-01-29 06:35:38 [auto1.fr] INFO: Found listing with ID: WW75250
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WW75250%27 HTTP/1.1" 200 None
2026-01-29 06:35:38 [auto1.fr] INFO: Scrape type for WW75250: 0
2026-01-29 06:35:38 [auto1.fr] INFO: Found listing with ID: LC40158
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LC40158%27 HTTP/1.1" 200 None
2026-01-29 06:35:38 [auto1.fr] INFO: Scrape type for LC40158: 0
2026-01-29 06:35:38 [auto1.fr] INFO: Found listing with ID: EP45496
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EP45496%27 HTTP/1.1" 200 None
2026-01-29 06:35:38 [auto1.fr] INFO: Scrape type for EP45496: 0
2026-01-29 06:35:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:35:39 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:35:39 [auto1.fr] INFO: Found listing with ID: DS11235
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS11235%27 HTTP/1.1" 200 None
2026-01-29 06:35:39 [auto1.fr] INFO: Scrape type for DS11235: 0
2026-01-29 06:35:39 [auto1.fr] INFO: Found listing with ID: PM25887
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PM25887%27 HTTP/1.1" 200 None
2026-01-29 06:35:39 [auto1.fr] INFO: Scrape type for PM25887: 0
2026-01-29 06:35:39 [auto1.fr] INFO: Found listing with ID: GK58582
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GK58582%27 HTTP/1.1" 200 None
2026-01-29 06:35:39 [auto1.fr] INFO: Scrape type for GK58582: 0
2026-01-29 06:35:39 [auto1.fr] INFO: Found listing with ID: AA04449
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AA04449%27 HTTP/1.1" 200 None
2026-01-29 06:35:39 [auto1.fr] INFO: Scrape type for AA04449: 0
2026-01-29 06:35:39 [auto1.fr] INFO: Found listing with ID: TF54279
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TF54279%27 HTTP/1.1" 200 None
2026-01-29 06:35:39 [auto1.fr] INFO: Scrape type for TF54279: 0
2026-01-29 06:35:39 [auto1.fr] INFO: Found listing with ID: ZD92767
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZD92767%27 HTTP/1.1" 200 None
2026-01-29 06:35:39 [auto1.fr] INFO: Scrape type for ZD92767: 0
2026-01-29 06:35:39 [auto1.fr] INFO: Found listing with ID: DB11458
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DB11458%27 HTTP/1.1" 200 None
2026-01-29 06:35:39 [auto1.fr] INFO: Scrape type for DB11458: 0
2026-01-29 06:35:39 [auto1.fr] INFO: Found listing with ID: FL57229
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FL57229%27 HTTP/1.1" 200 None
2026-01-29 06:35:39 [auto1.fr] INFO: Scrape type for FL57229: 0
2026-01-29 06:35:39 [auto1.fr] INFO: Found listing with ID: JT04400
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JT04400%27 HTTP/1.1" 200 None
2026-01-29 06:35:39 [auto1.fr] INFO: Scrape type for JT04400: 0
2026-01-29 06:35:39 [auto1.fr] INFO: Found listing with ID: KC00298
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KC00298%27 HTTP/1.1" 200 None
2026-01-29 06:35:39 [auto1.fr] INFO: Scrape type for KC00298: 0
2026-01-29 06:35:39 [auto1.fr] INFO: Found listing with ID: LN15564
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LN15564%27 HTTP/1.1" 200 None
2026-01-29 06:35:39 [auto1.fr] INFO: Scrape type for LN15564: 0
2026-01-29 06:35:39 [auto1.fr] INFO: Found listing with ID: VU46239
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VU46239%27 HTTP/1.1" 200 None
2026-01-29 06:35:39 [auto1.fr] INFO: Scrape type for VU46239: 0
2026-01-29 06:35:39 [auto1.fr] INFO: Found listing with ID: NH33931
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH33931%27 HTTP/1.1" 200 None
2026-01-29 06:35:39 [auto1.fr] INFO: Scrape type for NH33931: 0
2026-01-29 06:35:39 [auto1.fr] INFO: Found listing with ID: LG53482
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LG53482%27 HTTP/1.1" 200 None
2026-01-29 06:35:39 [auto1.fr] INFO: Scrape type for LG53482: 0
2026-01-29 06:35:39 [auto1.fr] INFO: Found listing with ID: ZM46559
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZM46559%27 HTTP/1.1" 200 None
2026-01-29 06:35:39 [auto1.fr] INFO: Scrape type for ZM46559: 0
2026-01-29 06:35:39 [auto1.fr] INFO: Found listing with ID: YF99481
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YF99481%27 HTTP/1.1" 200 None
2026-01-29 06:35:39 [auto1.fr] INFO: Scrape type for YF99481: 0
2026-01-29 06:35:39 [auto1.fr] INFO: Found listing with ID: RH35237
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RH35237%27 HTTP/1.1" 200 None
2026-01-29 06:35:39 [auto1.fr] INFO: Scrape type for RH35237: 0
2026-01-29 06:35:39 [auto1.fr] INFO: Found listing with ID: MH51328
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MH51328%27 HTTP/1.1" 200 None
2026-01-29 06:35:39 [auto1.fr] INFO: Scrape type for MH51328: 0
2026-01-29 06:35:39 [auto1.fr] INFO: Found listing with ID: PJ87785
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PJ87785%27 HTTP/1.1" 200 None
2026-01-29 06:35:39 [auto1.fr] INFO: Scrape type for PJ87785: 0
2026-01-29 06:35:39 [auto1.fr] INFO: Found listing with ID: JK56397
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JK56397%27 HTTP/1.1" 200 None
2026-01-29 06:35:39 [auto1.fr] INFO: Scrape type for JK56397: 0
2026-01-29 06:35:39 [auto1.fr] INFO: Found listing with ID: SE87500
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SE87500%27 HTTP/1.1" 200 None
2026-01-29 06:35:39 [auto1.fr] INFO: Scrape type for SE87500: 0
2026-01-29 06:35:39 [auto1.fr] INFO: Found listing with ID: WM84365
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM84365%27 HTTP/1.1" 200 None
2026-01-29 06:35:39 [auto1.fr] INFO: Scrape type for WM84365: 0
2026-01-29 06:35:39 [auto1.fr] INFO: Found listing with ID: FP17391
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP17391%27 HTTP/1.1" 200 None
2026-01-29 06:35:39 [auto1.fr] INFO: Scrape type for FP17391: 0
2026-01-29 06:35:39 [auto1.fr] INFO: Found listing with ID: GP51185
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GP51185%27 HTTP/1.1" 200 None
2026-01-29 06:35:39 [auto1.fr] INFO: Scrape type for GP51185: 0
2026-01-29 06:35:39 [auto1.fr] INFO: Found listing with ID: CY25046
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY25046%27 HTTP/1.1" 200 None
2026-01-29 06:35:39 [auto1.fr] INFO: Scrape type for CY25046: 0
2026-01-29 06:35:39 [auto1.fr] INFO: Found listing with ID: AB70792
2026-01-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AB70792%27 HTTP/1.1" 200 None
2026-01-29 06:35:40 [auto1.fr] INFO: Scrape type for AB70792: 0
2026-01-29 06:35:40 [auto1.fr] INFO: Found listing with ID: PJ36643
2026-01-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PJ36643%27 HTTP/1.1" 200 None
2026-01-29 06:35:40 [auto1.fr] INFO: Scrape type for PJ36643: 0
2026-01-29 06:35:40 [auto1.fr] INFO: Found listing with ID: BN01683
2026-01-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BN01683%27 HTTP/1.1" 200 None
2026-01-29 06:35:40 [auto1.fr] INFO: Scrape type for BN01683: 0
2026-01-29 06:35:40 [auto1.fr] INFO: Found listing with ID: HT06734
2026-01-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HT06734%27 HTTP/1.1" 200 None
2026-01-29 06:35:40 [auto1.fr] INFO: Scrape type for HT06734: 0
2026-01-29 06:35:40 [auto1.fr] INFO: Found listing with ID: KE64846
2026-01-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KE64846%27 HTTP/1.1" 200 None
2026-01-29 06:35:40 [auto1.fr] INFO: Scrape type for KE64846: 0
2026-01-29 06:35:40 [auto1.fr] INFO: Found listing with ID: UW57073
2026-01-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UW57073%27 HTTP/1.1" 200 None
2026-01-29 06:35:40 [auto1.fr] INFO: Scrape type for UW57073: 0
2026-01-29 06:35:40 [auto1.fr] INFO: Found listing with ID: ES30730
2026-01-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ES30730%27 HTTP/1.1" 200 None
2026-01-29 06:35:40 [auto1.fr] INFO: Scrape type for ES30730: 0
2026-01-29 06:35:40 [auto1.fr] INFO: Found listing with ID: GG65299
2026-01-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG65299%27 HTTP/1.1" 200 None
2026-01-29 06:35:40 [auto1.fr] INFO: Scrape type for GG65299: 0
2026-01-29 06:35:40 [auto1.fr] INFO: Found listing with ID: RB50523
2026-01-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RB50523%27 HTTP/1.1" 200 None
2026-01-29 06:35:40 [auto1.fr] INFO: Scrape type for RB50523: 0
2026-01-29 06:35:40 [auto1.fr] INFO: Found listing with ID: UJ65145
2026-01-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UJ65145%27 HTTP/1.1" 200 None
2026-01-29 06:35:40 [auto1.fr] INFO: Scrape type for UJ65145: 0
2026-01-29 06:35:40 [auto1.fr] INFO: Found listing with ID: CW59299
2026-01-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CW59299%27 HTTP/1.1" 200 None
2026-01-29 06:35:40 [auto1.fr] INFO: Scrape type for CW59299: 0
2026-01-29 06:35:40 [auto1.fr] INFO: Found listing with ID: AN67050
2026-01-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AN67050%27 HTTP/1.1" 200 None
2026-01-29 06:35:40 [auto1.fr] INFO: Scrape type for AN67050: 0
2026-01-29 06:35:40 [auto1.fr] INFO: Found listing with ID: DD90499
2026-01-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DD90499%27 HTTP/1.1" 200 None
2026-01-29 06:35:40 [auto1.fr] INFO: Scrape type for DD90499: 0
2026-01-29 06:35:40 [auto1.fr] INFO: Found listing with ID: NK43664
2026-01-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK43664%27 HTTP/1.1" 200 None
2026-01-29 06:35:40 [auto1.fr] INFO: Scrape type for NK43664: 0
2026-01-29 06:35:40 [auto1.fr] INFO: Found listing with ID: YG67019
2026-01-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG67019%27 HTTP/1.1" 200 None
2026-01-29 06:35:40 [auto1.fr] INFO: Scrape type for YG67019: 0
2026-01-29 06:35:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:35:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-29 06:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FB97001/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:35:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:35:41 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: HD53761
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HD53761%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for HD53761: 0
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: LF73902
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LF73902%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for LF73902: 0
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: FS63120
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FS63120%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for FS63120: 0
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: KL38696
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KL38696%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for KL38696: 0
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: XV22277
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XV22277%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for XV22277: 0
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: ZX89240
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZX89240%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for ZX89240: 0
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: EH53081
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EH53081%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for EH53081: 0
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: NR39198
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NR39198%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for NR39198: 0
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: VK43865
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VK43865%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for VK43865: 0
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: PF80977
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF80977%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for PF80977: 0
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: SE43566
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SE43566%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for SE43566: 0
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: AH47445
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AH47445%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for AH47445: 0
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: UY10549
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY10549%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for UY10549: 0
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: UN54650
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN54650%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for UN54650: 0
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: ZB92087
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZB92087%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for ZB92087: 0
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: SZ57250
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SZ57250%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for SZ57250: 0
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: DA56533
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DA56533%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for DA56533: 0
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: WX86172
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WX86172%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for WX86172: 0
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: KV59825
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV59825%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for KV59825: 0
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: RD60293
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RD60293%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for RD60293: 0
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: DG86086
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DG86086%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for DG86086: 0
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: YD91186
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YD91186%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for YD91186: 0
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: KV66727
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV66727%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for KV66727: 0
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: CF48017
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CF48017%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for CF48017: 0
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: ND87176
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ND87176%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for ND87176: 0
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: NR49183
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NR49183%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for NR49183: 0
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: FJ19351
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ19351%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for FJ19351: 0
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: JD57935
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD57935%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for JD57935: 0
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: CH87620
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CH87620%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for CH87620: 0
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: ZM09873
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZM09873%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for ZM09873: 0
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: WP05880
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WP05880%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for WP05880: 0
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: XD30040
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XD30040%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for XD30040: 0
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: HV30911
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HV30911%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for HV30911: 0
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: UZ52226
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UZ52226%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for UZ52226: 0
2026-01-29 06:35:41 [auto1.fr] INFO: Found listing with ID: XX00378
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XX00378%27 HTTP/1.1" 200 None
2026-01-29 06:35:41 [auto1.fr] INFO: Scrape type for XX00378: 0
2026-01-29 06:35:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-29 06:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:35:42 [auto1.fr] INFO: Parsing search results for channel: 24h
2026-01-29 06:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FB97001> (referer: https://www.auto1.com/v1/car-details-view/FB97001/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-29 06:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70c5158f-a64d-5fc1-a4a2-9d357cdc9b42 with identifier: FB97001
2026-01-29 06:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70c5158f-a64d-5fc1-a4a2-9d357cdc9b42 with scrape type 2
2026-01-29 06:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70c5158f-a64d-5fc1-a4a2-9d357cdc9b42 with scrape type 2
2026-01-29 06:35:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 70c5158f-a64d-5fc1-a4a2-9d357cdc9b42, identifier: FB97001
2026-01-29 06:35:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 70c5158f-a64d-5fc1-a4a2-9d357cdc9b42 with identifier: FB97001
2026-01-29 06:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 70c5158f-a64d-5fc1-a4a2-9d357cdc9b42 with identifier: FB97001
2026-01-29 06:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 195955 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    195955
2026-01-29 06:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 70c5158f-a64d-5fc1-a4a2-9d357cdc9b42 spider: auto1.fr
2026-01-29 06:35:43 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.fr, Dropping listing: 70c5158f-a64d-5fc1-a4a2-9d357cdc9b42 due to rule: high_mileage_for_country.json, error: 195955 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    195955
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-01-29T16:29:12Z',
 'fuel_type': 'diesel',
 'id': '70c5158f-a64d-5fc1-a4a2-9d357cdc9b42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB97001',
 'listing': 'auction',
 'location': 'FR, Loyettes',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 195955,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-29',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 2.0 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2018}
2026-01-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB97001%27 HTTP/1.1" 200 None
2026-01-29 06:35:43 [auto1.fr] INFO: Saving data for FB97001: {'auction_closing_time': 1769704152.0, 'created_time': 1769448886.736059, 'last_price_update_time': 1769668543.530939}
2026-01-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FB97001') HTTP/1.1" 204 0
2026-01-29 06:35:43 [scrapy.core.engine] INFO: Closing spider (finished)
2026-01-29 06:35:43 [auto1.fr] INFO: auto1.fr Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2026-01-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20last_price_update_time%20lt%201769236543 HTTP/1.1" 200 None
2026-01-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='AC56538') HTTP/1.1" 204 0
2026-01-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='AD44917') HTTP/1.1" 204 0
2026-01-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='AE70806') HTTP/1.1" 204 0
2026-01-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='AL45792') HTTP/1.1" 204 0
2026-01-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='AP98793') HTTP/1.1" 204 0
2026-01-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='AS33590') HTTP/1.1" 204 0
2026-01-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='AT97365') HTTP/1.1" 204 0
2026-01-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='AU29487') HTTP/1.1" 204 0
2026-01-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='AX91461') HTTP/1.1" 204 0
2026-01-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='AY10551') HTTP/1.1" 204 0
2026-01-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='BA13122') HTTP/1.1" 204 0
2026-01-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='BE03881') HTTP/1.1" 204 0
2026-01-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='BE06514') HTTP/1.1" 204 0
2026-01-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='BE75699') HTTP/1.1" 204 0
2026-01-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='BG34868') HTTP/1.1" 204 0
2026-01-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='BL51674') HTTP/1.1" 204 0
2026-01-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='BL69248') HTTP/1.1" 204 0
2026-01-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='BV20586') HTTP/1.1" 204 0
2026-01-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='BW23999') HTTP/1.1" 204 0
2026-01-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='BX16796') HTTP/1.1" 204 0
2026-01-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='CC99962') HTTP/1.1" 204 0
2026-01-29 06:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='CD65350') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='CE30091') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='CE79946') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='CE98907') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='CH09262') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='CJ51774') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='CJ52166') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='CP15105') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='CS85146') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='CY92045') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='CZ01645') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='DF20687') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='DF25156') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='DF68159') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='DJ30345') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='DJ51191') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='DN94133') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='DP12090') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='DP38047') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='DR56557') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='DS10379') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='DS97278') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='DU62765') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='DV28345') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='DW44007') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='DW44189') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='DW59793') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='EA15756') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='ED25096') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='EF05655') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='EH61047') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='EL79518') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='EM74561') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='EM75316') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='EP53977') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='ES93036') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='EU83130') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='EY99584') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='FA48240') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='FA64823') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='FB22561') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='FB31750') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='FF43921') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='FF88701') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='FH47858') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='FM90629') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='FP53329') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='FX41857') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='FZ04606') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='GA56888') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='GC43002') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='GG80493') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='GJ58809') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='GN58761') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='GR99571') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='GS92981') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='GX43176') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='GX70215') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='GY61340') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='GZ30220') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='HA95721') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='HD10739') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='HD52883') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='HE60710') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='HF17369') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='HT07418') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='HT92408') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='HU01361') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='HV37129') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='HX79023') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='JA53712') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='JA61465') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='JA62198') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='JD57676') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='JE11457') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='JE77720') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='JJ13690') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='JJ89794') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='JL42677') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='JL82435') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='JL87842') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='JR17111') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='JR28828') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='JU59258') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='JX62515') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='JY88597') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='KA86132') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='KB24550') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='KB65074') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='KD00114') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='KF85752') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='KG78592') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='KJ94424') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='KK32611') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='KL77117') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='KM60299') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='KR63204') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='KS10458') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='KV49029') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='KY33945') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='KY39058') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='KZ11520') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='LF89252') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='LL13757') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='LN06746') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='LN24435') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='LP19458') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='LP65803') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='LS81095') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='LZ52338') HTTP/1.1" 204 0
2026-01-29 06:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='MG05439') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='MJ09005') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='MJ83118') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='MK72623') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='MN37795') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='MN50250') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='MS72534') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='MT27472') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='MU00862') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='MV42580') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='MV53393') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='MX86467') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='NC17936') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='ND06140') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='ND42586') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='ND59551') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='NE90599') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='NM79582') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='NM83797') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='NT91728') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='NW06414') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='PB49727') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='PB82080') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='PB98789') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='PD19199') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='PE63391') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='PH06732') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='PJ20031') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='PK52646') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='PR42466') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='PR43049') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='PV12229') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='PV85708') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='RB05543') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='RD01049') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='RK43071') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='RL20367') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='RM79650') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='RM86809') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='RP51235') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='RU74626') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='RV13566') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='RV93754') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='RX28214') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='SE39749') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='SM25889') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='SM85943') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='SR34297') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='ST01655') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='SU98111') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='SW39455') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='SW71090') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='SW98885') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='SX87957') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='SZ38774') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='TB74137') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='TB85462') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='TC58998') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='TE14953') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='TF47516') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='TG21502') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='TH78705') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='TK13594') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='TK47749') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='TL95977') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='TS59334') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='TW11989') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='UA51723') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='UA73413') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='UN71166') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='UR17100') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='UU44063') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='UU45673') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='UU66239') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='VF90329') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='VJ94051') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='VL58327') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='VP08839') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='VS29604') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='VU26839') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='VX30296') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='VZ12247') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='WC14886') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='WG97717') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='WJ49569') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='WJ58165') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='WN56072') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='WT22104') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='WX62663') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='WY77091') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='XC26783') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='XH38842') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='XH73035') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='XL85933') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='XL96729') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='XM86236') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='XM86632') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='XM98164') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='XP96589') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='XS51963') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='XW49320') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='XZ09604') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='XZ69035') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='XZ92750') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='YE35735') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='YH23058') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='YM72418') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='YP09435') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='YR96651') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='YW49663') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='YY81516') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='YZ67252') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZA35340') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZC61751') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZG04469') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZJ26577') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZL70388') HTTP/1.1" 204 0
2026-01-29 06:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZM28685') HTTP/1.1" 204 0
2026-01-29 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZM78044') HTTP/1.1" 204 0
2026-01-29 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZM95539') HTTP/1.1" 204 0
2026-01-29 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZP61293') HTTP/1.1" 204 0
2026-01-29 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZP66282') HTTP/1.1" 204 0
2026-01-29 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZW36842') HTTP/1.1" 204 0
2026-01-29 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZY33506') HTTP/1.1" 204 0
2026-01-29 06:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZZ48126') HTTP/1.1" 204 0
2026-01-29 06:35:46 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (296 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.fr/task_31_2026-01-29T06_00_01.jl
2026-01-29 06:35:46 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 3591104,
 'downloader/request_count': 1744,
 'downloader/request_method_count/GET': 1689,
 'downloader/request_method_count/POST': 55,
 'downloader/response_bytes': 85774817,
 'downloader/response_count': 1744,
 'downloader/response_status_count/200': 1744,
 'dupefilter/filtered': 37,
 'elapsed_time_seconds': 2133.740164,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 1, 29, 6, 35, 46, 51774, tzinfo=datetime.timezone.utc),
 'item_dropped_count': 348,
 'item_dropped_reasons_count/DropItem': 348,
 'item_scraped_count': 296,
 'log_count/DEBUG': 15544,
 'log_count/INFO': 14193,
 'memusage/max': 187514880,
 'memusage/startup': 127000576,
 'photo_download_count': 399,
 'request_depth_max': 56,
 'response_received_count': 1345,
 'scheduler/dequeued': 1744,
 'scheduler/dequeued/memory': 1744,
 'scheduler/enqueued': 1744,
 'scheduler/enqueued/memory': 1744,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 1403,
 'scrapy-zyte-api/error_ratio': 0.041339985744832504,
 'scrapy-zyte-api/errors': 58,
 "scrapy-zyte-api/exception_types/<class 'aiohttp.client_exceptions.ClientConnectorError'>": 58,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 5.764855088644614,
 'scrapy-zyte-api/mean_response_seconds': 5.788326733228389,
 'scrapy-zyte-api/processed': 1345,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 1345,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 1344,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 1345,
 'scrapy-zyte-api/request_args/httpRequestBody': 55,
 'scrapy-zyte-api/request_args/httpRequestMethod': 55,
 'scrapy-zyte-api/request_args/httpResponseBody': 1345,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 1345,
 'scrapy-zyte-api/request_args/sessionContext': 1345,
 'scrapy-zyte-api/request_args/url': 1345,
 'scrapy-zyte-api/status_codes/0': 58,
 'scrapy-zyte-api/status_codes/200': 1345,
 'scrapy-zyte-api/success': 1345,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 1, 29, 6, 0, 12, 311610, tzinfo=datetime.timezone.utc)}
2026-01-29 06:35:46 [scrapy.core.engine] INFO: Spider closed (finished)
2026-01-29 06:35:46 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f2e7e206ed0>
2026-01-29 06:35:46 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f2e7e0a5a10>

PROJECT (sourcing_v2), SPIDER (auto1.fr)